Measurement Invariance Testing with Alignment Method: Many Groups Comparison
It is necessary to examine the measurement invariance (MI) among groups in studies where different groups are compared by using a measurement instrument. Most of the studies, measurement invariance is tested with multiple group confirmatory factor analysis. This model applies many model adjustments b...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
izzet kara
2020-12-01
|
| Series: | International Journal of Assessment Tools in Education |
| Subjects: | |
| Online Access: | https://dergipark.org.tr/tr/download/article-file/1035557 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850197719919886336 |
|---|---|
| author | Gözde Sırgancı Gizem Uyumaz Alperen Yandı |
| author_facet | Gözde Sırgancı Gizem Uyumaz Alperen Yandı |
| author_sort | Gözde Sırgancı |
| collection | DOAJ |
| description | It is necessary to examine the measurement invariance (MI) among groups in studies where different groups are compared by using a measurement instrument. Most of the studies, measurement invariance is tested with multiple group confirmatory factor analysis. This model applies many model adjustments based on the modification indexes. Therefore, it is not practical due to too many large modification indexes while testing MI over many groups. Besides scalar model is a poor model fit when comparing many groups and so does not hold MI. In this study, the aim is to explain the basic concepts and processes of the alignment method which is offered as a new method for testing MI and illustrate an application on the real data set. In this study, measurement invariance among 56 countries including Turkey is tested with alignment method in order to set an example for researchers. For this purpose, the Instrumental Motivation Scale data, which is one of the psychological measurement instruments used in PISA 2015, was used. As a result of MG-CFA, it was found that configural invariance was ensured. The fit indexes of CFI and TLI were calculated as 0.982 and 0.946 respectively in this stage. After that, metric invariance was tested by considering the difference of fit indices obtained for the two stages. It was found that the metric invariance could not be provided. Alignment results show which countries hold MI and which do not. Besides it provides information which items have the most invariants for groups that hold MI. |
| format | Article |
| id | doaj-art-2ea96b64dd48406fa1f39d68cc63fc18 |
| institution | OA Journals |
| issn | 2148-7456 |
| language | English |
| publishDate | 2020-12-01 |
| publisher | izzet kara |
| record_format | Article |
| series | International Journal of Assessment Tools in Education |
| spelling | doaj-art-2ea96b64dd48406fa1f39d68cc63fc182025-08-20T02:13:03Zengizzet karaInternational Journal of Assessment Tools in Education2148-74562020-12-017465767310.21449/ijate.714218618Measurement Invariance Testing with Alignment Method: Many Groups ComparisonGözde Sırgancı0https://orcid.org/0000-0003-4824-5413Gizem Uyumaz1https://orcid.org/0000-0003-0792-2289Alperen Yandı2https://orcid.org/0000-0002-1612-4249Yozgat Bozok UniversityGiresun UniversityBOLU ABANT İZZET BAYSAL ÜNİVERSİTESİIt is necessary to examine the measurement invariance (MI) among groups in studies where different groups are compared by using a measurement instrument. Most of the studies, measurement invariance is tested with multiple group confirmatory factor analysis. This model applies many model adjustments based on the modification indexes. Therefore, it is not practical due to too many large modification indexes while testing MI over many groups. Besides scalar model is a poor model fit when comparing many groups and so does not hold MI. In this study, the aim is to explain the basic concepts and processes of the alignment method which is offered as a new method for testing MI and illustrate an application on the real data set. In this study, measurement invariance among 56 countries including Turkey is tested with alignment method in order to set an example for researchers. For this purpose, the Instrumental Motivation Scale data, which is one of the psychological measurement instruments used in PISA 2015, was used. As a result of MG-CFA, it was found that configural invariance was ensured. The fit indexes of CFI and TLI were calculated as 0.982 and 0.946 respectively in this stage. After that, metric invariance was tested by considering the difference of fit indices obtained for the two stages. It was found that the metric invariance could not be provided. Alignment results show which countries hold MI and which do not. Besides it provides information which items have the most invariants for groups that hold MI.https://dergipark.org.tr/tr/download/article-file/1035557multi-group confirmatory factor analysisvaliditymodification indexesmulti-group confirmatoryfactor analysisvaliditymodification indexes |
| spellingShingle | Gözde Sırgancı Gizem Uyumaz Alperen Yandı Measurement Invariance Testing with Alignment Method: Many Groups Comparison International Journal of Assessment Tools in Education multi-group confirmatory factor analysis validity modification indexes multi-group confirmatoryfactor analysis validity modification indexes |
| title | Measurement Invariance Testing with Alignment Method: Many Groups Comparison |
| title_full | Measurement Invariance Testing with Alignment Method: Many Groups Comparison |
| title_fullStr | Measurement Invariance Testing with Alignment Method: Many Groups Comparison |
| title_full_unstemmed | Measurement Invariance Testing with Alignment Method: Many Groups Comparison |
| title_short | Measurement Invariance Testing with Alignment Method: Many Groups Comparison |
| title_sort | measurement invariance testing with alignment method many groups comparison |
| topic | multi-group confirmatory factor analysis validity modification indexes multi-group confirmatoryfactor analysis validity modification indexes |
| url | https://dergipark.org.tr/tr/download/article-file/1035557 |
| work_keys_str_mv | AT gozdesırgancı measurementinvariancetestingwithalignmentmethodmanygroupscomparison AT gizemuyumaz measurementinvariancetestingwithalignmentmethodmanygroupscomparison AT alperenyandı measurementinvariancetestingwithalignmentmethodmanygroupscomparison |