Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory
This study aims to develop and validate a high-order thinking skills (HOTS)-based multiple-choice instrument to assess citizen participation in consumer education. Guided by Bannister and Monsma's framework, the instrument was developed through expert reviews and tested empirically using the Ra...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
lppm Universitas Negeri Jakarta
2025-07-01
|
| Series: | JISAE (Journal of Indonesian Student Assessment and Evaluation) |
| Subjects: | |
| Online Access: | https://journal.unj.ac.id/unj/index.php/jisae/article/view/55820 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849704332191072256 |
|---|---|
| author | Putu Diah Ari Kusumadewi Sri Wening Emy Budiastuti Widihastuti Widihastuti |
| author_facet | Putu Diah Ari Kusumadewi Sri Wening Emy Budiastuti Widihastuti Widihastuti |
| author_sort | Putu Diah Ari Kusumadewi |
| collection | DOAJ |
| description | This study aims to develop and validate a high-order thinking skills (HOTS)-based multiple-choice instrument to assess citizen participation in consumer education. Guided by Bannister and Monsma's framework, the instrument was developed through expert reviews and tested empirically using the Rasch model. The content validity, assessed by Aiken's V, CVR, and I-CVI, showed high expert agreement. Empirical validation involving 250 university students indicated excellent item reliability (0.99), acceptable person reliability (0.79), and appropriate item fit. All 24 items analyzed fell within acceptable MNSQ ranges and showed positive point-measure correlations. While item difficulties ranged from –2.23 to +1.87 logits, most were easier for the sample, suggesting potential refinement for high-ability students. The findings support the instrument's validity and reliability for assessing Higher Order Thinking Skills (HOTS) in citizen participation, providing a robust tool for assessing transformative consumer education. |
| format | Article |
| id | doaj-art-32650f2023784647b2b51ee02fdc2b58 |
| institution | DOAJ |
| issn | 2442-4919 2597-8934 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | lppm Universitas Negeri Jakarta |
| record_format | Article |
| series | JISAE (Journal of Indonesian Student Assessment and Evaluation) |
| spelling | doaj-art-32650f2023784647b2b51ee02fdc2b582025-08-20T03:16:47Zenglppm Universitas Negeri JakartaJISAE (Journal of Indonesian Student Assessment and Evaluation)2442-49192597-89342025-07-01111354510.21009/jisae.v11i1.55820256883Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response TheoryPutu Diah Ari Kusumadewi0Sri Wening1Emy Budiastuti2Widihastuti Widihastuti3Universitas Negeri YogyakartaUniversitas Negeri YogyakartaUniversitas Negeri YogyakartaUniversitas Negeri YogyakartaThis study aims to develop and validate a high-order thinking skills (HOTS)-based multiple-choice instrument to assess citizen participation in consumer education. Guided by Bannister and Monsma's framework, the instrument was developed through expert reviews and tested empirically using the Rasch model. The content validity, assessed by Aiken's V, CVR, and I-CVI, showed high expert agreement. Empirical validation involving 250 university students indicated excellent item reliability (0.99), acceptable person reliability (0.79), and appropriate item fit. All 24 items analyzed fell within acceptable MNSQ ranges and showed positive point-measure correlations. While item difficulties ranged from –2.23 to +1.87 logits, most were easier for the sample, suggesting potential refinement for high-ability students. The findings support the instrument's validity and reliability for assessing Higher Order Thinking Skills (HOTS) in citizen participation, providing a robust tool for assessing transformative consumer education.https://journal.unj.ac.id/unj/index.php/jisae/article/view/55820consumer educationcitizen participationcontent validityrasch model |
| spellingShingle | Putu Diah Ari Kusumadewi Sri Wening Emy Budiastuti Widihastuti Widihastuti Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory JISAE (Journal of Indonesian Student Assessment and Evaluation) consumer education citizen participation content validity rasch model |
| title | Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory |
| title_full | Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory |
| title_fullStr | Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory |
| title_full_unstemmed | Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory |
| title_short | Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory |
| title_sort | development and validation of a higher order thinking skills based test on citizen participation in consumer education using item response theory |
| topic | consumer education citizen participation content validity rasch model |
| url | https://journal.unj.ac.id/unj/index.php/jisae/article/view/55820 |
| work_keys_str_mv | AT putudiaharikusumadewi developmentandvalidationofahigherorderthinkingskillsbasedtestoncitizenparticipationinconsumereducationusingitemresponsetheory AT sriwening developmentandvalidationofahigherorderthinkingskillsbasedtestoncitizenparticipationinconsumereducationusingitemresponsetheory AT emybudiastuti developmentandvalidationofahigherorderthinkingskillsbasedtestoncitizenparticipationinconsumereducationusingitemresponsetheory AT widihastutiwidihastuti developmentandvalidationofahigherorderthinkingskillsbasedtestoncitizenparticipationinconsumereducationusingitemresponsetheory |