Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics
Science literacy is a critical skill in the 21st century, particularly for middle school students navigating the complexities of energy concepts in science education. This study aims to develop and validate an essay-based assessment instrument designed to measure students' science literacy skil...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
lppm Universitas Negeri Jakarta
2024-12-01
|
| Series: | JISAE (Journal of Indonesian Student Assessment and Evaluation) |
| Subjects: | |
| Online Access: | https://journal.unj.ac.id/unj/index.php/jisae/article/view/50762 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850048843403493376 |
|---|---|
| author | Riky Sheptian Dwi Rismi Ocy Dinny Devi Triana Lussy Dwi Utami Wahyuni |
| author_facet | Riky Sheptian Dwi Rismi Ocy Dinny Devi Triana Lussy Dwi Utami Wahyuni |
| author_sort | Riky Sheptian |
| collection | DOAJ |
| description | Science literacy is a critical skill in the 21st century, particularly for middle school students navigating the complexities of energy concepts in science education. This study aims to develop and validate an essay-based assessment instrument designed to measure students' science literacy skills in the context of energy. Employing a mixed-methods approach, the research involved expert validation, panel validation, and empirical testing with 111 students from junior high school in Sukabumi, Indonesia. The results revealed that the instrument possesses strong content validity, with Aiken's V, CVR, and I-CVI scores exceeding 0.80. Construct validity analysis using Exploratory Factor Analysis (EFA) confirmed the suitability of the factor structure, while reliability tests yielded McDonald’s ω = 0.886 and Cronbach's α = 0.922, indicating excellent internal consistency. The instrument also includes a detailed analytical rubric to ensure objective and transparent evaluation. This validated tool offers educators a reliable means of assessing students' science literacy comprehensively, addressing a critical gap in science education evaluation. By fostering more effective assessment practices, this study contributes to enhancing the quality of science education in Indonesia and beyond. |
| format | Article |
| id | doaj-art-e67dbe79de22455f9e150a9da7725df8 |
| institution | DOAJ |
| issn | 2442-4919 2597-8934 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | lppm Universitas Negeri Jakarta |
| record_format | Article |
| series | JISAE (Journal of Indonesian Student Assessment and Evaluation) |
| spelling | doaj-art-e67dbe79de22455f9e150a9da7725df82025-08-20T02:53:50Zenglppm Universitas Negeri JakartaJISAE (Journal of Indonesian Student Assessment and Evaluation)2442-49192597-89342024-12-011028810010.21009/jisae.v10i2.50762251788Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy TopicsRiky Sheptian0Dwi Rismi Ocy1Dinny Devi Triana2Lussy Dwi Utami Wahyuni3Universitas Negeri JakartaUniversitas Negeri JakartaUniversitas Negeri JakartaUniversitas Negeri JakartaScience literacy is a critical skill in the 21st century, particularly for middle school students navigating the complexities of energy concepts in science education. This study aims to develop and validate an essay-based assessment instrument designed to measure students' science literacy skills in the context of energy. Employing a mixed-methods approach, the research involved expert validation, panel validation, and empirical testing with 111 students from junior high school in Sukabumi, Indonesia. The results revealed that the instrument possesses strong content validity, with Aiken's V, CVR, and I-CVI scores exceeding 0.80. Construct validity analysis using Exploratory Factor Analysis (EFA) confirmed the suitability of the factor structure, while reliability tests yielded McDonald’s ω = 0.886 and Cronbach's α = 0.922, indicating excellent internal consistency. The instrument also includes a detailed analytical rubric to ensure objective and transparent evaluation. This validated tool offers educators a reliable means of assessing students' science literacy comprehensively, addressing a critical gap in science education evaluation. By fostering more effective assessment practices, this study contributes to enhancing the quality of science education in Indonesia and beyond.https://journal.unj.ac.id/unj/index.php/jisae/article/view/50762science literacy; assessment instrument; essay test; energy concepts; exploratory factor analysis (efa). |
| spellingShingle | Riky Sheptian Dwi Rismi Ocy Dinny Devi Triana Lussy Dwi Utami Wahyuni Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics JISAE (Journal of Indonesian Student Assessment and Evaluation) science literacy; assessment instrument; essay test; energy concepts; exploratory factor analysis (efa). |
| title | Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics |
| title_full | Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics |
| title_fullStr | Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics |
| title_full_unstemmed | Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics |
| title_short | Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics |
| title_sort | developing a validated essay based assessment instrument to measure science literacy in energy topics |
| topic | science literacy; assessment instrument; essay test; energy concepts; exploratory factor analysis (efa). |
| url | https://journal.unj.ac.id/unj/index.php/jisae/article/view/50762 |
| work_keys_str_mv | AT rikysheptian developingavalidatedessaybasedassessmentinstrumenttomeasurescienceliteracyinenergytopics AT dwirismiocy developingavalidatedessaybasedassessmentinstrumenttomeasurescienceliteracyinenergytopics AT dinnydevitriana developingavalidatedessaybasedassessmentinstrumenttomeasurescienceliteracyinenergytopics AT lussydwiutamiwahyuni developingavalidatedessaybasedassessmentinstrumenttomeasurescienceliteracyinenergytopics |