Development of a Numeracy Assessment Instrument for Vocational High School (VHS) Students
Numeracy skills are essential components that must be mastered by Vocational High School (VHS) graduates to enter the workforce. Developing a quality instrument based on the Item Response Theory (IRT) approach is necessary to measure numeracy skills. Since the development pro...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SEAMEO Regional Centre for QITEP in Mathematics
2024-10-01
|
| Series: | Southeast Asian Mathematics Education Journal |
| Subjects: | |
| Online Access: | https://journal.qitepinmath.org/index.php/seamej/article/view/306 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832591961122406400 |
|---|---|
| author | Jumini Jumini Kana Hidayati |
| author_facet | Jumini Jumini Kana Hidayati |
| author_sort | Jumini Jumini |
| collection | DOAJ |
| description | Numeracy skills are essential components that must be mastered by Vocational High School (VHS) graduates to enter the workforce. Developing a quality instrument based on the Item Response Theory (IRT) approach is necessary to measure numeracy skills. Since the development process involved VHS students, the instrument is developed based on the characteristics of the users. This study aims to (1) develop a quality numeracy assessment instrument for VHS students and (2) describe the numeracy skill profile of VHS eleven graders in Sleman Regency based on the assessment result. The subjects of the wide-scale trial were 374 students from nine VHSs in the Sleman Regency of Indonesia, assessed in nine study areas. Data analysis used the Item Response Theory (IRT) of the Quest program with the outputs: (1) An instrument consisting of 35 questions involving multiple-choice, complex multiple-choice, short answer, and essay. All items are valid qualitatively based on expert judgment and quantitatively based on infit and outfit MNSQ value and unidimensionality. The test item reliability value is 0.96, including in the special category, and the person reliability estimateis 0.89, categorized as good. Based on Total Information Function (TIF) and Standard Error of Measurement (SEM), the instrument is reliable in estimating the numeracy skills of the students with the ability ranging from -3.2 to 3.3 logit or covering the ability categories of low, medium, and high. The difficulty level of all items is in the range of -2.0 to 2.0, falling into the good category. (2) Most students, covering 67% of VHS students in Sleman Regency, have numeracy skills at the Basic level. |
| format | Article |
| id | doaj-art-a61cf3d27ee542e49640050cc356fcbf |
| institution | Kabale University |
| issn | 2089-4716 2721-8546 |
| language | English |
| publishDate | 2024-10-01 |
| publisher | SEAMEO Regional Centre for QITEP in Mathematics |
| record_format | Article |
| series | Southeast Asian Mathematics Education Journal |
| spelling | doaj-art-a61cf3d27ee542e49640050cc356fcbf2025-01-22T04:25:00ZengSEAMEO Regional Centre for QITEP in MathematicsSoutheast Asian Mathematics Education Journal2089-47162721-85462024-10-0114111410.46517/seamej.v14i1.306119Development of a Numeracy Assessment Instrument for Vocational High School (VHS) StudentsJumini Jumini0Kana Hidayati1State Vocational High School 1 KalasanDepartment of Mathematics Education, Yogyakarta State UniversityNumeracy skills are essential components that must be mastered by Vocational High School (VHS) graduates to enter the workforce. Developing a quality instrument based on the Item Response Theory (IRT) approach is necessary to measure numeracy skills. Since the development process involved VHS students, the instrument is developed based on the characteristics of the users. This study aims to (1) develop a quality numeracy assessment instrument for VHS students and (2) describe the numeracy skill profile of VHS eleven graders in Sleman Regency based on the assessment result. The subjects of the wide-scale trial were 374 students from nine VHSs in the Sleman Regency of Indonesia, assessed in nine study areas. Data analysis used the Item Response Theory (IRT) of the Quest program with the outputs: (1) An instrument consisting of 35 questions involving multiple-choice, complex multiple-choice, short answer, and essay. All items are valid qualitatively based on expert judgment and quantitatively based on infit and outfit MNSQ value and unidimensionality. The test item reliability value is 0.96, including in the special category, and the person reliability estimateis 0.89, categorized as good. Based on Total Information Function (TIF) and Standard Error of Measurement (SEM), the instrument is reliable in estimating the numeracy skills of the students with the ability ranging from -3.2 to 3.3 logit or covering the ability categories of low, medium, and high. The difficulty level of all items is in the range of -2.0 to 2.0, falling into the good category. (2) Most students, covering 67% of VHS students in Sleman Regency, have numeracy skills at the Basic level.https://journal.qitepinmath.org/index.php/seamej/article/view/306assessmentinstrumentnumeracyvocational high school |
| spellingShingle | Jumini Jumini Kana Hidayati Development of a Numeracy Assessment Instrument for Vocational High School (VHS) Students Southeast Asian Mathematics Education Journal assessment instrument numeracy vocational high school |
| title | Development of a Numeracy Assessment Instrument for Vocational High School (VHS) Students |
| title_full | Development of a Numeracy Assessment Instrument for Vocational High School (VHS) Students |
| title_fullStr | Development of a Numeracy Assessment Instrument for Vocational High School (VHS) Students |
| title_full_unstemmed | Development of a Numeracy Assessment Instrument for Vocational High School (VHS) Students |
| title_short | Development of a Numeracy Assessment Instrument for Vocational High School (VHS) Students |
| title_sort | development of a numeracy assessment instrument for vocational high school vhs students |
| topic | assessment instrument numeracy vocational high school |
| url | https://journal.qitepinmath.org/index.php/seamej/article/view/306 |
| work_keys_str_mv | AT juminijumini developmentofanumeracyassessmentinstrumentforvocationalhighschoolvhsstudents AT kanahidayati developmentofanumeracyassessmentinstrumentforvocationalhighschoolvhsstudents |