Next-generation Enem assessment with fewer items and high reliability using CAT

The Exame Nacional do Ensino Médio [Brazilian High School Exam] (Enem) is a test that includes an essay and four 45-item tests. Its reliability and the impact of fatigue on scores are important considerations, so Computerized Adaptive Testing (CAT) may be a way to address these issues. Therefore, t...

Full description

Saved in:
Bibliographic Details
Main Authors: Alexandre Jaloto, Ricardo Primi
Format: Article
Language:Portuguese
Published: Fundação Carlos Chagas 2024-12-01
Series:Estudos em Avaliação Educacional
Subjects:
Online Access:https://publicacoes.fcc.org.br/eae/article/view/10142
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841554055760969728
author Alexandre Jaloto
Ricardo Primi
author_facet Alexandre Jaloto
Ricardo Primi
author_sort Alexandre Jaloto
collection DOAJ
description The Exame Nacional do Ensino Médio [Brazilian High School Exam] (Enem) is a test that includes an essay and four 45-item tests. Its reliability and the impact of fatigue on scores are important considerations, so Computerized Adaptive Testing (CAT) may be a way to address these issues. Therefore, the present study aimed to verify the possibility of reducing the number of items on the Enem, using a CAT. We used tests from the 2009 to 2019 editions of the Enem. We simulated a CAT, which ended when the error was less than 0.30, or when 45 items were applied. On average, the application ranged from 12.0 (Languages and Codes – LC) to 29.2 (Mathematics – MT) items. The results point to the potential of reducing the size of the Enem to 20 items for a proportion that varies from 39.8% (MT) to 94.8% (LC) of the population.
format Article
id doaj-art-a7f214b5f65a4923839307c6e978a464
institution Kabale University
issn 0103-6831
1984-932X
language Portuguese
publishDate 2024-12-01
publisher Fundação Carlos Chagas
record_format Article
series Estudos em Avaliação Educacional
spelling doaj-art-a7f214b5f65a4923839307c6e978a4642025-01-09T02:00:58ZporFundação Carlos ChagasEstudos em Avaliação Educacional0103-68311984-932X2024-12-013510.18222/eae.v35.10142Next-generation Enem assessment with fewer items and high reliability using CATAlexandre Jaloto0Ricardo Primi1Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira (Inep), Brasília-DF, BrasilUniversidade São Francisco (USF), Campinas-SP, Brasil The Exame Nacional do Ensino Médio [Brazilian High School Exam] (Enem) is a test that includes an essay and four 45-item tests. Its reliability and the impact of fatigue on scores are important considerations, so Computerized Adaptive Testing (CAT) may be a way to address these issues. Therefore, the present study aimed to verify the possibility of reducing the number of items on the Enem, using a CAT. We used tests from the 2009 to 2019 editions of the Enem. We simulated a CAT, which ended when the error was less than 0.30, or when 45 items were applied. On average, the application ranged from 12.0 (Languages and Codes – LC) to 29.2 (Mathematics – MT) items. The results point to the potential of reducing the size of the Enem to 20 items for a proportion that varies from 39.8% (MT) to 94.8% (LC) of the population. https://publicacoes.fcc.org.br/eae/article/view/10142Student EvaluationPsychometricsItem Response TheoryHigher Education
spellingShingle Alexandre Jaloto
Ricardo Primi
Next-generation Enem assessment with fewer items and high reliability using CAT
Estudos em Avaliação Educacional
Student Evaluation
Psychometrics
Item Response Theory
Higher Education
title Next-generation Enem assessment with fewer items and high reliability using CAT
title_full Next-generation Enem assessment with fewer items and high reliability using CAT
title_fullStr Next-generation Enem assessment with fewer items and high reliability using CAT
title_full_unstemmed Next-generation Enem assessment with fewer items and high reliability using CAT
title_short Next-generation Enem assessment with fewer items and high reliability using CAT
title_sort next generation enem assessment with fewer items and high reliability using cat
topic Student Evaluation
Psychometrics
Item Response Theory
Higher Education
url https://publicacoes.fcc.org.br/eae/article/view/10142
work_keys_str_mv AT alexandrejaloto nextgenerationenemassessmentwithfeweritemsandhighreliabilityusingcat
AT ricardoprimi nextgenerationenemassessmentwithfeweritemsandhighreliabilityusingcat