Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical Kinetics

The main goal of this study was to validate the strategy for the assessment of the cognitive complexity of chemical kinetics exam items. The strategy included three steps: 1) assessment of the difficulty of concepts, 2) assessment of distractor value. and 3) assessment of concepts’ interactivity. On...

Full description

Saved in:
Bibliographic Details
Main Authors: Saša Horvat, Dušica Rodić, Nevena Jović, Tamara Rončević, Snežana Babić-Kekez
Format: Article
Language:English
Published: University of Ljubljana 2023-12-01
Series:Center for Educational Policy Studies Journal
Subjects:
Online Access:https://cepsj.si/index.php/cepsj/article/view/1235
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849397219762896896
author Saša Horvat
Dušica Rodić
Nevena Jović
Tamara Rončević
Snežana Babić-Kekez
author_facet Saša Horvat
Dušica Rodić
Nevena Jović
Tamara Rončević
Snežana Babić-Kekez
author_sort Saša Horvat
collection DOAJ
description The main goal of this study was to validate the strategy for the assessment of the cognitive complexity of chemical kinetics exam items. The strategy included three steps: 1) assessment of the difficulty of concepts, 2) assessment of distractor value. and 3) assessment of concepts’ interactivity. One of the tasks was to determine whether there were misconceptions by students that might have influenced their achievement. Eighty-seven students in the first year of secondary school participated in the study. A knowledge test was used as a research instrument to assess the performance, and a five-point Likert-type scale was used to evaluate the perceived mental effort. The strategy was validated using regression analysis from which significant correlation coefficients were obtained between selected variables: students’ achievement and invested mental effort (dependent variables) and a numerical rating of cognitive complexity (independent variable).
format Article
id doaj-art-af8dfb4f0e444397a6455e4812194ce7
institution Kabale University
issn 1855-9719
2232-2647
language English
publishDate 2023-12-01
publisher University of Ljubljana
record_format Article
series Center for Educational Policy Studies Journal
spelling doaj-art-af8dfb4f0e444397a6455e4812194ce72025-08-20T03:39:05ZengUniversity of LjubljanaCenter for Educational Policy Studies Journal1855-97192232-26472023-12-0113411113310.26529/cepsj.1235Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical KineticsSaša HorvatDušica RodićNevena JovićTamara RončevićSnežana Babić-KekezThe main goal of this study was to validate the strategy for the assessment of the cognitive complexity of chemical kinetics exam items. The strategy included three steps: 1) assessment of the difficulty of concepts, 2) assessment of distractor value. and 3) assessment of concepts’ interactivity. One of the tasks was to determine whether there were misconceptions by students that might have influenced their achievement. Eighty-seven students in the first year of secondary school participated in the study. A knowledge test was used as a research instrument to assess the performance, and a five-point Likert-type scale was used to evaluate the perceived mental effort. The strategy was validated using regression analysis from which significant correlation coefficients were obtained between selected variables: students’ achievement and invested mental effort (dependent variables) and a numerical rating of cognitive complexity (independent variable).https://cepsj.si/index.php/cepsj/article/view/1235mental effortperformancechemical equilibrium
spellingShingle Saša Horvat
Dušica Rodić
Nevena Jović
Tamara Rončević
Snežana Babić-Kekez
Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical Kinetics
Center for Educational Policy Studies Journal
mental effort
performance
chemical equilibrium
title Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical Kinetics
title_full Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical Kinetics
title_fullStr Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical Kinetics
title_full_unstemmed Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical Kinetics
title_short Validation of the Strategy for Determining the Numerical Rating of the Cognitive Complexity of Exam Items in the Field of Chemical Kinetics
title_sort validation of the strategy for determining the numerical rating of the cognitive complexity of exam items in the field of chemical kinetics
topic mental effort
performance
chemical equilibrium
url https://cepsj.si/index.php/cepsj/article/view/1235
work_keys_str_mv AT sasahorvat validationofthestrategyfordeterminingthenumericalratingofthecognitivecomplexityofexamitemsinthefieldofchemicalkinetics
AT dusicarodic validationofthestrategyfordeterminingthenumericalratingofthecognitivecomplexityofexamitemsinthefieldofchemicalkinetics
AT nevenajovic validationofthestrategyfordeterminingthenumericalratingofthecognitivecomplexityofexamitemsinthefieldofchemicalkinetics
AT tamararoncevic validationofthestrategyfordeterminingthenumericalratingofthecognitivecomplexityofexamitemsinthefieldofchemicalkinetics
AT snezanababickekez validationofthestrategyfordeterminingthenumericalratingofthecognitivecomplexityofexamitemsinthefieldofchemicalkinetics