A Study on the Consistency and Efficiency of Student Performance Evaluation Methods: A Mathematical Framework and Comparative Simulation Results
Background: Consistent evaluation methods foster fairness, reduce bias, and enhance student understanding and motivation. Notably, mathematical inconsistencies, such as improper weighting, flawed averaging, and unsound scaling, can undermine the accuracy and reliability of assigned grades. This pape...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-05-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/15/11/6014 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Background: Consistent evaluation methods foster fairness, reduce bias, and enhance student understanding and motivation. Notably, mathematical inconsistencies, such as improper weighting, flawed averaging, and unsound scaling, can undermine the accuracy and reliability of assigned grades. This paper addresses the critical need for consistent student evaluation methods, with a primary focus on ensuring mathematical consistency within grading systems. Methods: We propose a scheme aimed at identifying inconsistencies in student evaluation related to the mathematical framework of the used grading method. To explain the functioning of our construct, we provide mathematical representation of conventional grading methods, including summative assessments, rubrics, and the Systematic Task-Based Assessment Method (STBAM) that we have recently developed, which incorporates both traditional and fuzzy logic-based grading modules. We introduce a Consistency Index <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mo>(</mo><msub><mrow><mi>C</mi><mi>I</mi></mrow><mrow><mi>M</mi></mrow></msub><mo>)</mo></mrow></semantics></math></inline-formula> depending on the Mean Absolute Deviation of assigned scores <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mrow><mo>(</mo><mi>M</mi><mi>A</mi><mi>D</mi></mrow><mrow><mi>M</mi></mrow></msub><mo>)</mo></mrow></semantics></math></inline-formula> and a method’s Complexity Pointer <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mrow><mo>(</mo><mi>C</mi><mi>P</mi></mrow><mrow><mi>M</mi></mrow></msub></mrow></semantics></math></inline-formula>). We also propose a method’s Efficiency Index <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mrow><mo>(</mo><mi>β</mi></mrow><mrow><mi>M</mi></mrow></msub><mo>)</mo></mrow></semantics></math></inline-formula> expressed in terms of the Consistency Index and the latter indicator. We compared the mathematical consistency and efficiency of the methods addressed in this study through simulation runs. Results: We demonstrated how the proposed indices can reveal the strengths and weaknesses of each grading scheme analysed. Conclusions: The fuzzy logic-based modulus of the STBAM yielded the highest values of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mrow><mi>C</mi><mi>I</mi></mrow><mrow><mi>M</mi></mrow></msub></mrow></semantics></math></inline-formula> and <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mrow><mi>β</mi></mrow><mrow><mi>M</mi></mrow></msub></mrow></semantics></math></inline-formula>. However, performing a pending analysis of scalability, teacher training, and cultural adaptability would be essential to strengthen the potential of the STBAM to be adopted as a reliable grading alternative to conventional grading approaches. In the meantime, our approach could provide a clear, logical, and defensible framework for testing the mathematical consistency of student assessment methods. |
|---|---|
| ISSN: | 2076-3417 |