Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of Text
Research objective. The main objectives of developing a module for automatic assessment of students’ papers based on the Russian grading scale system are:– Increased grading efficiency: the automatic system can process a larger number of papers in less time than a lecturer, reducing the time spent o...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Plekhanov Russian University of Economics
2024-07-01
|
| Series: | Открытое образование (Москва) |
| Subjects: | |
| Online Access: | https://openedu.rea.ru/jour/article/view/1032 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849303405386792960 |
|---|---|
| author | A. A. Poguda Jean Max Habib Tape |
| author_facet | A. A. Poguda Jean Max Habib Tape |
| author_sort | A. A. Poguda |
| collection | DOAJ |
| description | Research objective. The main objectives of developing a module for automatic assessment of students’ papers based on the Russian grading scale system are:– Increased grading efficiency: the automatic system can process a larger number of papers in less time than a lecturer, reducing the time spent on checking;– Grading objectivity: the automated system is not subject to bias and other human factors, which ensures more objective grading of papers;– Standardization of grading: the automated system provides a uniform approach to grading, making it more transparent and comparable;– Reduced workload for lecturers: freeing lecturers from the routine work of checking papers allows them to devote more time to individual work with students.Materials and methods. Various methods can be used to develop a module for automatic assessment of students’ work, such as:Machine learning techniques: these techniques allow the module to learn from a set of examples where lecturers have already assessed students’ papers and automatically grade new papers.Natural Language Processing (NLP) methods: these methods allow the module to understand the meaning of text and evaluate it against given criteria.Expert systems methods: these methods allow the module to utilize the knowledge of experts in assessing students’ papers. For this project, we have chosen a combination of Levenshtein and Jaro index algorithms based on the method of assessing students’ knowledge in the Russian system.Results. The following main results were obtained in the course of this research. The module of automatic evaluation of student papers has been successfully developed and implemented on the basis of the Russian system of evaluation scales. Test evaluations of papers showed high accuracy of the module’s predictions and reliability of its work. Comparison of the module with manual assessment confirmed its ability to give comparable results. The module proved to be useful for lecturers, providing them with the ability to quickly and objectively assess students’ papers. Integration of the module with existing learning management systems facilitates its implementation in the educational environment. All the obtained results testify to the high efficiency and prospectivity of the developed module.Conclusion. As a result of this work, a module for automatic evaluation of students’ papers based on the Russian system of evaluation scales was developed and implemented. The main results of the work are that the module has been successfully tested and demonstrated high accuracy and reliability in the assessment of papers. The module has also demonstrated its usefulness for lecturers, providing them with an opportunity to quickly and objectively assess students’ papers. Due to its integration with existing learning management systems, the module can be easily implemented into the educational environment. In general, the results of the work confirm the effectiveness and prospects of using automatic assessment of students’ papers based on the Russian system of assessment scales. |
| format | Article |
| id | doaj-art-e90432e9285d43938d759b1eed8f131b |
| institution | Kabale University |
| issn | 1818-4243 2079-5939 |
| language | English |
| publishDate | 2024-07-01 |
| publisher | Plekhanov Russian University of Economics |
| record_format | Article |
| series | Открытое образование (Москва) |
| spelling | doaj-art-e90432e9285d43938d759b1eed8f131b2025-08-20T03:59:57ZengPlekhanov Russian University of EconomicsОткрытое образование (Москва)1818-42432079-59392024-07-01283465510.21686/1818-4243-2024-3-46-55702Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of TextA. A. Poguda0Jean Max Habib Tape1National Research Tomsk State UniversityNational Research Tomsk State UniversityResearch objective. The main objectives of developing a module for automatic assessment of students’ papers based on the Russian grading scale system are:– Increased grading efficiency: the automatic system can process a larger number of papers in less time than a lecturer, reducing the time spent on checking;– Grading objectivity: the automated system is not subject to bias and other human factors, which ensures more objective grading of papers;– Standardization of grading: the automated system provides a uniform approach to grading, making it more transparent and comparable;– Reduced workload for lecturers: freeing lecturers from the routine work of checking papers allows them to devote more time to individual work with students.Materials and methods. Various methods can be used to develop a module for automatic assessment of students’ work, such as:Machine learning techniques: these techniques allow the module to learn from a set of examples where lecturers have already assessed students’ papers and automatically grade new papers.Natural Language Processing (NLP) methods: these methods allow the module to understand the meaning of text and evaluate it against given criteria.Expert systems methods: these methods allow the module to utilize the knowledge of experts in assessing students’ papers. For this project, we have chosen a combination of Levenshtein and Jaro index algorithms based on the method of assessing students’ knowledge in the Russian system.Results. The following main results were obtained in the course of this research. The module of automatic evaluation of student papers has been successfully developed and implemented on the basis of the Russian system of evaluation scales. Test evaluations of papers showed high accuracy of the module’s predictions and reliability of its work. Comparison of the module with manual assessment confirmed its ability to give comparable results. The module proved to be useful for lecturers, providing them with the ability to quickly and objectively assess students’ papers. Integration of the module with existing learning management systems facilitates its implementation in the educational environment. All the obtained results testify to the high efficiency and prospectivity of the developed module.Conclusion. As a result of this work, a module for automatic evaluation of students’ papers based on the Russian system of evaluation scales was developed and implemented. The main results of the work are that the module has been successfully tested and demonstrated high accuracy and reliability in the assessment of papers. The module has also demonstrated its usefulness for lecturers, providing them with an opportunity to quickly and objectively assess students’ papers. Due to its integration with existing learning management systems, the module can be easily implemented into the educational environment. In general, the results of the work confirm the effectiveness and prospects of using automatic assessment of students’ papers based on the Russian system of assessment scales.https://openedu.rea.ru/jour/article/view/1032automatic evaluation of students’ papersplagiarism detectionrussian system of evaluation scaleseducational technologies |
| spellingShingle | A. A. Poguda Jean Max Habib Tape Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of Text Открытое образование (Москва) automatic evaluation of students’ papers plagiarism detection russian system of evaluation scales educational technologies |
| title | Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of Text |
| title_full | Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of Text |
| title_fullStr | Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of Text |
| title_full_unstemmed | Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of Text |
| title_short | Development of an Algorithm and Module for Automatic Evaluation of Student Papers Based on Semantic Analysis of Text |
| title_sort | development of an algorithm and module for automatic evaluation of student papers based on semantic analysis of text |
| topic | automatic evaluation of students’ papers plagiarism detection russian system of evaluation scales educational technologies |
| url | https://openedu.rea.ru/jour/article/view/1032 |
| work_keys_str_mv | AT aapoguda developmentofanalgorithmandmoduleforautomaticevaluationofstudentpapersbasedonsemanticanalysisoftext AT jeanmaxhabibtape developmentofanalgorithmandmoduleforautomaticevaluationofstudentpapersbasedonsemanticanalysisoftext |