Promises and breakages of automated grading systems: a qualitative study in computer science education
Automated grading systems (AGSs) have gained attention for their potential to streamline assessment in higher education. However, their integration into university assessment practice poses challenges, particularly for teachers in computer science seeking to balance their workload while ensuring an...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2025-02-01
|
| Series: | Education Inquiry |
| Subjects: | |
| Online Access: | https://www.tandfonline.com/doi/10.1080/20004508.2025.2464996 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849762439201030144 |
|---|---|
| author | Clàudia Figueras Alexandra Farazouli Teresa Cerratto Pargman Cormac McGrath Chiara Rossitto |
| author_facet | Clàudia Figueras Alexandra Farazouli Teresa Cerratto Pargman Cormac McGrath Chiara Rossitto |
| author_sort | Clàudia Figueras |
| collection | DOAJ |
| description | Automated grading systems (AGSs) have gained attention for their potential to streamline assessment in higher education. However, their integration into university assessment practice poses challenges, particularly for teachers in computer science seeking to balance their workload while ensuring an adequate and fair assessment of students’ programming skills and knowledge. The present study focuses on individuals with expertise in developing, using, and researching AGSs in higher education, whom we refer to as “AGS experts”. Through semi-structured interviews, we examine how the AGSs they engage with impact their work and assessment practices in computer science education. Drawing on the concept of breakages, we argue that while AGS experts invest time and effort in developing these systems, enticed by the promises of more efficient workload management and improved assessment practices, the actual use may introduce tensions leading to breakages disrupting assessment practices. Our findings illustrate the complexities and the potential impact the deployment of AGS brings to assessment practices within a public university setting and discuss the implications for future research. |
| format | Article |
| id | doaj-art-bd6bbe2d8e1040579f3e3f0534121dd4 |
| institution | DOAJ |
| issn | 2000-4508 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Education Inquiry |
| spelling | doaj-art-bd6bbe2d8e1040579f3e3f0534121dd42025-08-20T03:05:44ZengTaylor & Francis GroupEducation Inquiry2000-45082025-02-0112210.1080/20004508.2025.2464996Promises and breakages of automated grading systems: a qualitative study in computer science educationClàudia Figueras0Alexandra Farazouli1Teresa Cerratto Pargman2Cormac McGrath3Chiara Rossitto4Department of Computer and Systems Sciences, Stockholm University, Stockholm SwedenDepartment of Education, Stockholm University, Stockholm SwedenDepartment of Computer and Systems Sciences, Stockholm University, Stockholm SwedenDepartment of Education, Stockholm University, Stockholm SwedenDepartment of Computer and Systems Sciences, Stockholm University, Stockholm SwedenAutomated grading systems (AGSs) have gained attention for their potential to streamline assessment in higher education. However, their integration into university assessment practice poses challenges, particularly for teachers in computer science seeking to balance their workload while ensuring an adequate and fair assessment of students’ programming skills and knowledge. The present study focuses on individuals with expertise in developing, using, and researching AGSs in higher education, whom we refer to as “AGS experts”. Through semi-structured interviews, we examine how the AGSs they engage with impact their work and assessment practices in computer science education. Drawing on the concept of breakages, we argue that while AGS experts invest time and effort in developing these systems, enticed by the promises of more efficient workload management and improved assessment practices, the actual use may introduce tensions leading to breakages disrupting assessment practices. Our findings illustrate the complexities and the potential impact the deployment of AGS brings to assessment practices within a public university setting and discuss the implications for future research.https://www.tandfonline.com/doi/10.1080/20004508.2025.2464996Automated Grading Systemsautogradinghigher educationbreakagesassessment |
| spellingShingle | Clàudia Figueras Alexandra Farazouli Teresa Cerratto Pargman Cormac McGrath Chiara Rossitto Promises and breakages of automated grading systems: a qualitative study in computer science education Education Inquiry Automated Grading Systems autograding higher education breakages assessment |
| title | Promises and breakages of automated grading systems: a qualitative study in computer science education |
| title_full | Promises and breakages of automated grading systems: a qualitative study in computer science education |
| title_fullStr | Promises and breakages of automated grading systems: a qualitative study in computer science education |
| title_full_unstemmed | Promises and breakages of automated grading systems: a qualitative study in computer science education |
| title_short | Promises and breakages of automated grading systems: a qualitative study in computer science education |
| title_sort | promises and breakages of automated grading systems a qualitative study in computer science education |
| topic | Automated Grading Systems autograding higher education breakages assessment |
| url | https://www.tandfonline.com/doi/10.1080/20004508.2025.2464996 |
| work_keys_str_mv | AT claudiafigueras promisesandbreakagesofautomatedgradingsystemsaqualitativestudyincomputerscienceeducation AT alexandrafarazouli promisesandbreakagesofautomatedgradingsystemsaqualitativestudyincomputerscienceeducation AT teresacerrattopargman promisesandbreakagesofautomatedgradingsystemsaqualitativestudyincomputerscienceeducation AT cormacmcgrath promisesandbreakagesofautomatedgradingsystemsaqualitativestudyincomputerscienceeducation AT chiararossitto promisesandbreakagesofautomatedgradingsystemsaqualitativestudyincomputerscienceeducation |