Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on Assignments
Objective: This study evaluated the effectiveness of an AI-based tool (ChatGPT-4) (AIT) vs a human tutor (HT) in providing feedback on dental students’ assignments. Methods: A total of 194 answers to two histology questions were assessed by both tutors using the same rubric. Students compared feedba...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-02-01
|
| Series: | International Dental Journal |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S002065392401640X |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832592783965159424 |
|---|---|
| author | Chantha K. Jayawardena Yuvika Gunathilake Dhammika Ihalagedara |
| author_facet | Chantha K. Jayawardena Yuvika Gunathilake Dhammika Ihalagedara |
| author_sort | Chantha K. Jayawardena |
| collection | DOAJ |
| description | Objective: This study evaluated the effectiveness of an AI-based tool (ChatGPT-4) (AIT) vs a human tutor (HT) in providing feedback on dental students’ assignments. Methods: A total of 194 answers to two histology questions were assessed by both tutors using the same rubric. Students compared feedback from both tutors and evaluated its accuracy against a standard rubric. Students’ perceptions were collected on five dimensions of feedback quality. A subject expert also evaluated feedback provided by the two tutors for 40 randomly selected answers. Results: No significant differences were found in total scores between HT and AIT for one question, but a significant difference was noted for Question 2 and overall scores. Students’ perceptions showed no differences regarding understanding mistakes, promoting critical thinking, feedback comprehension, or relevance. However, students felt more comfortable with HT feedback (X2 = 9.01, P < .05). In contrast, expert evaluation highlighted that AIT scored higher in identifying mistakes, with significant differences in clarity (W = 40.5, P < .001) and suggestions for improvement (W = 96.5, P < .001). Conclusion: AIT demonstrates significant potential to complement HT by providing detailed feedback in a shorter timeframe. While students did not perceive differences in feedback quality, expert analysis identified AIT as superior in clarity and suggestions for improvement. |
| format | Article |
| id | doaj-art-4d6290b894444d26aa5947c268e7de62 |
| institution | Kabale University |
| issn | 0020-6539 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Dental Journal |
| spelling | doaj-art-4d6290b894444d26aa5947c268e7de622025-01-21T04:12:50ZengElsevierInternational Dental Journal0020-65392025-02-01751100108Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on AssignmentsChantha K. Jayawardena0Yuvika Gunathilake1Dhammika Ihalagedara2Department of Basic Sciences, Faculty of Dental Sciences, University of Peradeniya, Peradeniya, 20400 Sri Lanka; Corresponding author. Department of Basic Sciences, Faculty of Dental Sciences, University of Peradeniya, Peradeniya 20400, Sri Lanka.Department of Basic Sciences, Faculty of Dental Sciences, University of Peradeniya, Peradeniya, 20400 Sri Lanka; Ministry of Health, Colombo, Sri LankaDepartment of Basic Sciences, Faculty of Dental Sciences, University of Peradeniya, Peradeniya, 20400 Sri LankaObjective: This study evaluated the effectiveness of an AI-based tool (ChatGPT-4) (AIT) vs a human tutor (HT) in providing feedback on dental students’ assignments. Methods: A total of 194 answers to two histology questions were assessed by both tutors using the same rubric. Students compared feedback from both tutors and evaluated its accuracy against a standard rubric. Students’ perceptions were collected on five dimensions of feedback quality. A subject expert also evaluated feedback provided by the two tutors for 40 randomly selected answers. Results: No significant differences were found in total scores between HT and AIT for one question, but a significant difference was noted for Question 2 and overall scores. Students’ perceptions showed no differences regarding understanding mistakes, promoting critical thinking, feedback comprehension, or relevance. However, students felt more comfortable with HT feedback (X2 = 9.01, P < .05). In contrast, expert evaluation highlighted that AIT scored higher in identifying mistakes, with significant differences in clarity (W = 40.5, P < .001) and suggestions for improvement (W = 96.5, P < .001). Conclusion: AIT demonstrates significant potential to complement HT by providing detailed feedback in a shorter timeframe. While students did not perceive differences in feedback quality, expert analysis identified AIT as superior in clarity and suggestions for improvement.http://www.sciencedirect.com/science/article/pii/S002065392401640XArtificial intelligence (AI)Student feedbackEducational assessmentTutorsStudent engagementTutorial assignment |
| spellingShingle | Chantha K. Jayawardena Yuvika Gunathilake Dhammika Ihalagedara Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on Assignments International Dental Journal Artificial intelligence (AI) Student feedback Educational assessment Tutors Student engagement Tutorial assignment |
| title | Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on Assignments |
| title_full | Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on Assignments |
| title_fullStr | Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on Assignments |
| title_full_unstemmed | Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on Assignments |
| title_short | Dental Students’ Learning Experience: Artificial Intelligence vs Human Feedback on Assignments |
| title_sort | dental students learning experience artificial intelligence vs human feedback on assignments |
| topic | Artificial intelligence (AI) Student feedback Educational assessment Tutors Student engagement Tutorial assignment |
| url | http://www.sciencedirect.com/science/article/pii/S002065392401640X |
| work_keys_str_mv | AT chanthakjayawardena dentalstudentslearningexperienceartificialintelligencevshumanfeedbackonassignments AT yuvikagunathilake dentalstudentslearningexperienceartificialintelligencevshumanfeedbackonassignments AT dhammikaihalagedara dentalstudentslearningexperienceartificialintelligencevshumanfeedbackonassignments |