Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School Students
The release of ChatGPT in late 2022 prompted widespread concern about the implications of artificial intelligence for academic integrity, but thus far there has been little direct empirical evidence to inform this debate. Participants (69 high school teachers, 140 high school students, total N=209)...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-01-01
|
| Series: | Human Behavior and Emerging Technologies |
| Online Access: | http://dx.doi.org/10.1155/2023/1923981 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849764745632022528 |
|---|---|
| author | Tal Waltzer Riley L. Cox Gail D. Heyman |
| author_facet | Tal Waltzer Riley L. Cox Gail D. Heyman |
| author_sort | Tal Waltzer |
| collection | DOAJ |
| description | The release of ChatGPT in late 2022 prompted widespread concern about the implications of artificial intelligence for academic integrity, but thus far there has been little direct empirical evidence to inform this debate. Participants (69 high school teachers, 140 high school students, total N=209) took an AI Identification Test in which they read pairs of essays—one written by a high school student and the other by ChatGPT—and guessed which was generated by the chatbot. Accuracy was only 70% for teachers, and it was slightly worse for students (62%). Self-reported confidence did not predict accuracy, nor did experience with ChatGPT or subject-matter expertise. Well-written student essays were especially hard to differentiate from the ChatGPT texts. In another set of measures, students reported greater optimism than their teachers did about the future role of ChatGPT in education. Students expressed disapproval of submitting ChatGPT-generated essays as one’s own but rated this and other possible academic integrity violations involving ChatGPT less negatively than teachers did. These results form an empirical basis for further work on the relationship between AI and academic integrity. |
| format | Article |
| id | doaj-art-c1ae7d2d84b345e1886df3ef9b03784c |
| institution | DOAJ |
| issn | 2578-1863 |
| language | English |
| publishDate | 2023-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Human Behavior and Emerging Technologies |
| spelling | doaj-art-c1ae7d2d84b345e1886df3ef9b03784c2025-08-20T03:05:03ZengWileyHuman Behavior and Emerging Technologies2578-18632023-01-01202310.1155/2023/1923981Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School StudentsTal Waltzer0Riley L. Cox1Gail D. Heyman2Department of PsychologyDepartment of PsychologyDepartment of PsychologyThe release of ChatGPT in late 2022 prompted widespread concern about the implications of artificial intelligence for academic integrity, but thus far there has been little direct empirical evidence to inform this debate. Participants (69 high school teachers, 140 high school students, total N=209) took an AI Identification Test in which they read pairs of essays—one written by a high school student and the other by ChatGPT—and guessed which was generated by the chatbot. Accuracy was only 70% for teachers, and it was slightly worse for students (62%). Self-reported confidence did not predict accuracy, nor did experience with ChatGPT or subject-matter expertise. Well-written student essays were especially hard to differentiate from the ChatGPT texts. In another set of measures, students reported greater optimism than their teachers did about the future role of ChatGPT in education. Students expressed disapproval of submitting ChatGPT-generated essays as one’s own but rated this and other possible academic integrity violations involving ChatGPT less negatively than teachers did. These results form an empirical basis for further work on the relationship between AI and academic integrity.http://dx.doi.org/10.1155/2023/1923981 |
| spellingShingle | Tal Waltzer Riley L. Cox Gail D. Heyman Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School Students Human Behavior and Emerging Technologies |
| title | Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School Students |
| title_full | Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School Students |
| title_fullStr | Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School Students |
| title_full_unstemmed | Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School Students |
| title_short | Testing the Ability of Teachers and Students to Differentiate between Essays Generated by ChatGPT and High School Students |
| title_sort | testing the ability of teachers and students to differentiate between essays generated by chatgpt and high school students |
| url | http://dx.doi.org/10.1155/2023/1923981 |
| work_keys_str_mv | AT talwaltzer testingtheabilityofteachersandstudentstodifferentiatebetweenessaysgeneratedbychatgptandhighschoolstudents AT rileylcox testingtheabilityofteachersandstudentstodifferentiatebetweenessaysgeneratedbychatgptandhighschoolstudents AT gaildheyman testingtheabilityofteachersandstudentstodifferentiatebetweenessaysgeneratedbychatgptandhighschoolstudents |