How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world?
Aim. This study explores the impact of Artificial Intelligence (AI) -driven text generation on authorship recognition and its implications for education. Specifically, it examines how individuals with varying levels of experience using ChatGPT perceive AI-generated texts and whether editing affects...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
H.S. Skovoroda Kharkiv National Pedagogical University
2025-03-01
|
| Series: | Educational Challenges |
| Subjects: | |
| Online Access: | https://educationalchallenges.org.ua/index.php/education_challenges/article/view/334 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849311665289428992 |
|---|---|
| author | Veronika Yurchenko Oleksii Nalyvaiko |
| author_facet | Veronika Yurchenko Oleksii Nalyvaiko |
| author_sort | Veronika Yurchenko |
| collection | DOAJ |
| description | Aim. This study explores the impact of Artificial Intelligence (AI) -driven text generation on authorship recognition and its implications for education. Specifically, it examines how individuals with varying levels of experience using ChatGPT perceive AI-generated texts and whether editing affects their ability to distinguish between human and AI-authored content. The study aims to inform strategies for integrating AI literacy into education while addressing challenges in authorship attribution.
Methodology. A quantitative study was conducted with 85 participants, categorized based on their ChatGPT usage: no experience (n=22), occasional use (n=31), and daily use (n=32). Participants evaluated texts across five stylistic genres (literary, journalistic, scientific, philosophical, and promotional) and attempted to determine authorship (human, AI-generated, or AI-edited). The data were analyzed using statistical methods, including the Kruskal-Wallis test, ANOVA, and Pearson’s correlation analysis.
Results. The findings indicate that participants struggled to differentiate between human and AI-generated texts, with an average accuracy of 5.48 out of 15. The ability to identify authorship varied by genre, with philosophical texts being the easiest to recognize and journalistic texts posing the greatest challenge. Experience with ChatGPT did not significantly improve recognition accuracy. Editing AI-generated texts further blurred the distinction between human and machine authorship.
Conclusions. The results highlight the need for educational approaches that enhance critical literacy and awareness of AI-generated content. AI tools can serve as collaborative writing aids, but their integration into learning requires ethical considerations and adapted assessment strategies. Future research should expand the sample size and investigate the effects of long-term AI exposure on writing perception. |
| format | Article |
| id | doaj-art-fad50feff66f4e208d1e4c6f0c408024 |
| institution | Kabale University |
| issn | 2709-7986 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | H.S. Skovoroda Kharkiv National Pedagogical University |
| record_format | Article |
| series | Educational Challenges |
| spelling | doaj-art-fad50feff66f4e208d1e4c6f0c4080242025-08-20T03:53:18ZengH.S. Skovoroda Kharkiv National Pedagogical UniversityEducational Challenges2709-79862025-03-01301138–155138–15510.34142/2709-7986.2025.30.1.09335How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world?Veronika Yurchenko0https://orcid.org/0009-0000-1065-9595Oleksii Nalyvaiko1https://orcid.org/0000-0002-7094-1047V. N. Karazin Kharkiv National University, Ukraine.V. N. Karazin Kharkiv National University, Ukraine.Aim. This study explores the impact of Artificial Intelligence (AI) -driven text generation on authorship recognition and its implications for education. Specifically, it examines how individuals with varying levels of experience using ChatGPT perceive AI-generated texts and whether editing affects their ability to distinguish between human and AI-authored content. The study aims to inform strategies for integrating AI literacy into education while addressing challenges in authorship attribution. Methodology. A quantitative study was conducted with 85 participants, categorized based on their ChatGPT usage: no experience (n=22), occasional use (n=31), and daily use (n=32). Participants evaluated texts across five stylistic genres (literary, journalistic, scientific, philosophical, and promotional) and attempted to determine authorship (human, AI-generated, or AI-edited). The data were analyzed using statistical methods, including the Kruskal-Wallis test, ANOVA, and Pearson’s correlation analysis. Results. The findings indicate that participants struggled to differentiate between human and AI-generated texts, with an average accuracy of 5.48 out of 15. The ability to identify authorship varied by genre, with philosophical texts being the easiest to recognize and journalistic texts posing the greatest challenge. Experience with ChatGPT did not significantly improve recognition accuracy. Editing AI-generated texts further blurred the distinction between human and machine authorship. Conclusions. The results highlight the need for educational approaches that enhance critical literacy and awareness of AI-generated content. AI tools can serve as collaborative writing aids, but their integration into learning requires ethical considerations and adapted assessment strategies. Future research should expand the sample size and investigate the effects of long-term AI exposure on writing perception.https://educationalchallenges.org.ua/index.php/education_challenges/article/view/334ai-generated textchatgptauthorship recognitiondigital literacyartificial intelligence in educationhuman-ai collaborationwriting assessment |
| spellingShingle | Veronika Yurchenko Oleksii Nalyvaiko How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world? Educational Challenges ai-generated text chatgpt authorship recognition digital literacy artificial intelligence in education human-ai collaboration writing assessment |
| title | How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world? |
| title_full | How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world? |
| title_fullStr | How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world? |
| title_full_unstemmed | How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world? |
| title_short | How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world? |
| title_sort | how chatgpt shapes a new reality of writing is there a place for humans in an artificial world |
| topic | ai-generated text chatgpt authorship recognition digital literacy artificial intelligence in education human-ai collaboration writing assessment |
| url | https://educationalchallenges.org.ua/index.php/education_challenges/article/view/334 |
| work_keys_str_mv | AT veronikayurchenko howchatgptshapesanewrealityofwritingisthereaplaceforhumansinanartificialworld AT oleksiinalyvaiko howchatgptshapesanewrealityofwritingisthereaplaceforhumansinanartificialworld |