A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI Collaboration
Background/purpose – ChatGPT, an AI-powered chatbot designed with generative pre-trained transformer architecture, have intrigued millions of people from diverse backgrounds since its first release, and generated excitement with its groundbreaking performance in numerous use cases they have been tes...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
ÜNİVERSİTEPARK Limited
2023-07-01
|
| Series: | Educational Process: International Journal |
| Subjects: | |
| Online Access: | https://www.edupij.com/files/1/articles/article_304/EDUPIJ_304_article_64a1ee9436505.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850216539712651264 |
|---|---|
| author | Turgut Karakose, Murat Demirkol, Nurcihan Aslan, Hüseyin Köse, Ramazan Yirci |
| author_facet | Turgut Karakose, Murat Demirkol, Nurcihan Aslan, Hüseyin Köse, Ramazan Yirci |
| author_sort | Turgut Karakose, Murat Demirkol, Nurcihan Aslan, Hüseyin Köse, Ramazan Yirci |
| collection | DOAJ |
| description | Background/purpose – ChatGPT, an AI-powered chatbot designed with generative pre-trained transformer architecture, have intrigued millions of people from diverse backgrounds since its first release, and generated excitement with its groundbreaking performance in numerous use cases they have been tested. Its ability to generate coherent and contextually relevant responses across a wide range of topics have also attracted the attention of researchers, and several scholars have investigated the potential uses of this AI-based tool to promote scientific work. The current study was designed with a similar purpose, and aimed to conduct scientific research on the effects of COVID-19 pandemic on education with a collaborative analysis of human-artificial intelligence.
Materials/methods – The data were generated from simultaneous interviews with ChatGPT-3.5 and 4, and their responses were evaluated comparatively in terms of the accuracy, clarity, conciseness, and breadth of information provided for (1) the definition of the COVID-19 pandemic, (2) the negative impact of the COVID-19 pandemic on education, (3) the positive impact of the COVID-19 pandemic on education, (4) recommendations to improve the effectiveness of teaching and learning during the COVID-19 pandemic. We evaluated the responses using a trichotomous rating system, and also calculated Cohen’s kappa values to assess inter-rater agreements for each category of evaluation.
Results – The results indicated that both versions demonstrated a strong potential to generate accurate, clear and concise information with a satisfactory breadth. As can be expected, ChatGPT-4 provided more categorized and synthesized information, and was better at demonstrating critical reasoning.
Conclusion – These results indicate that ChatGPT is a promising tool that can support scientific research process in collaboration with human intelligence, and its newer versions could be developed in a way that these chatbots could be ethically and safely integrated into different stages of scientific work. |
| format | Article |
| id | doaj-art-3c3f6b83615347c7b2ccf4057236bc9b |
| institution | OA Journals |
| issn | 2147-0901 |
| language | English |
| publishDate | 2023-07-01 |
| publisher | ÜNİVERSİTEPARK Limited |
| record_format | Article |
| series | Educational Process: International Journal |
| spelling | doaj-art-3c3f6b83615347c7b2ccf4057236bc9b2025-08-20T02:08:16ZengÜNİVERSİTEPARK LimitedEducational Process: International Journal2147-09012023-07-0112310.22521/edupij.2023.123.1A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI CollaborationTurgut Karakose, Murat Demirkol, Nurcihan Aslan, Hüseyin Köse, Ramazan Yircihttps://orcid.org/0000-0003-0346-8154Background/purpose – ChatGPT, an AI-powered chatbot designed with generative pre-trained transformer architecture, have intrigued millions of people from diverse backgrounds since its first release, and generated excitement with its groundbreaking performance in numerous use cases they have been tested. Its ability to generate coherent and contextually relevant responses across a wide range of topics have also attracted the attention of researchers, and several scholars have investigated the potential uses of this AI-based tool to promote scientific work. The current study was designed with a similar purpose, and aimed to conduct scientific research on the effects of COVID-19 pandemic on education with a collaborative analysis of human-artificial intelligence. Materials/methods – The data were generated from simultaneous interviews with ChatGPT-3.5 and 4, and their responses were evaluated comparatively in terms of the accuracy, clarity, conciseness, and breadth of information provided for (1) the definition of the COVID-19 pandemic, (2) the negative impact of the COVID-19 pandemic on education, (3) the positive impact of the COVID-19 pandemic on education, (4) recommendations to improve the effectiveness of teaching and learning during the COVID-19 pandemic. We evaluated the responses using a trichotomous rating system, and also calculated Cohen’s kappa values to assess inter-rater agreements for each category of evaluation. Results – The results indicated that both versions demonstrated a strong potential to generate accurate, clear and concise information with a satisfactory breadth. As can be expected, ChatGPT-4 provided more categorized and synthesized information, and was better at demonstrating critical reasoning. Conclusion – These results indicate that ChatGPT is a promising tool that can support scientific research process in collaboration with human intelligence, and its newer versions could be developed in a way that these chatbots could be ethically and safely integrated into different stages of scientific work.https://www.edupij.com/files/1/articles/article_304/EDUPIJ_304_article_64a1ee9436505.pdfchatgptcovid-19 pandemicartificial intelligenceglobal health crisiseducationchatbot |
| spellingShingle | Turgut Karakose, Murat Demirkol, Nurcihan Aslan, Hüseyin Köse, Ramazan Yirci A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI Collaboration Educational Process: International Journal chatgpt covid-19 pandemic artificial intelligence global health crisis education chatbot |
| title | A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI Collaboration |
| title_full | A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI Collaboration |
| title_fullStr | A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI Collaboration |
| title_full_unstemmed | A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI Collaboration |
| title_short | A Conversation with ChatGPT about the Impact of the COVID-19 Pandemic on Education: Comparative Review Based on Human–AI Collaboration |
| title_sort | conversation with chatgpt about the impact of the covid 19 pandemic on education comparative review based on human ai collaboration |
| topic | chatgpt covid-19 pandemic artificial intelligence global health crisis education chatbot |
| url | https://www.edupij.com/files/1/articles/article_304/EDUPIJ_304_article_64a1ee9436505.pdf |
| work_keys_str_mv | AT turgutkarakosemuratdemirkolnurcihanaslanhuseyinkoseramazanyirci aconversationwithchatgptabouttheimpactofthecovid19pandemiconeducationcomparativereviewbasedonhumanaicollaboration AT turgutkarakosemuratdemirkolnurcihanaslanhuseyinkoseramazanyirci conversationwithchatgptabouttheimpactofthecovid19pandemiconeducationcomparativereviewbasedonhumanaicollaboration |