ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls
Background: The present research investigates the application of Chat Generative Pre-trained Transformer (ChatGPT), an artificial intelligence (AI)-based language processing model that utilize deep learning programs, in responding to various questions related to oral cancer. Materials and methods: A...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-06-01
|
| Series: | Oral Oncology Reports |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2772906024001262 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841553761797931008 |
|---|---|
| author | Nikunj Maniyar Gargi S. Sarode Sachin C. Sarode Shruti Thakkar |
| author_facet | Nikunj Maniyar Gargi S. Sarode Sachin C. Sarode Shruti Thakkar |
| author_sort | Nikunj Maniyar |
| collection | DOAJ |
| description | Background: The present research investigates the application of Chat Generative Pre-trained Transformer (ChatGPT), an artificial intelligence (AI)-based language processing model that utilize deep learning programs, in responding to various questions related to oral cancer. Materials and methods: A dataset of 25 questions on oral cancer was compiled from diverse sources and categorized into five groups based on key aspects of the disease. ChatGPT version 3.5 was used through a structured approach of submitting questions individually for evaluation. Two experienced oral cancer surgeons independently assessed response accuracy and reproducibility using a grading scale. Results: ChatGPT demonstrated an overall accuracy rate of 80%, providing “comprehensive/correct'' responses for 20 questions. No instances of mixed or misleading responses were observed. The highest accuracy was recorded in questions related to basic knowledge on oral cancer and oral cancer prevention, while questions on oral cancer treatment and post-operative aspects showed a mix of “comprehensive/correct'' and “incomplete/partially correct'' responses. There were no significant differences in response grades between question categories. Conclusion: Despite intrinsic constraints and the potential impact of the freely accessible version used, ChatGPT shows promise as a valuable information source for oral cancer-related queries. Caution is advised in relying solely on ChatGPT for the most current and reliable medical information, emphasizing the need for continuing refinements for its widespread use. |
| format | Article |
| id | doaj-art-ad01c6c234774e9b85da767206a649fb |
| institution | Kabale University |
| issn | 2772-9060 |
| language | English |
| publishDate | 2024-06-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Oral Oncology Reports |
| spelling | doaj-art-ad01c6c234774e9b85da767206a649fb2025-01-09T06:15:38ZengElsevierOral Oncology Reports2772-90602024-06-0110100280ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and PitfallsNikunj Maniyar0Gargi S. Sarode1Sachin C. Sarode2Shruti Thakkar3Department of Orthodontics & Dentofacial Orthopedics, Ahmedabad Dental College and Hospital, Bhadaj, Ahmedabad, Gujarat, IndiaDepartment of Oral Pathology and Microbiology, Dr. D.Y. Patil Dental College and Hospital, Dr. D.Y. Patil Vidyapeeth, Sant-Tukaram Nagar, Pimpri, Pune, 411018, MH, IndiaDepartment of Oral Pathology and Microbiology, Dr. D.Y. Patil Dental College and Hospital, Dr. D.Y. Patil Vidyapeeth, Sant-Tukaram Nagar, Pimpri, Pune, 411018, MH, India; Corresponding author.Independent Researcher, Mulund, Mumbai, Maharashtra, IndiaBackground: The present research investigates the application of Chat Generative Pre-trained Transformer (ChatGPT), an artificial intelligence (AI)-based language processing model that utilize deep learning programs, in responding to various questions related to oral cancer. Materials and methods: A dataset of 25 questions on oral cancer was compiled from diverse sources and categorized into five groups based on key aspects of the disease. ChatGPT version 3.5 was used through a structured approach of submitting questions individually for evaluation. Two experienced oral cancer surgeons independently assessed response accuracy and reproducibility using a grading scale. Results: ChatGPT demonstrated an overall accuracy rate of 80%, providing “comprehensive/correct'' responses for 20 questions. No instances of mixed or misleading responses were observed. The highest accuracy was recorded in questions related to basic knowledge on oral cancer and oral cancer prevention, while questions on oral cancer treatment and post-operative aspects showed a mix of “comprehensive/correct'' and “incomplete/partially correct'' responses. There were no significant differences in response grades between question categories. Conclusion: Despite intrinsic constraints and the potential impact of the freely accessible version used, ChatGPT shows promise as a valuable information source for oral cancer-related queries. Caution is advised in relying solely on ChatGPT for the most current and reliable medical information, emphasizing the need for continuing refinements for its widespread use.http://www.sciencedirect.com/science/article/pii/S2772906024001262Artificial intelligenceChatbotChatGPT 3.5Machine learningNatural language processingOral cancer |
| spellingShingle | Nikunj Maniyar Gargi S. Sarode Sachin C. Sarode Shruti Thakkar ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls Oral Oncology Reports Artificial intelligence Chatbot ChatGPT 3.5 Machine learning Natural language processing Oral cancer |
| title | ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls |
| title_full | ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls |
| title_fullStr | ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls |
| title_full_unstemmed | ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls |
| title_short | ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls |
| title_sort | chatgpt conversations on oral cancer unveiling chatgpt s potential and pitfalls |
| topic | Artificial intelligence Chatbot ChatGPT 3.5 Machine learning Natural language processing Oral cancer |
| url | http://www.sciencedirect.com/science/article/pii/S2772906024001262 |
| work_keys_str_mv | AT nikunjmaniyar chatgptconversationsonoralcancerunveilingchatgptspotentialandpitfalls AT gargissarode chatgptconversationsonoralcancerunveilingchatgptspotentialandpitfalls AT sachincsarode chatgptconversationsonoralcancerunveilingchatgptspotentialandpitfalls AT shrutithakkar chatgptconversationsonoralcancerunveilingchatgptspotentialandpitfalls |