A reality check on chatbot-generated references in global health research
Recent advancements in AI-driven chatbots like Chat Generative Pre-Trained Transformer (ChatGPT) and BARD hold immense promise for transforming scientific research, particularly in healthcare. However, their integration into global health initiatives has been slower than anticipated, raising concern...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-06-01
|
| Series: | Oral Oncology Reports |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S277290602400092X |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841553769081339904 |
|---|---|
| author | Amol S. Dhane Sachin Sarode Gargi Sarode Shruti Singh |
| author_facet | Amol S. Dhane Sachin Sarode Gargi Sarode Shruti Singh |
| author_sort | Amol S. Dhane |
| collection | DOAJ |
| description | Recent advancements in AI-driven chatbots like Chat Generative Pre-Trained Transformer (ChatGPT) and BARD hold immense promise for transforming scientific research, particularly in healthcare. However, their integration into global health initiatives has been slower than anticipated, raising concerns about the accuracy and reliability of health-related information disseminated to the public. This study examines the accuracy of references generated by ChatGPT and BARD in the realm of community health, revealing significant disparities in their performance. While ChatGPT demonstrated some degree of correctness, particularly in certain topics, such as global burden of diseases, references related to health promotion were entirely inaccurate. These findings underscore the challenges in AI-generated references for dynamic health subjects and emphasize the urgent need for improved methods to ensure the trustworthiness of health information. Integration of scientific databases into chatbots, exemplified by initiatives like Scopus AI, presents a promising solution towards achieving accurate and authentic scientific writing in the future. |
| format | Article |
| id | doaj-art-c1738c4c469842608af0dcf2b44c6c19 |
| institution | Kabale University |
| issn | 2772-9060 |
| language | English |
| publishDate | 2024-06-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Oral Oncology Reports |
| spelling | doaj-art-c1738c4c469842608af0dcf2b44c6c192025-01-09T06:15:29ZengElsevierOral Oncology Reports2772-90602024-06-0110100246A reality check on chatbot-generated references in global health researchAmol S. Dhane0Sachin Sarode1Gargi Sarode2Shruti Singh3Research & Development Cell, Dr. D. Y. Patil Vidyapeeth, Sant-Tukaram Nagar, Pimpri, Pune, 411018, MH, India; Dr. D. Y. Patil Unitech Society, Dr. D. Y. Patil Institute of Pharmaceutical Sciences and Research, Pimpri, Pune, Maharashtra, India; Corresponding author. Research & Development Cell, Dr. D. Y. Patil Vidyapeeth, Sant-Tukaram Nagar, Pimpri, Pune, 411018, MH, India.Department of Oral Pathology and Microbiology, Dr. D.Y. Patil Dental College and Hospital, Dr. D.Y. Patil Vidyapeeth, Sant-Tukaram Nagar, Pimpri, Pune, 411018, MH, India; Dr. D. Y. Patil Unitech Society, Dr. D. Y. Patil Institute of Pharmaceutical Sciences and Research, Pimpri, Pune, Maharashtra, IndiaDepartment of Oral Pathology and Microbiology, Dr. D.Y. Patil Dental College and Hospital, Dr. D.Y. Patil Vidyapeeth, Sant-Tukaram Nagar, Pimpri, Pune, 411018, MH, IndiaDepartment of Oral Pathology and Microbiology, Dr. D.Y. Patil Dental College and Hospital, Dr. D.Y. Patil Vidyapeeth, Sant-Tukaram Nagar, Pimpri, Pune, 411018, MH, IndiaRecent advancements in AI-driven chatbots like Chat Generative Pre-Trained Transformer (ChatGPT) and BARD hold immense promise for transforming scientific research, particularly in healthcare. However, their integration into global health initiatives has been slower than anticipated, raising concerns about the accuracy and reliability of health-related information disseminated to the public. This study examines the accuracy of references generated by ChatGPT and BARD in the realm of community health, revealing significant disparities in their performance. While ChatGPT demonstrated some degree of correctness, particularly in certain topics, such as global burden of diseases, references related to health promotion were entirely inaccurate. These findings underscore the challenges in AI-generated references for dynamic health subjects and emphasize the urgent need for improved methods to ensure the trustworthiness of health information. Integration of scientific databases into chatbots, exemplified by initiatives like Scopus AI, presents a promising solution towards achieving accurate and authentic scientific writing in the future.http://www.sciencedirect.com/science/article/pii/S277290602400092XChatGPTBARDHealthChatbot |
| spellingShingle | Amol S. Dhane Sachin Sarode Gargi Sarode Shruti Singh A reality check on chatbot-generated references in global health research Oral Oncology Reports ChatGPT BARD Health Chatbot |
| title | A reality check on chatbot-generated references in global health research |
| title_full | A reality check on chatbot-generated references in global health research |
| title_fullStr | A reality check on chatbot-generated references in global health research |
| title_full_unstemmed | A reality check on chatbot-generated references in global health research |
| title_short | A reality check on chatbot-generated references in global health research |
| title_sort | reality check on chatbot generated references in global health research |
| topic | ChatGPT BARD Health Chatbot |
| url | http://www.sciencedirect.com/science/article/pii/S277290602400092X |
| work_keys_str_mv | AT amolsdhane arealitycheckonchatbotgeneratedreferencesinglobalhealthresearch AT sachinsarode arealitycheckonchatbotgeneratedreferencesinglobalhealthresearch AT gargisarode arealitycheckonchatbotgeneratedreferencesinglobalhealthresearch AT shrutisingh arealitycheckonchatbotgeneratedreferencesinglobalhealthresearch AT amolsdhane realitycheckonchatbotgeneratedreferencesinglobalhealthresearch AT sachinsarode realitycheckonchatbotgeneratedreferencesinglobalhealthresearch AT gargisarode realitycheckonchatbotgeneratedreferencesinglobalhealthresearch AT shrutisingh realitycheckonchatbotgeneratedreferencesinglobalhealthresearch |