Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and Understanding
Background/Objectives: The rapid development of Large Language Models (LLMs) presents promising applications in healthcare, including patient education. In anesthesia, where patient anxiety is common due to misunderstandings and fears, LLMs could alleviate perioperative anxiety by providing accessib...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Anesthesia Research |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2813-5806/2/1/4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850137795461382144 |
|---|---|
| author | Jeevan Avinassh Ratnagandhi Praghya Godavarthy Mahindra Gnaneswaran Bryan Lim Rupeshraj Vittalraj |
| author_facet | Jeevan Avinassh Ratnagandhi Praghya Godavarthy Mahindra Gnaneswaran Bryan Lim Rupeshraj Vittalraj |
| author_sort | Jeevan Avinassh Ratnagandhi |
| collection | DOAJ |
| description | Background/Objectives: The rapid development of Large Language Models (LLMs) presents promising applications in healthcare, including patient education. In anesthesia, where patient anxiety is common due to misunderstandings and fears, LLMs could alleviate perioperative anxiety by providing accessible and accurate information. This study explores the potential of LLMs to enhance patient education on anesthetic and perioperative care, addressing time constraints faced by anesthetists. Methods: Three language models—ChatGPT-4, Claude 3, and Gemini—were evaluated using three common patient prompts. To minimize bias, incognito mode was used. Readability was assessed with the Flesch–Kincaid, Flesch Reading Ease, and Coleman–Liau indices. Response quality was rated for clarity, comprehension, and informativeness using the DISCERN score and Likert Scale. Results: Claude 3 required the highest reading level, delivering detailed responses but lacking citations. ChatGPT-4o offered accessible and concise answers but missed key details. Gemini provided reliable and comprehensive information and emphasized professional guidance but lacked citations. According to DISCERN and Likert scores, Gemini had the highest rank for reliability and patient friendliness. Conclusions: This study found that Gemini provided the most reliable information, followed by Claude 3, although no significant differences were observed. All models showed limitations in bias and lacked sufficient citations. While ChatGPT-4o was the most comprehensible, it lacked clinical depth. Further research is needed to balance simplicity with clinical accuracy, explore Artificial Intelligence (AI)–physician collaboration, and assess AI’s impact on patient safety and medical education. |
| format | Article |
| id | doaj-art-83a4d5c56f1b43a8abdd01e9191c49bb |
| institution | OA Journals |
| issn | 2813-5806 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Anesthesia Research |
| spelling | doaj-art-83a4d5c56f1b43a8abdd01e9191c49bb2025-08-20T02:30:45ZengMDPI AGAnesthesia Research2813-58062025-01-0121410.3390/anesthres2010004Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and UnderstandingJeevan Avinassh Ratnagandhi0Praghya Godavarthy1Mahindra Gnaneswaran2Bryan Lim3Rupeshraj Vittalraj4Department of Emergency Medicine, Peninsula Health, Melbourne, VIC 3199, AustraliaDepartment of Emergency Medicine, Peninsula Health, Melbourne, VIC 3199, AustraliaDepartment of Emergency Medicine, Peninsula Health, Melbourne, VIC 3199, AustraliaDepartment of Emergency Medicine, Western Health, Melbourne, VIC 3011, AustraliaDepartment of Anesthesia, Eastern Health, Melbourne, VIC 3128, AustraliaBackground/Objectives: The rapid development of Large Language Models (LLMs) presents promising applications in healthcare, including patient education. In anesthesia, where patient anxiety is common due to misunderstandings and fears, LLMs could alleviate perioperative anxiety by providing accessible and accurate information. This study explores the potential of LLMs to enhance patient education on anesthetic and perioperative care, addressing time constraints faced by anesthetists. Methods: Three language models—ChatGPT-4, Claude 3, and Gemini—were evaluated using three common patient prompts. To minimize bias, incognito mode was used. Readability was assessed with the Flesch–Kincaid, Flesch Reading Ease, and Coleman–Liau indices. Response quality was rated for clarity, comprehension, and informativeness using the DISCERN score and Likert Scale. Results: Claude 3 required the highest reading level, delivering detailed responses but lacking citations. ChatGPT-4o offered accessible and concise answers but missed key details. Gemini provided reliable and comprehensive information and emphasized professional guidance but lacked citations. According to DISCERN and Likert scores, Gemini had the highest rank for reliability and patient friendliness. Conclusions: This study found that Gemini provided the most reliable information, followed by Claude 3, although no significant differences were observed. All models showed limitations in bias and lacked sufficient citations. While ChatGPT-4o was the most comprehensible, it lacked clinical depth. Further research is needed to balance simplicity with clinical accuracy, explore Artificial Intelligence (AI)–physician collaboration, and assess AI’s impact on patient safety and medical education.https://www.mdpi.com/2813-5806/2/1/4LLManestheticeducationpublic healthperioperative |
| spellingShingle | Jeevan Avinassh Ratnagandhi Praghya Godavarthy Mahindra Gnaneswaran Bryan Lim Rupeshraj Vittalraj Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and Understanding Anesthesia Research LLM anesthetic education public health perioperative |
| title | Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and Understanding |
| title_full | Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and Understanding |
| title_fullStr | Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and Understanding |
| title_full_unstemmed | Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and Understanding |
| title_short | Enhancing Anesthetic Patient Education Through the Utilization of Large Language Models for Improved Communication and Understanding |
| title_sort | enhancing anesthetic patient education through the utilization of large language models for improved communication and understanding |
| topic | LLM anesthetic education public health perioperative |
| url | https://www.mdpi.com/2813-5806/2/1/4 |
| work_keys_str_mv | AT jeevanavinasshratnagandhi enhancinganestheticpatienteducationthroughtheutilizationoflargelanguagemodelsforimprovedcommunicationandunderstanding AT praghyagodavarthy enhancinganestheticpatienteducationthroughtheutilizationoflargelanguagemodelsforimprovedcommunicationandunderstanding AT mahindragnaneswaran enhancinganestheticpatienteducationthroughtheutilizationoflargelanguagemodelsforimprovedcommunicationandunderstanding AT bryanlim enhancinganestheticpatienteducationthroughtheutilizationoflargelanguagemodelsforimprovedcommunicationandunderstanding AT rupeshrajvittalraj enhancinganestheticpatienteducationthroughtheutilizationoflargelanguagemodelsforimprovedcommunicationandunderstanding |