Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study
BackgroundAdequate health literacy has been shown to be important for the general health of a population. To address this, it is recommended that patient-targeted medical information is written at a sixth-grade reading level. To make well-informed decisions about their health...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-12-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2024/1/e59843 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846110007724081152 |
|---|---|
| author | Reza Kianian Deyu Sun William Rojas-Carabali Rupesh Agrawal Edmund Tsui |
| author_facet | Reza Kianian Deyu Sun William Rojas-Carabali Rupesh Agrawal Edmund Tsui |
| author_sort | Reza Kianian |
| collection | DOAJ |
| description |
BackgroundAdequate health literacy has been shown to be important for the general health of a population. To address this, it is recommended that patient-targeted medical information is written at a sixth-grade reading level. To make well-informed decisions about their health, patients may want to interact directly with peer-reviewed open access scientific articles. However, studies have shown that such text is often written with highly complex language above the levels that can be comprehended by the general population. Previously, we have published on the use of large language models (LLMs) in easing the readability of patient-targeted health information on the internet. In this study, we continue to explore the advantages of LLMs in patient education.
ObjectiveThis study aimed to explore the use of LLMs, specifically ChatGPT (OpenAI), to enhance the readability of peer-reviewed scientific articles in the field of ophthalmology.
MethodsA total of 12 open access, peer-reviewed papers published by the senior authors of this study (ET and RA) were selected. Readability was assessed using the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook tests. ChatGPT 4.0 was asked “I will give you the text of a peer-reviewed scientific paper. Considering that the recommended readability of the text is 6th grade, can you simplify the following text so that a layperson reading this text can fully comprehend it? - Insert Manuscript Text -”. Appropriateness was evaluated by the 2 uveitis-trained ophthalmologists. Statistical analysis was performed in Microsoft Excel.
ResultsChatGPT significantly lowered the readability and length of the selected papers from 15th to 7th grade (P<.001) while generating responses that were deemed appropriate by expert ophthalmologists.
ConclusionsLLMs show promise in improving health literacy by enhancing the accessibility of peer-reviewed scientific articles and allowing the general population to interact directly with medical literature. |
| format | Article |
| id | doaj-art-e9452882c5424cfab66bf4f317ea5ce8 |
| institution | Kabale University |
| issn | 1438-8871 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-e9452882c5424cfab66bf4f317ea5ce82024-12-24T18:00:30ZengJMIR PublicationsJournal of Medical Internet Research1438-88712024-12-0126e5984310.2196/59843Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability StudyReza Kianianhttps://orcid.org/0000-0002-2737-8818Deyu Sunhttps://orcid.org/0000-0003-4637-0763William Rojas-Carabalihttps://orcid.org/0000-0002-9976-8989Rupesh Agrawalhttps://orcid.org/0000-0002-6662-5850Edmund Tsuihttps://orcid.org/0000-0001-7532-9191 BackgroundAdequate health literacy has been shown to be important for the general health of a population. To address this, it is recommended that patient-targeted medical information is written at a sixth-grade reading level. To make well-informed decisions about their health, patients may want to interact directly with peer-reviewed open access scientific articles. However, studies have shown that such text is often written with highly complex language above the levels that can be comprehended by the general population. Previously, we have published on the use of large language models (LLMs) in easing the readability of patient-targeted health information on the internet. In this study, we continue to explore the advantages of LLMs in patient education. ObjectiveThis study aimed to explore the use of LLMs, specifically ChatGPT (OpenAI), to enhance the readability of peer-reviewed scientific articles in the field of ophthalmology. MethodsA total of 12 open access, peer-reviewed papers published by the senior authors of this study (ET and RA) were selected. Readability was assessed using the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook tests. ChatGPT 4.0 was asked “I will give you the text of a peer-reviewed scientific paper. Considering that the recommended readability of the text is 6th grade, can you simplify the following text so that a layperson reading this text can fully comprehend it? - Insert Manuscript Text -”. Appropriateness was evaluated by the 2 uveitis-trained ophthalmologists. Statistical analysis was performed in Microsoft Excel. ResultsChatGPT significantly lowered the readability and length of the selected papers from 15th to 7th grade (P<.001) while generating responses that were deemed appropriate by expert ophthalmologists. ConclusionsLLMs show promise in improving health literacy by enhancing the accessibility of peer-reviewed scientific articles and allowing the general population to interact directly with medical literature.https://www.jmir.org/2024/1/e59843 |
| spellingShingle | Reza Kianian Deyu Sun William Rojas-Carabali Rupesh Agrawal Edmund Tsui Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study Journal of Medical Internet Research |
| title | Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study |
| title_full | Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study |
| title_fullStr | Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study |
| title_full_unstemmed | Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study |
| title_short | Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study |
| title_sort | large language models may help patients understand peer reviewed scientific articles about ophthalmology development and usability study |
| url | https://www.jmir.org/2024/1/e59843 |
| work_keys_str_mv | AT rezakianian largelanguagemodelsmayhelppatientsunderstandpeerreviewedscientificarticlesaboutophthalmologydevelopmentandusabilitystudy AT deyusun largelanguagemodelsmayhelppatientsunderstandpeerreviewedscientificarticlesaboutophthalmologydevelopmentandusabilitystudy AT williamrojascarabali largelanguagemodelsmayhelppatientsunderstandpeerreviewedscientificarticlesaboutophthalmologydevelopmentandusabilitystudy AT rupeshagrawal largelanguagemodelsmayhelppatientsunderstandpeerreviewedscientificarticlesaboutophthalmologydevelopmentandusabilitystudy AT edmundtsui largelanguagemodelsmayhelppatientsunderstandpeerreviewedscientificarticlesaboutophthalmologydevelopmentandusabilitystudy |