What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory Study
BackgroundFor hospitalized patients, the discharge letter serves as a crucial source of medical information, outlining important discharge instructions and health management tasks. However, these letters are often written in professional jargon, making them difficult for pati...
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-01-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2025/1/e67143 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832592039507656704 |
|---|---|
| author | Felix Eisinger Friederike Holderried Moritz Mahling Christian Stegemann–Philipps Anne Herrmann–Werner Eric Nazarenus Alessandra Sonanini Martina Guthoff Carsten Eickhoff Martin Holderried |
| author_facet | Felix Eisinger Friederike Holderried Moritz Mahling Christian Stegemann–Philipps Anne Herrmann–Werner Eric Nazarenus Alessandra Sonanini Martina Guthoff Carsten Eickhoff Martin Holderried |
| author_sort | Felix Eisinger |
| collection | DOAJ |
| description |
BackgroundFor hospitalized patients, the discharge letter serves as a crucial source of medical information, outlining important discharge instructions and health management tasks. However, these letters are often written in professional jargon, making them difficult for patients with limited medical knowledge to understand. Large language models, such as GPT, have the potential to transform these discharge summaries into patient-friendly letters, improving accessibility and understanding.
ObjectiveThis study aims to use GPT-4 to convert discharge letters into more readable patient-centered letters. We evaluated how effectively and comprehensively GPT-4 identified and transferred patient safety–relevant information from the discharge letters to the transformed patient letters.
MethodsThree discharge letters were created based on common medical conditions, containing 72 patient safety–relevant pieces of information, referred to as “learning objectives.” GPT-4 was prompted to transform these discharge letters into patient-centered letters. The resulting patient letters were analyzed for medical accuracy, patient centricity, and the ability to identify and translate the learning objectives. Bloom’s taxonomy was applied to analyze and categorize the learning objectives.
ResultsGPT-4 addressed the majority (56/72, 78%) of the learning objectives from the discharge letters. However, 11 of the 72 (15%) learning objectives were not included in the majority of the patient-centered letters. A qualitative analysis based on Bloom’s taxonomy revealed that learning objectives in the “Understand” category (9/11) were more frequently omitted than those in the “Remember” category (2/11). Most of the missing learning objectives were related to the content field of “prevention of complications.” By contrast, learning objectives regarding “lifestyle” and “organizational” aspects were addressed more frequently. Medical errors were found in a small proportion of sentences (31/787, 3.9%). In terms of patient centricity, the patient-centered letters demonstrated better readability than the discharge letters. Compared with discharge letters, they included fewer medical terms (132/860, 15.3%, vs 165/273, 60/4%), fewer abbreviations (43/860, 5%, vs 49/273, 17.9%), and more explanations of medical terms (121/131, 92.4%, vs 0/165, 0%).
ConclusionsOur study demonstrates that GPT-4 has the potential to transform discharge letters into more patient-centered communication. While the readability and patient centricity of the transformed letters are well-established, they do not fully address all patient safety–relevant information, resulting in the omission of key aspects. Further optimization of prompt engineering may help address this issue and improve the completeness of the transformation. |
| format | Article |
| id | doaj-art-f2a0930e4e3543f7a2aa6069d7c674c0 |
| institution | Kabale University |
| issn | 1438-8871 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-f2a0930e4e3543f7a2aa6069d7c674c02025-01-21T21:31:08ZengJMIR PublicationsJournal of Medical Internet Research1438-88712025-01-0127e6714310.2196/67143What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory StudyFelix Eisingerhttps://orcid.org/0009-0009-8902-532XFriederike Holderriedhttps://orcid.org/0000-0003-1828-0920Moritz Mahlinghttps://orcid.org/0000-0001-7960-4015Christian Stegemann–Philippshttps://orcid.org/0000-0002-8122-5724Anne Herrmann–Wernerhttps://orcid.org/0000-0003-2413-7047Eric Nazarenushttps://orcid.org/0009-0000-8635-3891Alessandra Sonaninihttps://orcid.org/0009-0009-4893-3989Martina Guthoffhttps://orcid.org/0000-0002-4294-980XCarsten Eickhoffhttps://orcid.org/0000-0001-9895-4061Martin Holderriedhttps://orcid.org/0000-0002-1337-0516 BackgroundFor hospitalized patients, the discharge letter serves as a crucial source of medical information, outlining important discharge instructions and health management tasks. However, these letters are often written in professional jargon, making them difficult for patients with limited medical knowledge to understand. Large language models, such as GPT, have the potential to transform these discharge summaries into patient-friendly letters, improving accessibility and understanding. ObjectiveThis study aims to use GPT-4 to convert discharge letters into more readable patient-centered letters. We evaluated how effectively and comprehensively GPT-4 identified and transferred patient safety–relevant information from the discharge letters to the transformed patient letters. MethodsThree discharge letters were created based on common medical conditions, containing 72 patient safety–relevant pieces of information, referred to as “learning objectives.” GPT-4 was prompted to transform these discharge letters into patient-centered letters. The resulting patient letters were analyzed for medical accuracy, patient centricity, and the ability to identify and translate the learning objectives. Bloom’s taxonomy was applied to analyze and categorize the learning objectives. ResultsGPT-4 addressed the majority (56/72, 78%) of the learning objectives from the discharge letters. However, 11 of the 72 (15%) learning objectives were not included in the majority of the patient-centered letters. A qualitative analysis based on Bloom’s taxonomy revealed that learning objectives in the “Understand” category (9/11) were more frequently omitted than those in the “Remember” category (2/11). Most of the missing learning objectives were related to the content field of “prevention of complications.” By contrast, learning objectives regarding “lifestyle” and “organizational” aspects were addressed more frequently. Medical errors were found in a small proportion of sentences (31/787, 3.9%). In terms of patient centricity, the patient-centered letters demonstrated better readability than the discharge letters. Compared with discharge letters, they included fewer medical terms (132/860, 15.3%, vs 165/273, 60/4%), fewer abbreviations (43/860, 5%, vs 49/273, 17.9%), and more explanations of medical terms (121/131, 92.4%, vs 0/165, 0%). ConclusionsOur study demonstrates that GPT-4 has the potential to transform discharge letters into more patient-centered communication. While the readability and patient centricity of the transformed letters are well-established, they do not fully address all patient safety–relevant information, resulting in the omission of key aspects. Further optimization of prompt engineering may help address this issue and improve the completeness of the transformation.https://www.jmir.org/2025/1/e67143 |
| spellingShingle | Felix Eisinger Friederike Holderried Moritz Mahling Christian Stegemann–Philipps Anne Herrmann–Werner Eric Nazarenus Alessandra Sonanini Martina Guthoff Carsten Eickhoff Martin Holderried What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory Study Journal of Medical Internet Research |
| title | What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory Study |
| title_full | What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory Study |
| title_fullStr | What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory Study |
| title_full_unstemmed | What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory Study |
| title_short | What’s Going On With Me and How Can I Better Manage My Health? The Potential of GPT-4 to Transform Discharge Letters Into Patient-Centered Letters to Enhance Patient Safety: Prospective, Exploratory Study |
| title_sort | what s going on with me and how can i better manage my health the potential of gpt 4 to transform discharge letters into patient centered letters to enhance patient safety prospective exploratory study |
| url | https://www.jmir.org/2025/1/e67143 |
| work_keys_str_mv | AT felixeisinger whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT friederikeholderried whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT moritzmahling whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT christianstegemannphilipps whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT anneherrmannwerner whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT ericnazarenus whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT alessandrasonanini whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT martinaguthoff whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT carsteneickhoff whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy AT martinholderried whatsgoingonwithmeandhowcanibettermanagemyhealththepotentialofgpt4totransformdischargelettersintopatientcenteredletterstoenhancepatientsafetyprospectiveexploratorystudy |