The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT
<b>Objectives:</b> ChatGPT is a large language model that is able to generate human-like text. The aim of this study was to evaluate ChatGPT as a potential supplement to urological clinical practice by exploring its capacity, efficacy and accuracy when delivering information on frequentl...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-06-01
|
| Series: | Société Internationale d’Urologie Journal |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2563-6499/5/3/32 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849470751900434432 |
|---|---|
| author | Allen Ao Guo Basil Razi Paul Kim Ashan Canagasingham Justin Vass Venu Chalasani Krishan Rasiah Amanda Chung |
| author_facet | Allen Ao Guo Basil Razi Paul Kim Ashan Canagasingham Justin Vass Venu Chalasani Krishan Rasiah Amanda Chung |
| author_sort | Allen Ao Guo |
| collection | DOAJ |
| description | <b>Objectives:</b> ChatGPT is a large language model that is able to generate human-like text. The aim of this study was to evaluate ChatGPT as a potential supplement to urological clinical practice by exploring its capacity, efficacy and accuracy when delivering information on frequently asked questions from patients with bladder cancer. <b>Methods:</b> We proposed 10 hypothetical questions to ChatGPT to simulate a doctor–patient consultation for patients recently diagnosed with bladder cancer. The responses were then assessed using two predefined scales of accuracy and completeness by Specialist Urologists. <b>Results:</b> ChatGPT provided coherent answers that were concise and easily comprehensible. Overall, mean accuracy scores for the 10 questions ranged from 3.7 to 6.0, with a median of 5.0. Mean completeness scores ranged from 1.3 to 2.3, with a median of 1.8. ChatGPT was also cognizant of its own limitations and recommended all patients should adhere closely to medical advice dispensed by their healthcare provider. <b>Conclusions:</b> This study provides further insight into the role of ChatGPT as an adjunct consultation tool for answering frequently asked questions from patients with bladder cancer diagnosis. Whilst it was able to provide information in a concise and coherent manner, there were concerns regarding the completeness of information conveyed. Further development and research into this rapidly evolving tool are required to ascertain the potential impacts of AI models such as ChatGPT in urology and the broader healthcare landscape. |
| format | Article |
| id | doaj-art-ddaf39cdf30f48e4b13c14999ffeb543 |
| institution | Kabale University |
| issn | 2563-6499 |
| language | English |
| publishDate | 2024-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Société Internationale d’Urologie Journal |
| spelling | doaj-art-ddaf39cdf30f48e4b13c14999ffeb5432025-08-20T03:25:04ZengMDPI AGSociété Internationale d’Urologie Journal2563-64992024-06-015321422410.3390/siuj5030032The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPTAllen Ao Guo0Basil Razi1Paul Kim2Ashan Canagasingham3Justin Vass4Venu Chalasani5Krishan Rasiah6Amanda Chung7Faculty of Medicine, University of New South Wales, Sydney 2052, AustraliaNorth Shore Urology Research Group, St. Leonards 2065, AustraliaNorth Shore Urology Research Group, St. Leonards 2065, AustraliaNorth Shore Urology Research Group, St. Leonards 2065, AustraliaNorth Shore Urology Research Group, St. Leonards 2065, AustraliaNorth Shore Urology Research Group, St. Leonards 2065, AustraliaNorth Shore Urology Research Group, St. Leonards 2065, AustraliaNorth Shore Urology Research Group, St. Leonards 2065, Australia<b>Objectives:</b> ChatGPT is a large language model that is able to generate human-like text. The aim of this study was to evaluate ChatGPT as a potential supplement to urological clinical practice by exploring its capacity, efficacy and accuracy when delivering information on frequently asked questions from patients with bladder cancer. <b>Methods:</b> We proposed 10 hypothetical questions to ChatGPT to simulate a doctor–patient consultation for patients recently diagnosed with bladder cancer. The responses were then assessed using two predefined scales of accuracy and completeness by Specialist Urologists. <b>Results:</b> ChatGPT provided coherent answers that were concise and easily comprehensible. Overall, mean accuracy scores for the 10 questions ranged from 3.7 to 6.0, with a median of 5.0. Mean completeness scores ranged from 1.3 to 2.3, with a median of 1.8. ChatGPT was also cognizant of its own limitations and recommended all patients should adhere closely to medical advice dispensed by their healthcare provider. <b>Conclusions:</b> This study provides further insight into the role of ChatGPT as an adjunct consultation tool for answering frequently asked questions from patients with bladder cancer diagnosis. Whilst it was able to provide information in a concise and coherent manner, there were concerns regarding the completeness of information conveyed. Further development and research into this rapidly evolving tool are required to ascertain the potential impacts of AI models such as ChatGPT in urology and the broader healthcare landscape.https://www.mdpi.com/2563-6499/5/3/32bladder cancerpatient educationChatGPTartificial intelligence |
| spellingShingle | Allen Ao Guo Basil Razi Paul Kim Ashan Canagasingham Justin Vass Venu Chalasani Krishan Rasiah Amanda Chung The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT Société Internationale d’Urologie Journal bladder cancer patient education ChatGPT artificial intelligence |
| title | The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT |
| title_full | The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT |
| title_fullStr | The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT |
| title_full_unstemmed | The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT |
| title_short | The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT |
| title_sort | role of artificial intelligence in patient education a bladder cancer consultation with chatgpt |
| topic | bladder cancer patient education ChatGPT artificial intelligence |
| url | https://www.mdpi.com/2563-6499/5/3/32 |
| work_keys_str_mv | AT allenaoguo theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT basilrazi theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT paulkim theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT ashancanagasingham theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT justinvass theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT venuchalasani theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT krishanrasiah theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT amandachung theroleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT allenaoguo roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT basilrazi roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT paulkim roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT ashancanagasingham roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT justinvass roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT venuchalasani roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT krishanrasiah roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt AT amandachung roleofartificialintelligenceinpatienteducationabladdercancerconsultationwithchatgpt |