Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems
Because of restrictive laws in multiple states for gender-affirming care, patients might be prompted to get recommendations from contemporary online chatbots. This study explored the appropriateness of such recommendations using validated tools to assess patient education materials by a team of LGBT...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-03-01
|
| Series: | CJC Open |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2589790X24006000 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850222350644019200 |
|---|---|
| author | Brototo Deb, MD, MIDS Michael Fradley, MD Stephen Cook, MD Geoffrey D. Barnes, MD, MSc |
| author_facet | Brototo Deb, MD, MIDS Michael Fradley, MD Stephen Cook, MD Geoffrey D. Barnes, MD, MSc |
| author_sort | Brototo Deb, MD, MIDS |
| collection | DOAJ |
| description | Because of restrictive laws in multiple states for gender-affirming care, patients might be prompted to get recommendations from contemporary online chatbots. This study explored the appropriateness of such recommendations using validated tools to assess patient education materials by a team of LGBTQ-affirming cardiologists. The study showed that although all systems emphasize the need for multidisciplinary care, there were notable differences in the comprehensiveness, cultural appropriateness, and presentation of their responses. GPT-4 (https://chatbotapp.ai) and Gemini (https://gemini.google.com/app) outperformed Bing (https://copilot.microsoft.com), particularly in the balanced and culturally sensitive delivery of information. Résumé: En raison des lois restrictives en matière de soins liés à l’affirmation de genre en vigueur dans plusieurs États américains, certains patients pourraient être tentés d’obtenir des recommandations de la part d’agents conversationnels actuellement disponibles en ligne. Dans le cadre de cette étude, une équipe de cardiologues ayant une approche affirmative des soins aux personnes LGBTQ a examiné la pertinence de telles recommandations à l’aide d’outils validés visant à évaluer le matériel éducatif destiné aux patients. L’étude a montré que même si toutes les sources consultées mettaient l’accent sur la nécessité d’offrir des soins multidisciplinaires, des différences notables ont été observées en ce qui concerne l’exhaustivité du contenu, la pertinence culturelle et la présentation des réponses. Les applications GPT-4 (https://chatbotapp.ai) et Gemini (https://gemini.google.com/app) ont surpassé Bing (https://copilot.microsoft.com), en particulier pour ce qui est du caractère pondéré de l’information fournie et de la prise en compte des particularités culturelles. |
| format | Article |
| id | doaj-art-f9d16381b83c4d30adb4669d6bd5524c |
| institution | OA Journals |
| issn | 2589-790X |
| language | English |
| publishDate | 2025-03-01 |
| publisher | Elsevier |
| record_format | Article |
| series | CJC Open |
| spelling | doaj-art-f9d16381b83c4d30adb4669d6bd5524c2025-08-20T02:06:22ZengElsevierCJC Open2589-790X2025-03-017333834310.1016/j.cjco.2024.11.020Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence SystemsBrototo Deb, MD, MIDS0Michael Fradley, MD1Stephen Cook, MD2Geoffrey D. Barnes, MD, MSc3Department of Medicine, MedStar Georgetown University - Washington Hospital Center, Washington DC, USA; Corresponding author: Dr Brototo Deb, 110 Irving St NW, Washington DC 20009. Tel.: +1-507-319-8808.Department of Cardiology, University of Pennsylvania, Philadelphia, Pennsylvania, USAIndiana Heart Physicians, Indianapolis, Indiana, USAFrankel Cardiovascular Center and Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, Michigan, USABecause of restrictive laws in multiple states for gender-affirming care, patients might be prompted to get recommendations from contemporary online chatbots. This study explored the appropriateness of such recommendations using validated tools to assess patient education materials by a team of LGBTQ-affirming cardiologists. The study showed that although all systems emphasize the need for multidisciplinary care, there were notable differences in the comprehensiveness, cultural appropriateness, and presentation of their responses. GPT-4 (https://chatbotapp.ai) and Gemini (https://gemini.google.com/app) outperformed Bing (https://copilot.microsoft.com), particularly in the balanced and culturally sensitive delivery of information. Résumé: En raison des lois restrictives en matière de soins liés à l’affirmation de genre en vigueur dans plusieurs États américains, certains patients pourraient être tentés d’obtenir des recommandations de la part d’agents conversationnels actuellement disponibles en ligne. Dans le cadre de cette étude, une équipe de cardiologues ayant une approche affirmative des soins aux personnes LGBTQ a examiné la pertinence de telles recommandations à l’aide d’outils validés visant à évaluer le matériel éducatif destiné aux patients. L’étude a montré que même si toutes les sources consultées mettaient l’accent sur la nécessité d’offrir des soins multidisciplinaires, des différences notables ont été observées en ce qui concerne l’exhaustivité du contenu, la pertinence culturelle et la présentation des réponses. Les applications GPT-4 (https://chatbotapp.ai) et Gemini (https://gemini.google.com/app) ont surpassé Bing (https://copilot.microsoft.com), en particulier pour ce qui est du caractère pondéré de l’information fournie et de la prise en compte des particularités culturelles.http://www.sciencedirect.com/science/article/pii/S2589790X24006000 |
| spellingShingle | Brototo Deb, MD, MIDS Michael Fradley, MD Stephen Cook, MD Geoffrey D. Barnes, MD, MSc Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems CJC Open |
| title | Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems |
| title_full | Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems |
| title_fullStr | Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems |
| title_full_unstemmed | Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems |
| title_short | Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems |
| title_sort | evaluation of information about cardiovascular implications of gender affirming care from online chat based artificial intelligence systems |
| url | http://www.sciencedirect.com/science/article/pii/S2589790X24006000 |
| work_keys_str_mv | AT brototodebmdmids evaluationofinformationaboutcardiovascularimplicationsofgenderaffirmingcarefromonlinechatbasedartificialintelligencesystems AT michaelfradleymd evaluationofinformationaboutcardiovascularimplicationsofgenderaffirmingcarefromonlinechatbasedartificialintelligencesystems AT stephencookmd evaluationofinformationaboutcardiovascularimplicationsofgenderaffirmingcarefromonlinechatbasedartificialintelligencesystems AT geoffreydbarnesmdmsc evaluationofinformationaboutcardiovascularimplicationsofgenderaffirmingcarefromonlinechatbasedartificialintelligencesystems |