Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative Analysis
Category: Other; Sports Introduction/Purpose: On its current trajectory, AI chatbots may become the primary source of information for patient education material in the field of orthopaedics. Despite this, there has been no evaluation of the accuracy and validity of foot and ankle patient education m...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2024-12-01
|
| Series: | Foot & Ankle Orthopaedics |
| Online Access: | https://doi.org/10.1177/2473011424S00295 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850103851768610816 |
|---|---|
| author | Aarav S. Parekh Joseph A.S McCahon DO Amy Nghe BA David I. Pedowitz DO Joseph N. Daniel DO Selene G. Parekh MD, MBA |
| author_facet | Aarav S. Parekh Joseph A.S McCahon DO Amy Nghe BA David I. Pedowitz DO Joseph N. Daniel DO Selene G. Parekh MD, MBA |
| author_sort | Aarav S. Parekh |
| collection | DOAJ |
| description | Category: Other; Sports Introduction/Purpose: On its current trajectory, AI chatbots may become the primary source of information for patient education material in the field of orthopaedics. Despite this, there has been no evaluation of the accuracy and validity of foot and ankle patient education material generated by AI platforms. The purpose of this study was to perform a comparative analysis of foot and ankle patient education material generated by the ai chatbots, as they compare to the AOFAS recommended patient education website, footcaremd.org. Methods: ChatGPT, Google Bard, and Bing AI were used to generate patient educational materials on ten of the most common foot and ankle conditions. The content from these ai language model platforms was analyzed and compared with footcaremd.org for accuracy of included information. Accuracy was determined for each of the ten conditions on a basis of included information regarding background, symptoms, causes, diagnosis, treatments, surgical options, recovery procedures, and risks or preventions. Results: When compared to the reference standard of the AOFAS website: footcaremd.org, the AI language model platforms consistently scored below 60% in accuracy rates in all categories of the articles analyzed. ChatGPT was found to contain an average of 46.2% of key content across all included conditions when compared to footcaremd.org. Comparatively, Google Bard contained an average of 36.5% and Bing AI contained 28.0% of information included on footcaremd.org. Conclusion: AI language model generated patient education regarding common foot and ankle conditions provides limited content accuracy across all three AI chatbot platforms. Clinicians should be aware of the increasing popularity of these platforms and be prepared to answer questions or clarify misunderstandings, and when appropriate direct patients to more validated education material such as footcaremd.org. |
| format | Article |
| id | doaj-art-c08e76ee425f47dab885c0f8fca1a17e |
| institution | DOAJ |
| issn | 2473-0114 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | Foot & Ankle Orthopaedics |
| spelling | doaj-art-c08e76ee425f47dab885c0f8fca1a17e2025-08-20T02:39:27ZengSAGE PublishingFoot & Ankle Orthopaedics2473-01142024-12-01910.1177/2473011424S00295Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative AnalysisAarav S. ParekhJoseph A.S McCahon DOAmy Nghe BADavid I. Pedowitz DOJoseph N. Daniel DOSelene G. Parekh MD, MBACategory: Other; Sports Introduction/Purpose: On its current trajectory, AI chatbots may become the primary source of information for patient education material in the field of orthopaedics. Despite this, there has been no evaluation of the accuracy and validity of foot and ankle patient education material generated by AI platforms. The purpose of this study was to perform a comparative analysis of foot and ankle patient education material generated by the ai chatbots, as they compare to the AOFAS recommended patient education website, footcaremd.org. Methods: ChatGPT, Google Bard, and Bing AI were used to generate patient educational materials on ten of the most common foot and ankle conditions. The content from these ai language model platforms was analyzed and compared with footcaremd.org for accuracy of included information. Accuracy was determined for each of the ten conditions on a basis of included information regarding background, symptoms, causes, diagnosis, treatments, surgical options, recovery procedures, and risks or preventions. Results: When compared to the reference standard of the AOFAS website: footcaremd.org, the AI language model platforms consistently scored below 60% in accuracy rates in all categories of the articles analyzed. ChatGPT was found to contain an average of 46.2% of key content across all included conditions when compared to footcaremd.org. Comparatively, Google Bard contained an average of 36.5% and Bing AI contained 28.0% of information included on footcaremd.org. Conclusion: AI language model generated patient education regarding common foot and ankle conditions provides limited content accuracy across all three AI chatbot platforms. Clinicians should be aware of the increasing popularity of these platforms and be prepared to answer questions or clarify misunderstandings, and when appropriate direct patients to more validated education material such as footcaremd.org.https://doi.org/10.1177/2473011424S00295 |
| spellingShingle | Aarav S. Parekh Joseph A.S McCahon DO Amy Nghe BA David I. Pedowitz DO Joseph N. Daniel DO Selene G. Parekh MD, MBA Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative Analysis Foot & Ankle Orthopaedics |
| title | Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative Analysis |
| title_full | Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative Analysis |
| title_fullStr | Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative Analysis |
| title_full_unstemmed | Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative Analysis |
| title_short | Foot and Ankle Patient Education Materials and Artificial Intelligence Chatbots: A Comparative Analysis |
| title_sort | foot and ankle patient education materials and artificial intelligence chatbots a comparative analysis |
| url | https://doi.org/10.1177/2473011424S00295 |
| work_keys_str_mv | AT aaravsparekh footandanklepatienteducationmaterialsandartificialintelligencechatbotsacomparativeanalysis AT josephasmccahondo footandanklepatienteducationmaterialsandartificialintelligencechatbotsacomparativeanalysis AT amyngheba footandanklepatienteducationmaterialsandartificialintelligencechatbotsacomparativeanalysis AT davidipedowitzdo footandanklepatienteducationmaterialsandartificialintelligencechatbotsacomparativeanalysis AT josephndanieldo footandanklepatienteducationmaterialsandartificialintelligencechatbotsacomparativeanalysis AT selenegparekhmdmba footandanklepatienteducationmaterialsandartificialintelligencechatbotsacomparativeanalysis |