The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study
BackgroundGastrointestinal endoscopy represents a useful tool for the diagnosis and treatment of gastrointestinal diseases. Video platforms for spreading endoscopy-related knowledge may help patients understand the pros and cons of endoscopy on the premise of ensuring accurac...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-03-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2025/1/e58855 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850035309350223872 |
|---|---|
| author | Jinpei Liu Yifan Qiu Yilong Liu Wenping Xu Weichen Ning Peimei Shi Zongli Yuan Fang Wang Yihai Shi |
| author_facet | Jinpei Liu Yifan Qiu Yilong Liu Wenping Xu Weichen Ning Peimei Shi Zongli Yuan Fang Wang Yihai Shi |
| author_sort | Jinpei Liu |
| collection | DOAJ |
| description |
BackgroundGastrointestinal endoscopy represents a useful tool for the diagnosis and treatment of gastrointestinal diseases. Video platforms for spreading endoscopy-related knowledge may help patients understand the pros and cons of endoscopy on the premise of ensuring accuracy. However, videos with misinformation may lead to adverse consequences.
ObjectiveThis study aims to evaluate the quality of gastrointestinal endoscopy-related videos on YouTube and to assess whether large language models (LLMs) can help patients obtain information from videos more efficiently.
MethodsWe collected information from YouTube videos about 3 commonly used gastrointestinal endoscopes (gastroscopy, colonoscopy, and capsule endoscopy) and assessed their quality (rated by the modified DISCERN Tool, mDISCERN), reliability (rated by the Journal of the American Medical Association), and recommendation (rated by the Global Quality Score). We tasked LLM with summarizing the video content and assessed it from 3 perspectives: accuracy, completeness, and readability.
ResultsA total of 167 videos were included. According to the indicated scoring, the quality, reliability, and recommendation of the 3 gastrointestinal endoscopy-related videos on YouTube were overall unsatisfactory, and the quality of the videos released by patients was particularly poor. Capsule endoscopy yielded a significantly lower Global Quality Score than did gastroscopy and colonoscopy. LLM-based summaries yielded accuracy scores of 4 (IQR 4-5), completeness scores of 4 (IQR 4-5), and readability scores of 2 (IQR 1-2).
ConclusionsThe quality of gastrointestinal endoscope-related videos currently on YouTube is poor. Moreover, additional regulatory and improvement strategies are needed in the future. LLM may be helpful in generalizing video-related information, but there is still room for improvement in its ability. |
| format | Article |
| id | doaj-art-4d7b8d4e774f4d48b0dfe7fd17d66b76 |
| institution | DOAJ |
| issn | 1438-8871 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-4d7b8d4e774f4d48b0dfe7fd17d66b762025-08-20T02:57:32ZengJMIR PublicationsJournal of Medical Internet Research1438-88712025-03-0127e5885510.2196/58855The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional StudyJinpei Liuhttps://orcid.org/0000-0003-2776-0942Yifan Qiuhttps://orcid.org/0009-0007-6992-1843Yilong Liuhttps://orcid.org/0000-0002-0055-8333Wenping Xuhttps://orcid.org/0000-0002-2062-4641Weichen Ninghttps://orcid.org/0009-0003-3910-1087Peimei Shihttps://orcid.org/0000-0002-1922-0164Zongli Yuanhttps://orcid.org/0000-0002-7900-2601Fang Wanghttps://orcid.org/0009-0000-1989-1681Yihai Shihttps://orcid.org/0000-0003-3858-7903 BackgroundGastrointestinal endoscopy represents a useful tool for the diagnosis and treatment of gastrointestinal diseases. Video platforms for spreading endoscopy-related knowledge may help patients understand the pros and cons of endoscopy on the premise of ensuring accuracy. However, videos with misinformation may lead to adverse consequences. ObjectiveThis study aims to evaluate the quality of gastrointestinal endoscopy-related videos on YouTube and to assess whether large language models (LLMs) can help patients obtain information from videos more efficiently. MethodsWe collected information from YouTube videos about 3 commonly used gastrointestinal endoscopes (gastroscopy, colonoscopy, and capsule endoscopy) and assessed their quality (rated by the modified DISCERN Tool, mDISCERN), reliability (rated by the Journal of the American Medical Association), and recommendation (rated by the Global Quality Score). We tasked LLM with summarizing the video content and assessed it from 3 perspectives: accuracy, completeness, and readability. ResultsA total of 167 videos were included. According to the indicated scoring, the quality, reliability, and recommendation of the 3 gastrointestinal endoscopy-related videos on YouTube were overall unsatisfactory, and the quality of the videos released by patients was particularly poor. Capsule endoscopy yielded a significantly lower Global Quality Score than did gastroscopy and colonoscopy. LLM-based summaries yielded accuracy scores of 4 (IQR 4-5), completeness scores of 4 (IQR 4-5), and readability scores of 2 (IQR 1-2). ConclusionsThe quality of gastrointestinal endoscope-related videos currently on YouTube is poor. Moreover, additional regulatory and improvement strategies are needed in the future. LLM may be helpful in generalizing video-related information, but there is still room for improvement in its ability.https://www.jmir.org/2025/1/e58855 |
| spellingShingle | Jinpei Liu Yifan Qiu Yilong Liu Wenping Xu Weichen Ning Peimei Shi Zongli Yuan Fang Wang Yihai Shi The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study Journal of Medical Internet Research |
| title | The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study |
| title_full | The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study |
| title_fullStr | The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study |
| title_full_unstemmed | The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study |
| title_short | The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study |
| title_sort | reliability and quality of videos as guidance for gastrointestinal endoscopy cross sectional study |
| url | https://www.jmir.org/2025/1/e58855 |
| work_keys_str_mv | AT jinpeiliu thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT yifanqiu thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT yilongliu thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT wenpingxu thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT weichenning thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT peimeishi thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT zongliyuan thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT fangwang thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT yihaishi thereliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT jinpeiliu reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT yifanqiu reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT yilongliu reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT wenpingxu reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT weichenning reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT peimeishi reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT zongliyuan reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT fangwang reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy AT yihaishi reliabilityandqualityofvideosasguidanceforgastrointestinalendoscopycrosssectionalstudy |