Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study).
<h4>Introduction</h4>Surgical patients frequently experience post-operative complications at home. Digital remote monitoring of surgical wounds via image-based systems has emerged as a promising solution for early detection and intervention. However, the increased clinician workload from...
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0315384 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850105668035411968 |
|---|---|
| author | Melissa Rochon Judith Tanner James Jurkiewicz Jacqueline Beckhelling Akuha Aondoakaa Keith Wilson Luxmi Dhoonmoon Max Underwood Lara Mason Roy Harris Karen Cariaga |
| author_facet | Melissa Rochon Judith Tanner James Jurkiewicz Jacqueline Beckhelling Akuha Aondoakaa Keith Wilson Luxmi Dhoonmoon Max Underwood Lara Mason Roy Harris Karen Cariaga |
| author_sort | Melissa Rochon |
| collection | DOAJ |
| description | <h4>Introduction</h4>Surgical patients frequently experience post-operative complications at home. Digital remote monitoring of surgical wounds via image-based systems has emerged as a promising solution for early detection and intervention. However, the increased clinician workload from reviewing patient-submitted images presents a challenge. This study utilises artificial intelligence (AI) to prioritise surgical wound images for clinician review, aiming to efficiently manage workload.<h4>Methods and analysis</h4>Conducted from September 2023 to March 2024, the study phases included compiling a training dataset of 37,974 images, creating a testing set of 3,634 images, developing an AI algorithm using 'You Only Look Once' models, and conducting prospective tests compared against clinical nurse specialists' evaluations. The primary objective was to validate the AI's sensitivity in prioritising wound reviews, alongside assessing intra-rater reliability. Secondary objectives focused on specificity, positive predictive value (PPV), and negative predictive value (NPV) for various wound features.<h4>Results</h4>The AI demonstrated a sensitivity of 89%, exceeding the target of 85% and proving effective in identifying cases requiring priority review. Intra-rater reliability was perfect, achieving 100% consistency in repeated assessments. Observations indicated variations in detecting wound characteristics across different skin tones; sensitivity was notably lower for incisional separation and discolouration in darker skin tones. Specificity remained high overall, with some results favouring darker skin tones. The NPV were similar for both light and dark skin tones. However, the NPV was slightly higher for dark skin tones at 95% (95% CI: 93%-97%) compared to 91% (95% CI: 87%-92%) for light skin tones. Both PPV and NPV varied, especially in identifying sutures or staples, indicating areas needing further refinement to ensure equitable accuracy.<h4>Conclusion</h4>The AI algorithm not only met but surpassed the expected sensitivity for identifying priority cases, showing high reliability. Nonetheless, the disparities in performance across skin tones, especially in recognising certain wound characteristics like discolouration or incisional separation, underline the need for ongoing training and adaptation of the AI to ensure fairness and effectiveness across diverse patient groups. |
| format | Article |
| id | doaj-art-8238522d2829451bbe4e6504e4f9b6e6 |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-8238522d2829451bbe4e6504e4f9b6e62025-08-20T02:39:02ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-011912e031538410.1371/journal.pone.0315384Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study).Melissa RochonJudith TannerJames JurkiewiczJacqueline BeckhellingAkuha AondoakaaKeith WilsonLuxmi DhoonmoonMax UnderwoodLara MasonRoy HarrisKaren Cariaga<h4>Introduction</h4>Surgical patients frequently experience post-operative complications at home. Digital remote monitoring of surgical wounds via image-based systems has emerged as a promising solution for early detection and intervention. However, the increased clinician workload from reviewing patient-submitted images presents a challenge. This study utilises artificial intelligence (AI) to prioritise surgical wound images for clinician review, aiming to efficiently manage workload.<h4>Methods and analysis</h4>Conducted from September 2023 to March 2024, the study phases included compiling a training dataset of 37,974 images, creating a testing set of 3,634 images, developing an AI algorithm using 'You Only Look Once' models, and conducting prospective tests compared against clinical nurse specialists' evaluations. The primary objective was to validate the AI's sensitivity in prioritising wound reviews, alongside assessing intra-rater reliability. Secondary objectives focused on specificity, positive predictive value (PPV), and negative predictive value (NPV) for various wound features.<h4>Results</h4>The AI demonstrated a sensitivity of 89%, exceeding the target of 85% and proving effective in identifying cases requiring priority review. Intra-rater reliability was perfect, achieving 100% consistency in repeated assessments. Observations indicated variations in detecting wound characteristics across different skin tones; sensitivity was notably lower for incisional separation and discolouration in darker skin tones. Specificity remained high overall, with some results favouring darker skin tones. The NPV were similar for both light and dark skin tones. However, the NPV was slightly higher for dark skin tones at 95% (95% CI: 93%-97%) compared to 91% (95% CI: 87%-92%) for light skin tones. Both PPV and NPV varied, especially in identifying sutures or staples, indicating areas needing further refinement to ensure equitable accuracy.<h4>Conclusion</h4>The AI algorithm not only met but surpassed the expected sensitivity for identifying priority cases, showing high reliability. Nonetheless, the disparities in performance across skin tones, especially in recognising certain wound characteristics like discolouration or incisional separation, underline the need for ongoing training and adaptation of the AI to ensure fairness and effectiveness across diverse patient groups.https://doi.org/10.1371/journal.pone.0315384 |
| spellingShingle | Melissa Rochon Judith Tanner James Jurkiewicz Jacqueline Beckhelling Akuha Aondoakaa Keith Wilson Luxmi Dhoonmoon Max Underwood Lara Mason Roy Harris Karen Cariaga Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study). PLoS ONE |
| title | Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study). |
| title_full | Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study). |
| title_fullStr | Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study). |
| title_full_unstemmed | Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study). |
| title_short | Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study). |
| title_sort | wound imaging software and digital platform to assist review of surgical wounds using patient smartphones the development and evaluation of artificial intelligence wisdom ai study |
| url | https://doi.org/10.1371/journal.pone.0315384 |
| work_keys_str_mv | AT melissarochon woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT judithtanner woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT jamesjurkiewicz woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT jacquelinebeckhelling woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT akuhaaondoakaa woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT keithwilson woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT luxmidhoonmoon woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT maxunderwood woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT laramason woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT royharris woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy AT karencariaga woundimagingsoftwareanddigitalplatformtoassistreviewofsurgicalwoundsusingpatientsmartphonesthedevelopmentandevaluationofartificialintelligencewisdomaistudy |