Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases.
Digital health technology (DHT) holds the potential to improve health services, and its adoption has proliferated in recent decades owing to technological advancement. Optimal evaluation methodologies appropriate for generating quality evidence on DHT have yet to be established; traditional comparat...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-04-01
|
| Series: | PLOS Digital Health |
| Online Access: | https://doi.org/10.1371/journal.pdig.0000806 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850139755448107008 |
|---|---|
| author | Nyangi Gityamwi Jo Armes Jenny Harris Emma Ream Richard Green Anand Ahankari Alison Callwood Athena Ip Jane Cockle-Hearne Wendy Grosvenor Agnieszka Lemanska Simon S Skene |
| author_facet | Nyangi Gityamwi Jo Armes Jenny Harris Emma Ream Richard Green Anand Ahankari Alison Callwood Athena Ip Jane Cockle-Hearne Wendy Grosvenor Agnieszka Lemanska Simon S Skene |
| author_sort | Nyangi Gityamwi |
| collection | DOAJ |
| description | Digital health technology (DHT) holds the potential to improve health services, and its adoption has proliferated in recent decades owing to technological advancement. Optimal evaluation methodologies appropriate for generating quality evidence on DHT have yet to be established; traditional comparative designs present several limitations. This study aimed to scope the literature to highlight common methodological approaches used and their limitations to inform considerations for designing robust DHT evaluation studies. A scoping review was conducted following the Joanna Briggs Institute (JBI) scoping review guidelines. A systematic search was conducted using the CINAHL (EBSCO), MEDLINE (EBSCOhost), PsycINFO (EBSCO), EMBASE (Elsevier) and Web of Science (Clarivate Analytics) databases using iteratively developed search terms. We selected studies published in English between January 2016 and March 2022 and focussed on primary research evaluating the effectiveness of DHT with technology-user interactive or asynchronous features for adults (≥18 years) with cancer, diabetes or cardiovascular conditions. The final number of articles, after the screening and selection process, comprised 140 records. Data were analysed descriptively (frequency and percentages) and summarised thematically. Results showed most studies (n = 104, 74.3%) employed the standard two-arm parallel RCT design, with usual/standard care as the preferred comparator in nearly half (n = 65, 47.1%) of all included studies. Of the 104 comparative studies reviewed, limitations in recruitment were most frequently reported (n = 70, 37%), followed by limitations in evaluation/measurement techniques (n = 57, 27%), presence of confounding factors (n = 50, 24%) and short duration of studies (n = 24, 11%). The review highlights the need to consider inclusive approaches to recruitment and adoption of the emerging methodological approaches that account for the fast-paced, multi-component and group contamination problem resulting from the unconcealable nature of DHT interventions. |
| format | Article |
| id | doaj-art-3f3ab1ba5a164ff9bdff6e57a02f059a |
| institution | OA Journals |
| issn | 2767-3170 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLOS Digital Health |
| spelling | doaj-art-3f3ab1ba5a164ff9bdff6e57a02f059a2025-08-20T02:30:09ZengPublic Library of Science (PLoS)PLOS Digital Health2767-31702025-04-0144e000080610.1371/journal.pdig.0000806Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases.Nyangi GityamwiJo ArmesJenny HarrisEmma ReamRichard GreenAnand AhankariAlison CallwoodAthena IpJane Cockle-HearneWendy GrosvenorAgnieszka LemanskaSimon S SkeneDigital health technology (DHT) holds the potential to improve health services, and its adoption has proliferated in recent decades owing to technological advancement. Optimal evaluation methodologies appropriate for generating quality evidence on DHT have yet to be established; traditional comparative designs present several limitations. This study aimed to scope the literature to highlight common methodological approaches used and their limitations to inform considerations for designing robust DHT evaluation studies. A scoping review was conducted following the Joanna Briggs Institute (JBI) scoping review guidelines. A systematic search was conducted using the CINAHL (EBSCO), MEDLINE (EBSCOhost), PsycINFO (EBSCO), EMBASE (Elsevier) and Web of Science (Clarivate Analytics) databases using iteratively developed search terms. We selected studies published in English between January 2016 and March 2022 and focussed on primary research evaluating the effectiveness of DHT with technology-user interactive or asynchronous features for adults (≥18 years) with cancer, diabetes or cardiovascular conditions. The final number of articles, after the screening and selection process, comprised 140 records. Data were analysed descriptively (frequency and percentages) and summarised thematically. Results showed most studies (n = 104, 74.3%) employed the standard two-arm parallel RCT design, with usual/standard care as the preferred comparator in nearly half (n = 65, 47.1%) of all included studies. Of the 104 comparative studies reviewed, limitations in recruitment were most frequently reported (n = 70, 37%), followed by limitations in evaluation/measurement techniques (n = 57, 27%), presence of confounding factors (n = 50, 24%) and short duration of studies (n = 24, 11%). The review highlights the need to consider inclusive approaches to recruitment and adoption of the emerging methodological approaches that account for the fast-paced, multi-component and group contamination problem resulting from the unconcealable nature of DHT interventions.https://doi.org/10.1371/journal.pdig.0000806 |
| spellingShingle | Nyangi Gityamwi Jo Armes Jenny Harris Emma Ream Richard Green Anand Ahankari Alison Callwood Athena Ip Jane Cockle-Hearne Wendy Grosvenor Agnieszka Lemanska Simon S Skene Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases. PLOS Digital Health |
| title | Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases. |
| title_full | Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases. |
| title_fullStr | Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases. |
| title_full_unstemmed | Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases. |
| title_short | Methodological approaches and author-reported limitations in evaluation studies of digital health technologies (DHT): A scoping review of DHT interventions for cancer, diabetes mellitus, and cardiovascular diseases. |
| title_sort | methodological approaches and author reported limitations in evaluation studies of digital health technologies dht a scoping review of dht interventions for cancer diabetes mellitus and cardiovascular diseases |
| url | https://doi.org/10.1371/journal.pdig.0000806 |
| work_keys_str_mv | AT nyangigityamwi methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT joarmes methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT jennyharris methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT emmaream methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT richardgreen methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT anandahankari methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT alisoncallwood methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT athenaip methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT janecocklehearne methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT wendygrosvenor methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT agnieszkalemanska methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases AT simonsskene methodologicalapproachesandauthorreportedlimitationsinevaluationstudiesofdigitalhealthtechnologiesdhtascopingreviewofdhtinterventionsforcancerdiabetesmellitusandcardiovasculardiseases |