Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes Canada
Abstract Background Individuals with type 2 diabetes (T2D) have a high prevalence of cardiovascular and renal comorbidities. Despite clinical practice guidelines recommending the use of cardiorenal protective medications, many people with T2D are not prescribed these medications. A clinical decision...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-02-01
|
| Series: | BMC Medical Informatics and Decision Making |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12911-025-02881-4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850067818664427520 |
|---|---|
| author | Klaudia Grechuta Pedram Shokouh Valentina Bayer Henrich Kraemer Jeremy Gilbert Susie Jin Ahmad Alhussein |
| author_facet | Klaudia Grechuta Pedram Shokouh Valentina Bayer Henrich Kraemer Jeremy Gilbert Susie Jin Ahmad Alhussein |
| author_sort | Klaudia Grechuta |
| collection | DOAJ |
| description | Abstract Background Individuals with type 2 diabetes (T2D) have a high prevalence of cardiovascular and renal comorbidities. Despite clinical practice guidelines recommending the use of cardiorenal protective medications, many people with T2D are not prescribed these medications. A clinical decision support system called Exandra was developed to provide treatment recommendations for individuals with T2D based on current clinical practice guidelines from Diabetes Canada. The current study aimed to medically validate Exandra via review by external medical experts in T2D. Methods Validation of Exandra took place in two phases. Test cases using simulated clinical scenarios and recommendations were generated by Exandra. In Phase 1 of the validation, reviewers evaluated whether they agreed with Exandra’s recommendations with a “yes,” “no,” or “not sure” response. In Phase 2, reviewers were interviewed about their “no” and “not sure” responses to determine possible reasons and potential fixes to the Exandra system. The primary outcome was the precision rate of Exandra following the interviews and final adjudication of the cases. The target precision rate was 90%. Results Exandra displayed an overall precision rate of 95.5%. A large proportion of cases that were initially labeled “no” or “not sure” by reviewers were changed to “yes” following the interview phase. This was largely due to the validation using a simplified user interface compared with the complexity of the actual Exandra system, and reviewers needing clarification of how the outputs would be displayed on the Exandra platform. Conclusion Exandra displayed a high level of accuracy and precision in providing guideline-directed recommendations for managing T2D and its common comorbidities. The results of this study indicate that Exandra is a promising tool for improving the management of T2D and its comorbidities. |
| format | Article |
| id | doaj-art-e793e9f9605341669bacb0642a2fc8b4 |
| institution | DOAJ |
| issn | 1472-6947 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Informatics and Decision Making |
| spelling | doaj-art-e793e9f9605341669bacb0642a2fc8b42025-08-20T02:48:12ZengBMCBMC Medical Informatics and Decision Making1472-69472025-02-0125111210.1186/s12911-025-02881-4Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes CanadaKlaudia Grechuta0Pedram Shokouh1Valentina Bayer2Henrich Kraemer3Jeremy Gilbert4Susie Jin5Ahmad Alhussein6Boehringer Ingelheim International GmbHAdivus Medical Consultancy Mpv.Boehringer Ingelheim Pharmaceuticals, Inc.Boehringer Ingelheim International GmbHSunnybrook Health Sciences Centre, University of TorontoClinical Pharmacist, Certified Diabetes EducatorBoehringer Ingelheim International GmbHAbstract Background Individuals with type 2 diabetes (T2D) have a high prevalence of cardiovascular and renal comorbidities. Despite clinical practice guidelines recommending the use of cardiorenal protective medications, many people with T2D are not prescribed these medications. A clinical decision support system called Exandra was developed to provide treatment recommendations for individuals with T2D based on current clinical practice guidelines from Diabetes Canada. The current study aimed to medically validate Exandra via review by external medical experts in T2D. Methods Validation of Exandra took place in two phases. Test cases using simulated clinical scenarios and recommendations were generated by Exandra. In Phase 1 of the validation, reviewers evaluated whether they agreed with Exandra’s recommendations with a “yes,” “no,” or “not sure” response. In Phase 2, reviewers were interviewed about their “no” and “not sure” responses to determine possible reasons and potential fixes to the Exandra system. The primary outcome was the precision rate of Exandra following the interviews and final adjudication of the cases. The target precision rate was 90%. Results Exandra displayed an overall precision rate of 95.5%. A large proportion of cases that were initially labeled “no” or “not sure” by reviewers were changed to “yes” following the interview phase. This was largely due to the validation using a simplified user interface compared with the complexity of the actual Exandra system, and reviewers needing clarification of how the outputs would be displayed on the Exandra platform. Conclusion Exandra displayed a high level of accuracy and precision in providing guideline-directed recommendations for managing T2D and its common comorbidities. The results of this study indicate that Exandra is a promising tool for improving the management of T2D and its comorbidities.https://doi.org/10.1186/s12911-025-02881-4Type 2 diabetes mellitusClinical decision support systemsComorbidity |
| spellingShingle | Klaudia Grechuta Pedram Shokouh Valentina Bayer Henrich Kraemer Jeremy Gilbert Susie Jin Ahmad Alhussein Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes Canada BMC Medical Informatics and Decision Making Type 2 diabetes mellitus Clinical decision support systems Comorbidity |
| title | Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes Canada |
| title_full | Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes Canada |
| title_fullStr | Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes Canada |
| title_full_unstemmed | Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes Canada |
| title_short | Analytical validation of Exandra: a clinical decision support system for promoting guideline-directed therapy of type-2 diabetes in primary care – a collaborative study with experts from Diabetes Canada |
| title_sort | analytical validation of exandra a clinical decision support system for promoting guideline directed therapy of type 2 diabetes in primary care a collaborative study with experts from diabetes canada |
| topic | Type 2 diabetes mellitus Clinical decision support systems Comorbidity |
| url | https://doi.org/10.1186/s12911-025-02881-4 |
| work_keys_str_mv | AT klaudiagrechuta analyticalvalidationofexandraaclinicaldecisionsupportsystemforpromotingguidelinedirectedtherapyoftype2diabetesinprimarycareacollaborativestudywithexpertsfromdiabetescanada AT pedramshokouh analyticalvalidationofexandraaclinicaldecisionsupportsystemforpromotingguidelinedirectedtherapyoftype2diabetesinprimarycareacollaborativestudywithexpertsfromdiabetescanada AT valentinabayer analyticalvalidationofexandraaclinicaldecisionsupportsystemforpromotingguidelinedirectedtherapyoftype2diabetesinprimarycareacollaborativestudywithexpertsfromdiabetescanada AT henrichkraemer analyticalvalidationofexandraaclinicaldecisionsupportsystemforpromotingguidelinedirectedtherapyoftype2diabetesinprimarycareacollaborativestudywithexpertsfromdiabetescanada AT jeremygilbert analyticalvalidationofexandraaclinicaldecisionsupportsystemforpromotingguidelinedirectedtherapyoftype2diabetesinprimarycareacollaborativestudywithexpertsfromdiabetescanada AT susiejin analyticalvalidationofexandraaclinicaldecisionsupportsystemforpromotingguidelinedirectedtherapyoftype2diabetesinprimarycareacollaborativestudywithexpertsfromdiabetescanada AT ahmadalhussein analyticalvalidationofexandraaclinicaldecisionsupportsystemforpromotingguidelinedirectedtherapyoftype2diabetesinprimarycareacollaborativestudywithexpertsfromdiabetescanada |