A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare.
The power of computational modeling and simulation (M&S) is realized when the results are credible, and the workflow generates evidence that supports credibility for the context of use. The Committee on Credible Practice of Modeling & Simulation in Healthcare was established to help address...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0313711 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849426794177888256 |
|---|---|
| author | Alexandra Manchel Ahmet Erdemir Lealem Mulugeta Joy P Ku Bruno V Rego Marc Horner William W Lytton Jerry G Myers Rajanikanth Vadigepalli |
| author_facet | Alexandra Manchel Ahmet Erdemir Lealem Mulugeta Joy P Ku Bruno V Rego Marc Horner William W Lytton Jerry G Myers Rajanikanth Vadigepalli |
| author_sort | Alexandra Manchel |
| collection | DOAJ |
| description | The power of computational modeling and simulation (M&S) is realized when the results are credible, and the workflow generates evidence that supports credibility for the context of use. The Committee on Credible Practice of Modeling & Simulation in Healthcare was established to help address the need for processes and procedures to support the credible use of M&S in healthcare and biomedical research. Our community efforts have led to the Ten Rules (TR) for Credible Practice of M&S in life sciences and healthcare. This framework is an outcome of a multidisciplinary investigation from a wide range of stakeholders beginning in 2012. Here, we present a pragmatic rubric for assessing the conformance of an M&S activity to the TR. This rubric considers the ability of an M&S study to communicate how well the study conforms to the Ten Rules for credible practice and facilitate outreach to a wide range of stakeholders from context-specific M&S practitioners to policymakers. It uses an ordinal scale ranging from Insufficient (zero) to Comprehensive (four) that is applicable to each rule, providing a uniform approach for comparing assessments across different reviewers and different modeling studies. We used the rubric to evaluate the conformance of two computational modeling activities: 1. six viral disease (COVID-19) propagation models, and 2. a model of hepatic glycogenolysis with neural innervation and calcium signaling. These examples were used to evaluate the applicability of the rubric and illustrate rubric usage in real-world M&S scenarios including those that bridge scientific M&S with policymaking. The COVID-19 M&S studies were of particular interest because they needed to be quickly operationalized by government and private decision-makers early in the COVID-19 pandemic and were accessible as open-source tools. Our findings demonstrate that the TR rubric represents a systematic tool for assessing the conformance of an M&S activity to codified good practices and enhances the value of the TR for supporting real-world decision-making. |
| format | Article |
| id | doaj-art-255e20d41e1143e3b549bfaeade935ee |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-255e20d41e1143e3b549bfaeade935ee2025-08-20T03:29:15ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01206e031371110.1371/journal.pone.0313711A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare.Alexandra ManchelAhmet ErdemirLealem MulugetaJoy P KuBruno V RegoMarc HornerWilliam W LyttonJerry G MyersRajanikanth VadigepalliThe power of computational modeling and simulation (M&S) is realized when the results are credible, and the workflow generates evidence that supports credibility for the context of use. The Committee on Credible Practice of Modeling & Simulation in Healthcare was established to help address the need for processes and procedures to support the credible use of M&S in healthcare and biomedical research. Our community efforts have led to the Ten Rules (TR) for Credible Practice of M&S in life sciences and healthcare. This framework is an outcome of a multidisciplinary investigation from a wide range of stakeholders beginning in 2012. Here, we present a pragmatic rubric for assessing the conformance of an M&S activity to the TR. This rubric considers the ability of an M&S study to communicate how well the study conforms to the Ten Rules for credible practice and facilitate outreach to a wide range of stakeholders from context-specific M&S practitioners to policymakers. It uses an ordinal scale ranging from Insufficient (zero) to Comprehensive (four) that is applicable to each rule, providing a uniform approach for comparing assessments across different reviewers and different modeling studies. We used the rubric to evaluate the conformance of two computational modeling activities: 1. six viral disease (COVID-19) propagation models, and 2. a model of hepatic glycogenolysis with neural innervation and calcium signaling. These examples were used to evaluate the applicability of the rubric and illustrate rubric usage in real-world M&S scenarios including those that bridge scientific M&S with policymaking. The COVID-19 M&S studies were of particular interest because they needed to be quickly operationalized by government and private decision-makers early in the COVID-19 pandemic and were accessible as open-source tools. Our findings demonstrate that the TR rubric represents a systematic tool for assessing the conformance of an M&S activity to codified good practices and enhances the value of the TR for supporting real-world decision-making.https://doi.org/10.1371/journal.pone.0313711 |
| spellingShingle | Alexandra Manchel Ahmet Erdemir Lealem Mulugeta Joy P Ku Bruno V Rego Marc Horner William W Lytton Jerry G Myers Rajanikanth Vadigepalli A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare. PLoS ONE |
| title | A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare. |
| title_full | A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare. |
| title_fullStr | A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare. |
| title_full_unstemmed | A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare. |
| title_short | A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare. |
| title_sort | rubric for assessing conformance to the ten rules for credible practice of modeling and simulation in healthcare |
| url | https://doi.org/10.1371/journal.pone.0313711 |
| work_keys_str_mv | AT alexandramanchel arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT ahmeterdemir arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT lealemmulugeta arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT joypku arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT brunovrego arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT marchorner arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT williamwlytton arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT jerrygmyers arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT rajanikanthvadigepalli arubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT alexandramanchel rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT ahmeterdemir rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT lealemmulugeta rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT joypku rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT brunovrego rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT marchorner rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT williamwlytton rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT jerrygmyers rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare AT rajanikanthvadigepalli rubricforassessingconformancetothetenrulesforcrediblepracticeofmodelingandsimulationinhealthcare |