Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia.
<h4>Background and objectives</h4>Diagnosis of Pulmonary Rifampicin Resistant Tuberculosis (RR-TB) with the Drug-Susceptibility Test (DST) is costly and time-consuming. Furthermore, GeneXpert for rapid diagnosis is not widely available in Indonesia. This study aims to develop and evaluat...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2021-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0249243&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850181165776896000 |
|---|---|
| author | Bumi Herman Wandee Sirichokchatchawan Sathirakorn Pongpanich Chanin Nantasenamat |
| author_facet | Bumi Herman Wandee Sirichokchatchawan Sathirakorn Pongpanich Chanin Nantasenamat |
| author_sort | Bumi Herman |
| collection | DOAJ |
| description | <h4>Background and objectives</h4>Diagnosis of Pulmonary Rifampicin Resistant Tuberculosis (RR-TB) with the Drug-Susceptibility Test (DST) is costly and time-consuming. Furthermore, GeneXpert for rapid diagnosis is not widely available in Indonesia. This study aims to develop and evaluate the CUHAS-ROBUST model performance, an artificial-intelligence-based RR-TB screening tool.<h4>Methods</h4>A cross-sectional study involved suspected all type of RR-TB patients with complete sputum Lowenstein Jensen DST (reference) and 19 clinical, laboratory, and radiology parameter results, retrieved from medical records in hospitals under the Faculty of Medicine, Hasanuddin University Indonesia, from January 2015-December 2019. The Artificial Neural Network (ANN) models were built along with other classifiers. The model was tested on participants recruited from January 2020-October 2020 and deployed into CUHAS-ROBUST (index test) application. Sensitivity, specificity, and accuracy were obtained for assessment.<h4>Results</h4>A total of 487 participants (32 Multidrug-Resistant/MDR 57 RR-TB, 398 drug-sensitive) were recruited for model building and 157 participants (23 MDR and 21 RR) in prospective testing. The ANN full model yields the highest values of accuracy (88% (95% CI 85-91)), and sensitivity (84% (95% CI 76-89)) compare to other models that show sensitivity below 80% (Logistic Regression 32%, Decision Tree 44%, Random Forest 25%, Extreme Gradient Boost 25%). However, this ANN has lower specificity among other models (90% (95% CI 86-93)) where Logistic Regression demonstrates the highest (99% (95% CI 97-99)). This ANN model was selected for the CUHAS-ROBUST application, although still lower than the sensitivity of global GeneXpert results (87.5%).<h4>Conclusion</h4>The ANN-CUHAS ROBUST outperforms other AI classifiers model in detecting all type of RR-TB, and by deploying into the application, the health staff can utilize the tool for screening purposes particularly at the primary care level where the GeneXpert examination is not available.<h4>Trial registration</h4>NCT04208789. |
| format | Article |
| id | doaj-art-d6830cbb3b464faabc6a45819fd45c0f |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-d6830cbb3b464faabc6a45819fd45c0f2025-08-20T02:17:57ZengPublic Library of Science (PLoS)PLoS ONE1932-62032021-01-01163e024924310.1371/journal.pone.0249243Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia.Bumi HermanWandee SirichokchatchawanSathirakorn PongpanichChanin Nantasenamat<h4>Background and objectives</h4>Diagnosis of Pulmonary Rifampicin Resistant Tuberculosis (RR-TB) with the Drug-Susceptibility Test (DST) is costly and time-consuming. Furthermore, GeneXpert for rapid diagnosis is not widely available in Indonesia. This study aims to develop and evaluate the CUHAS-ROBUST model performance, an artificial-intelligence-based RR-TB screening tool.<h4>Methods</h4>A cross-sectional study involved suspected all type of RR-TB patients with complete sputum Lowenstein Jensen DST (reference) and 19 clinical, laboratory, and radiology parameter results, retrieved from medical records in hospitals under the Faculty of Medicine, Hasanuddin University Indonesia, from January 2015-December 2019. The Artificial Neural Network (ANN) models were built along with other classifiers. The model was tested on participants recruited from January 2020-October 2020 and deployed into CUHAS-ROBUST (index test) application. Sensitivity, specificity, and accuracy were obtained for assessment.<h4>Results</h4>A total of 487 participants (32 Multidrug-Resistant/MDR 57 RR-TB, 398 drug-sensitive) were recruited for model building and 157 participants (23 MDR and 21 RR) in prospective testing. The ANN full model yields the highest values of accuracy (88% (95% CI 85-91)), and sensitivity (84% (95% CI 76-89)) compare to other models that show sensitivity below 80% (Logistic Regression 32%, Decision Tree 44%, Random Forest 25%, Extreme Gradient Boost 25%). However, this ANN has lower specificity among other models (90% (95% CI 86-93)) where Logistic Regression demonstrates the highest (99% (95% CI 97-99)). This ANN model was selected for the CUHAS-ROBUST application, although still lower than the sensitivity of global GeneXpert results (87.5%).<h4>Conclusion</h4>The ANN-CUHAS ROBUST outperforms other AI classifiers model in detecting all type of RR-TB, and by deploying into the application, the health staff can utilize the tool for screening purposes particularly at the primary care level where the GeneXpert examination is not available.<h4>Trial registration</h4>NCT04208789.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0249243&type=printable |
| spellingShingle | Bumi Herman Wandee Sirichokchatchawan Sathirakorn Pongpanich Chanin Nantasenamat Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia. PLoS ONE |
| title | Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia. |
| title_full | Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia. |
| title_fullStr | Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia. |
| title_full_unstemmed | Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia. |
| title_short | Development and performance of CUHAS-ROBUST application for pulmonary rifampicin-resistance tuberculosis screening in Indonesia. |
| title_sort | development and performance of cuhas robust application for pulmonary rifampicin resistance tuberculosis screening in indonesia |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0249243&type=printable |
| work_keys_str_mv | AT bumiherman developmentandperformanceofcuhasrobustapplicationforpulmonaryrifampicinresistancetuberculosisscreeninginindonesia AT wandeesirichokchatchawan developmentandperformanceofcuhasrobustapplicationforpulmonaryrifampicinresistancetuberculosisscreeninginindonesia AT sathirakornpongpanich developmentandperformanceofcuhasrobustapplicationforpulmonaryrifampicinresistancetuberculosisscreeninginindonesia AT chaninnantasenamat developmentandperformanceofcuhasrobustapplicationforpulmonaryrifampicinresistancetuberculosisscreeninginindonesia |