Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel
Abstract Background According to the World Health Organization’s Integrated Management of Childhood Illness (IMCI) guidelines, childhood pneumonia diagnosis relies on counting respiratory rate (RR). Counting RR by health workers is frequently inaccurate, leading to misdiagnosis and poor outcomes. Au...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-08-01
|
| Series: | BMC Digital Health |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s44247-025-00175-3 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849225936963108864 |
|---|---|
| author | Ahad Mahmud Khan Md Shafiqul Islam Nabidul Haque Chowdhury Salahuddin Ahmed Rezwana Tabassum Sadia Afrin Zannatul Ferdush Amin Kazi Sazzadul Haque Afroza Yeasmin Rumi Jawata Rahman Rakib Bhuiyan Rizouan Ur Rashid Kamrun Nahar Robynne Simpson Ayaz Ahmed Md Mozibur Rahman Ting Shi Abdullah H. Baqui Steve Cunningham Eric D. McCollum Harry Campbell |
| author_facet | Ahad Mahmud Khan Md Shafiqul Islam Nabidul Haque Chowdhury Salahuddin Ahmed Rezwana Tabassum Sadia Afrin Zannatul Ferdush Amin Kazi Sazzadul Haque Afroza Yeasmin Rumi Jawata Rahman Rakib Bhuiyan Rizouan Ur Rashid Kamrun Nahar Robynne Simpson Ayaz Ahmed Md Mozibur Rahman Ting Shi Abdullah H. Baqui Steve Cunningham Eric D. McCollum Harry Campbell |
| author_sort | Ahad Mahmud Khan |
| collection | DOAJ |
| description | Abstract Background According to the World Health Organization’s Integrated Management of Childhood Illness (IMCI) guidelines, childhood pneumonia diagnosis relies on counting respiratory rate (RR). Counting RR by health workers is frequently inaccurate, leading to misdiagnosis and poor outcomes. Automated RR counters could potentially overcome these limitations. To address this gap, we introduced an automated RR counter and developed a reference video expert panel (VEP) to evaluate its performance. Methods We conducted a cross-sectional study involving children aged 0–59 months with suspected pneumonia in Bangladesh. The RR of children was counted using an automated counter (ChARM) and chest movements were simultaneously videotaped. These videos were interpreted by the VEP, trained to a standard procedure. We assessed ChARM’s accuracy in comparison to the RR generated by the VEP and summarised the time taken to count RR by ChARM. Results Among 339 enrolled children, ChARM successfully counted the RR of 294 children (86.7%). The VEP reached a consensus (i.e., RR count difference within two breaths per minute (bpm) between two VEP members) in 257 of the 294 children (87.4%). ChARM and the VEP agreed on RR counts within two bpm in 68.1% of children (n = 175/257), with a mean difference of 1.7 bpm and limits of agreement ranging from -6.7 to 10.2 bpm. ChARM classified age-adjusted fast and normal breathing with a sensitivity of 95.8% (95% CI: 88.1–99.1) and a specificity of 93.5% (95% CI: 89.0–96.6), demonstrating high agreement (kappa = 0.86). The median time to count the RR by ChARM was 66 s (interquartile range: 61–73 s). Conclusions ChARM counted RR accurately against a VEP reference, indicating a potential role in supporting health workers to diagnose pneumonia. However, it was unsuccessful for 1 in 8 cases, typically those more clinically challenging, suggesting a possible systematic bias. Further research is needed to address these issues and confirm ChARM’s reliability for broader use in real-world settings. Trial registration Current Controlled Trials ISRCTN14120515, registered retrospectively on 19 September 2024. |
| format | Article |
| id | doaj-art-b6bbb10b02804d36b5cfedcd806044c6 |
| institution | Kabale University |
| issn | 2731-684X |
| language | English |
| publishDate | 2025-08-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Digital Health |
| spelling | doaj-art-b6bbb10b02804d36b5cfedcd806044c62025-08-24T11:51:31ZengBMCBMC Digital Health2731-684X2025-08-013111010.1186/s44247-025-00175-3Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panelAhad Mahmud Khan0Md Shafiqul Islam1Nabidul Haque Chowdhury2Salahuddin Ahmed3Rezwana Tabassum4Sadia Afrin5Zannatul Ferdush Amin6Kazi Sazzadul Haque7Afroza Yeasmin Rumi8Jawata Rahman9Rakib Bhuiyan10Rizouan Ur Rashid11Kamrun Nahar12Robynne Simpson13Ayaz Ahmed14Md Mozibur Rahman15Ting Shi16Abdullah H. Baqui17Steve Cunningham18Eric D. McCollum19Harry Campbell20Projahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationProjahnmo Research FoundationUniversity of GreenwichUniversity of GreenwichDepartment of Paediatrics, Shaheed Suhrawardi Medical College HospitalRoyal Hospital for ChildrenRoyal Hospital for ChildrenDepartment of Neonatology, Institute of Child and Mother HealthUsher Institute, University of EdinburghDepartment of International Health, Johns Hopkins Bloomberg School of Public HealthCentre for Inflammation Research, University of EdinburghDepartment of International Health, Johns Hopkins Bloomberg School of Public HealthUsher Institute, University of EdinburghAbstract Background According to the World Health Organization’s Integrated Management of Childhood Illness (IMCI) guidelines, childhood pneumonia diagnosis relies on counting respiratory rate (RR). Counting RR by health workers is frequently inaccurate, leading to misdiagnosis and poor outcomes. Automated RR counters could potentially overcome these limitations. To address this gap, we introduced an automated RR counter and developed a reference video expert panel (VEP) to evaluate its performance. Methods We conducted a cross-sectional study involving children aged 0–59 months with suspected pneumonia in Bangladesh. The RR of children was counted using an automated counter (ChARM) and chest movements were simultaneously videotaped. These videos were interpreted by the VEP, trained to a standard procedure. We assessed ChARM’s accuracy in comparison to the RR generated by the VEP and summarised the time taken to count RR by ChARM. Results Among 339 enrolled children, ChARM successfully counted the RR of 294 children (86.7%). The VEP reached a consensus (i.e., RR count difference within two breaths per minute (bpm) between two VEP members) in 257 of the 294 children (87.4%). ChARM and the VEP agreed on RR counts within two bpm in 68.1% of children (n = 175/257), with a mean difference of 1.7 bpm and limits of agreement ranging from -6.7 to 10.2 bpm. ChARM classified age-adjusted fast and normal breathing with a sensitivity of 95.8% (95% CI: 88.1–99.1) and a specificity of 93.5% (95% CI: 89.0–96.6), demonstrating high agreement (kappa = 0.86). The median time to count the RR by ChARM was 66 s (interquartile range: 61–73 s). Conclusions ChARM counted RR accurately against a VEP reference, indicating a potential role in supporting health workers to diagnose pneumonia. However, it was unsuccessful for 1 in 8 cases, typically those more clinically challenging, suggesting a possible systematic bias. Further research is needed to address these issues and confirm ChARM’s reliability for broader use in real-world settings. Trial registration Current Controlled Trials ISRCTN14120515, registered retrospectively on 19 September 2024.https://doi.org/10.1186/s44247-025-00175-3PneumoniaRespiratory rateFast breathingAutomated counterVideo expert panelReference standard |
| spellingShingle | Ahad Mahmud Khan Md Shafiqul Islam Nabidul Haque Chowdhury Salahuddin Ahmed Rezwana Tabassum Sadia Afrin Zannatul Ferdush Amin Kazi Sazzadul Haque Afroza Yeasmin Rumi Jawata Rahman Rakib Bhuiyan Rizouan Ur Rashid Kamrun Nahar Robynne Simpson Ayaz Ahmed Md Mozibur Rahman Ting Shi Abdullah H. Baqui Steve Cunningham Eric D. McCollum Harry Campbell Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel BMC Digital Health Pneumonia Respiratory rate Fast breathing Automated counter Video expert panel Reference standard |
| title | Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel |
| title_full | Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel |
| title_fullStr | Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel |
| title_full_unstemmed | Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel |
| title_short | Evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel |
| title_sort | evaluating the performance of an automated respiratory rate counter in detecting fast breathing pneumonia in children using a reference video expert panel |
| topic | Pneumonia Respiratory rate Fast breathing Automated counter Video expert panel Reference standard |
| url | https://doi.org/10.1186/s44247-025-00175-3 |
| work_keys_str_mv | AT ahadmahmudkhan evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT mdshafiqulislam evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT nabidulhaquechowdhury evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT salahuddinahmed evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT rezwanatabassum evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT sadiaafrin evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT zannatulferdushamin evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT kazisazzadulhaque evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT afrozayeasminrumi evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT jawatarahman evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT rakibbhuiyan evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT rizouanurrashid evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT kamrunnahar evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT robynnesimpson evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT ayazahmed evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT mdmoziburrahman evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT tingshi evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT abdullahhbaqui evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT stevecunningham evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT ericdmccollum evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel AT harrycampbell evaluatingtheperformanceofanautomatedrespiratoryratecounterindetectingfastbreathingpneumoniainchildrenusingareferencevideoexpertpanel |