Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia.
<h4>Introduction</h4>In many low income countries, the delivery of quality health services is hampered by health system-wide barriers which are often interlinked, however empirical evidence on how to assess the level and scope of these barriers is scarce. A balanced scorecard is a tool t...
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2014-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0093977 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850125135470657536 |
|---|---|
| author | Wilbroad Mutale Jeffrey Stringer Namwinga Chintu Roma Chilengi Margaret Tembo Mwanamwenge Nkatya Kasese Dina Balabanova Neil Spicer James Lewis Helen Ayles |
| author_facet | Wilbroad Mutale Jeffrey Stringer Namwinga Chintu Roma Chilengi Margaret Tembo Mwanamwenge Nkatya Kasese Dina Balabanova Neil Spicer James Lewis Helen Ayles |
| author_sort | Wilbroad Mutale |
| collection | DOAJ |
| description | <h4>Introduction</h4>In many low income countries, the delivery of quality health services is hampered by health system-wide barriers which are often interlinked, however empirical evidence on how to assess the level and scope of these barriers is scarce. A balanced scorecard is a tool that allows for wider analysis of domains that are deemed important in achieving the overall vision of the health system. We present the quantitative results of the 12 months follow-up study applying the balanced scorecard approach in the BHOMA intervention with the aim of demonstrating the utility of the balanced scorecard in evaluating multiple building blocks in a trial setting.<h4>Methods</h4>The BHOMA is a cluster randomised trial that aims to strengthen the health system in three rural districts in Zambia. The intervention aims to improve clinical care quality by implementing practical tools that establish clear clinical care standards through intensive clinic implementations. This paper reports the findings of the follow-up health facility survey that was conducted after 12 months of intervention implementation. Comparisons were made between those facilities in the intervention and control sites. STATA version 12 was used for analysis.<h4>Results</h4>The study found significant mean differences between intervention(I) and control (C) sites in the following domains: Training domain (Mean I:C; 87.5.vs 61.1, mean difference 23.3, p = 0.031), adult clinical observation domain (mean I:C; 73.3 vs.58.0, mean difference 10.9, p = 0.02 ) and health information domain (mean I:C; 63.6 vs.56.1, mean difference 6.8, p = 0.01. There was no gender differences in adult service satisfaction. Governance and motivation scores did not differ between control and intervention sites.<h4>Conclusion</h4>This study demonstrates the utility of the balanced scorecard in assessing multiple elements of the health system. Using system wide approaches and triangulating data collection methods seems to be key to successful evaluation of such complex health intervention.<h4>Trial number</h4>ClinicalTrials.gov NCT01942278. |
| format | Article |
| id | doaj-art-a4c2e6e363d74b759deda5e36382ef4c |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2014-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-a4c2e6e363d74b759deda5e36382ef4c2025-08-20T02:34:10ZengPublic Library of Science (PLoS)PLoS ONE1932-62032014-01-0194e9397710.1371/journal.pone.0093977Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia.Wilbroad MutaleJeffrey StringerNamwinga ChintuRoma ChilengiMargaret Tembo MwanamwengeNkatya KaseseDina BalabanovaNeil SpicerJames LewisHelen Ayles<h4>Introduction</h4>In many low income countries, the delivery of quality health services is hampered by health system-wide barriers which are often interlinked, however empirical evidence on how to assess the level and scope of these barriers is scarce. A balanced scorecard is a tool that allows for wider analysis of domains that are deemed important in achieving the overall vision of the health system. We present the quantitative results of the 12 months follow-up study applying the balanced scorecard approach in the BHOMA intervention with the aim of demonstrating the utility of the balanced scorecard in evaluating multiple building blocks in a trial setting.<h4>Methods</h4>The BHOMA is a cluster randomised trial that aims to strengthen the health system in three rural districts in Zambia. The intervention aims to improve clinical care quality by implementing practical tools that establish clear clinical care standards through intensive clinic implementations. This paper reports the findings of the follow-up health facility survey that was conducted after 12 months of intervention implementation. Comparisons were made between those facilities in the intervention and control sites. STATA version 12 was used for analysis.<h4>Results</h4>The study found significant mean differences between intervention(I) and control (C) sites in the following domains: Training domain (Mean I:C; 87.5.vs 61.1, mean difference 23.3, p = 0.031), adult clinical observation domain (mean I:C; 73.3 vs.58.0, mean difference 10.9, p = 0.02 ) and health information domain (mean I:C; 63.6 vs.56.1, mean difference 6.8, p = 0.01. There was no gender differences in adult service satisfaction. Governance and motivation scores did not differ between control and intervention sites.<h4>Conclusion</h4>This study demonstrates the utility of the balanced scorecard in assessing multiple elements of the health system. Using system wide approaches and triangulating data collection methods seems to be key to successful evaluation of such complex health intervention.<h4>Trial number</h4>ClinicalTrials.gov NCT01942278.https://doi.org/10.1371/journal.pone.0093977 |
| spellingShingle | Wilbroad Mutale Jeffrey Stringer Namwinga Chintu Roma Chilengi Margaret Tembo Mwanamwenge Nkatya Kasese Dina Balabanova Neil Spicer James Lewis Helen Ayles Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia. PLoS ONE |
| title | Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia. |
| title_full | Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia. |
| title_fullStr | Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia. |
| title_full_unstemmed | Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia. |
| title_short | Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia. |
| title_sort | application of balanced scorecard in the evaluation of a complex health system intervention 12 months post intervention findings from the bhoma intervention a cluster randomised trial in zambia |
| url | https://doi.org/10.1371/journal.pone.0093977 |
| work_keys_str_mv | AT wilbroadmutale applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT jeffreystringer applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT namwingachintu applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT romachilengi applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT margarettembomwanamwenge applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT nkatyakasese applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT dinabalabanova applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT neilspicer applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT jameslewis applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia AT helenayles applicationofbalancedscorecardintheevaluationofacomplexhealthsystemintervention12monthspostinterventionfindingsfromthebhomainterventionaclusterrandomisedtrialinzambia |