Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality.
<h4>Introduction</h4>The Standardised Mortality Ratio (SMR) is increasingly used to compare the performance of different healthcare providers. However, it has long been known that differences in the populations of the providers can cause biased results when directly comparing two SMRs. T...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2013-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0061237&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849470505339322368 |
|---|---|
| author | T Alun Evans Sarah E Seaton Bradley N Manktelow |
| author_facet | T Alun Evans Sarah E Seaton Bradley N Manktelow |
| author_sort | T Alun Evans |
| collection | DOAJ |
| description | <h4>Introduction</h4>The Standardised Mortality Ratio (SMR) is increasingly used to compare the performance of different healthcare providers. However, it has long been known that differences in the populations of the providers can cause biased results when directly comparing two SMRs. This is potentially a particular problem in neonatal medicine where units provide different levels of care.<h4>Methods</h4>Using data from The Neonatal Survey (TNS), babies born at 24 to 31 weeks gestational age from 2002 to 2011 and admitted to one of 11 UK neonatal units were identified. Risk-adjusted SMRs were calculated for each unit using a previously published model to estimate the expected number of deaths. The model parameters were then re-estimated based on data from each individual neonatal unit ("reference" unit) and these then applied to each of the other units to estimate the number of deaths each unit would have observed if they had the same underlying mortality rates as each of the "reference" hospitals. The ratios of the SMRs were then calculated under the assumption of identical risk-specific probabilities of death.<h4>Results</h4>7243 babies were included in all analyses. When comparing between Network Neonatal Units (Level 3) the ratio of SMRs ranged from 0.92 to 1.00 and for the comparisons within Local Neonatal Units (Level 2) ranged from 0.79 to 1.56. However when comparing between neonatal units providing different levels of care ratios up to 1.68 were observed.<h4>Conclusions</h4>If the populations of healthcare providers differ considerably then it is likely that bias will be an issue when directly comparing SMRs. In neonatal care, the comparison of Network Neonatal Units is likely to be useful but caution is required when comparing Local Neonatal Units or between units of different types. Tools to quantify the likely bias are required. |
| format | Article |
| id | doaj-art-7c8b1b4bf75443e39ebcf07ac28d9661 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2013-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-7c8b1b4bf75443e39ebcf07ac28d96612025-08-20T03:25:08ZengPublic Library of Science (PLoS)PLoS ONE1932-62032013-01-0184e6123710.1371/journal.pone.0061237Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality.T Alun EvansSarah E SeatonBradley N Manktelow<h4>Introduction</h4>The Standardised Mortality Ratio (SMR) is increasingly used to compare the performance of different healthcare providers. However, it has long been known that differences in the populations of the providers can cause biased results when directly comparing two SMRs. This is potentially a particular problem in neonatal medicine where units provide different levels of care.<h4>Methods</h4>Using data from The Neonatal Survey (TNS), babies born at 24 to 31 weeks gestational age from 2002 to 2011 and admitted to one of 11 UK neonatal units were identified. Risk-adjusted SMRs were calculated for each unit using a previously published model to estimate the expected number of deaths. The model parameters were then re-estimated based on data from each individual neonatal unit ("reference" unit) and these then applied to each of the other units to estimate the number of deaths each unit would have observed if they had the same underlying mortality rates as each of the "reference" hospitals. The ratios of the SMRs were then calculated under the assumption of identical risk-specific probabilities of death.<h4>Results</h4>7243 babies were included in all analyses. When comparing between Network Neonatal Units (Level 3) the ratio of SMRs ranged from 0.92 to 1.00 and for the comparisons within Local Neonatal Units (Level 2) ranged from 0.79 to 1.56. However when comparing between neonatal units providing different levels of care ratios up to 1.68 were observed.<h4>Conclusions</h4>If the populations of healthcare providers differ considerably then it is likely that bias will be an issue when directly comparing SMRs. In neonatal care, the comparison of Network Neonatal Units is likely to be useful but caution is required when comparing Local Neonatal Units or between units of different types. Tools to quantify the likely bias are required.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0061237&type=printable |
| spellingShingle | T Alun Evans Sarah E Seaton Bradley N Manktelow Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality. PLoS ONE |
| title | Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality. |
| title_full | Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality. |
| title_fullStr | Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality. |
| title_full_unstemmed | Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality. |
| title_short | Quantifying the potential bias when directly comparing standardised mortality ratios for in-unit neonatal mortality. |
| title_sort | quantifying the potential bias when directly comparing standardised mortality ratios for in unit neonatal mortality |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0061237&type=printable |
| work_keys_str_mv | AT talunevans quantifyingthepotentialbiaswhendirectlycomparingstandardisedmortalityratiosforinunitneonatalmortality AT saraheseaton quantifyingthepotentialbiaswhendirectlycomparingstandardisedmortalityratiosforinunitneonatalmortality AT bradleynmanktelow quantifyingthepotentialbiaswhendirectlycomparingstandardisedmortalityratiosforinunitneonatalmortality |