Publication bias in reports of animal stroke studies leads to major overstatement of efficacy.
The consolidation of scientific knowledge proceeds through the interpretation and then distillation of data presented in research reports, first in review articles and then in textbooks and undergraduate courses, until truths become accepted as such both amongst "experts" and in the public...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2010-03-01
|
| Series: | PLoS Biology |
| Online Access: | https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.1000344&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849695114222370816 |
|---|---|
| author | Emily S Sena H Bart van der Worp Philip M W Bath David W Howells Malcolm R Macleod |
| author_facet | Emily S Sena H Bart van der Worp Philip M W Bath David W Howells Malcolm R Macleod |
| author_sort | Emily S Sena |
| collection | DOAJ |
| description | The consolidation of scientific knowledge proceeds through the interpretation and then distillation of data presented in research reports, first in review articles and then in textbooks and undergraduate courses, until truths become accepted as such both amongst "experts" and in the public understanding. Where data are collected but remain unpublished, they cannot contribute to this distillation of knowledge. If these unpublished data differ substantially from published work, conclusions may not reflect adequately the underlying biological effects being described. The existence and any impact of such "publication bias" in the laboratory sciences have not been described. Using the CAMARADES (Collaborative Approach to Meta-analysis and Review of Animal Data in Experimental Studies) database we identified 16 systematic reviews of interventions tested in animal studies of acute ischaemic stroke involving 525 unique publications. Only ten publications (2%) reported no significant effects on infarct volume and only six (1.2%) did not report at least one significant finding. Egger regression and trim-and-fill analysis suggested that publication bias was highly prevalent (present in the literature for 16 and ten interventions, respectively) in animal studies modelling stroke. Trim-and-fill analysis suggested that publication bias might account for around one-third of the efficacy reported in systematic reviews, with reported efficacy falling from 31.3% to 23.8% after adjustment for publication bias. We estimate that a further 214 experiments (in addition to the 1,359 identified through rigorous systematic review; non publication rate 14%) have been conducted but not reported. It is probable that publication bias has an important impact in other animal disease models, and more broadly in the life sciences. |
| format | Article |
| id | doaj-art-19af55a6f9af4bcba9e677d9b37bdee5 |
| institution | DOAJ |
| issn | 1544-9173 1545-7885 |
| language | English |
| publishDate | 2010-03-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS Biology |
| spelling | doaj-art-19af55a6f9af4bcba9e677d9b37bdee52025-08-20T03:19:52ZengPublic Library of Science (PLoS)PLoS Biology1544-91731545-78852010-03-0183e100034410.1371/journal.pbio.1000344Publication bias in reports of animal stroke studies leads to major overstatement of efficacy.Emily S SenaH Bart van der WorpPhilip M W BathDavid W HowellsMalcolm R MacleodThe consolidation of scientific knowledge proceeds through the interpretation and then distillation of data presented in research reports, first in review articles and then in textbooks and undergraduate courses, until truths become accepted as such both amongst "experts" and in the public understanding. Where data are collected but remain unpublished, they cannot contribute to this distillation of knowledge. If these unpublished data differ substantially from published work, conclusions may not reflect adequately the underlying biological effects being described. The existence and any impact of such "publication bias" in the laboratory sciences have not been described. Using the CAMARADES (Collaborative Approach to Meta-analysis and Review of Animal Data in Experimental Studies) database we identified 16 systematic reviews of interventions tested in animal studies of acute ischaemic stroke involving 525 unique publications. Only ten publications (2%) reported no significant effects on infarct volume and only six (1.2%) did not report at least one significant finding. Egger regression and trim-and-fill analysis suggested that publication bias was highly prevalent (present in the literature for 16 and ten interventions, respectively) in animal studies modelling stroke. Trim-and-fill analysis suggested that publication bias might account for around one-third of the efficacy reported in systematic reviews, with reported efficacy falling from 31.3% to 23.8% after adjustment for publication bias. We estimate that a further 214 experiments (in addition to the 1,359 identified through rigorous systematic review; non publication rate 14%) have been conducted but not reported. It is probable that publication bias has an important impact in other animal disease models, and more broadly in the life sciences.https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.1000344&type=printable |
| spellingShingle | Emily S Sena H Bart van der Worp Philip M W Bath David W Howells Malcolm R Macleod Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. PLoS Biology |
| title | Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. |
| title_full | Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. |
| title_fullStr | Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. |
| title_full_unstemmed | Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. |
| title_short | Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. |
| title_sort | publication bias in reports of animal stroke studies leads to major overstatement of efficacy |
| url | https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.1000344&type=printable |
| work_keys_str_mv | AT emilyssena publicationbiasinreportsofanimalstrokestudiesleadstomajoroverstatementofefficacy AT hbartvanderworp publicationbiasinreportsofanimalstrokestudiesleadstomajoroverstatementofefficacy AT philipmwbath publicationbiasinreportsofanimalstrokestudiesleadstomajoroverstatementofefficacy AT davidwhowells publicationbiasinreportsofanimalstrokestudiesleadstomajoroverstatementofefficacy AT malcolmrmacleod publicationbiasinreportsofanimalstrokestudiesleadstomajoroverstatementofefficacy |