Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services research

Objective Engaging stakeholders in reviews is considered to generate more relevant evidence and to facilitate dissemination and use. As little is known about stakeholder involvement, we assessed the characteristics of their engagement in systematic and rapid reviews and the methodological quality of...

Full description

Saved in:
Bibliographic Details
Main Authors: Milo Alan Puhan, Jonas Feldmann, Margot Mütsch
Format: Article
Language:English
Published: BMJ Publishing Group 2019-08-01
Series:BMJ Open
Online Access:https://bmjopen.bmj.com/content/9/8/e024587.full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850268218865745920
author Milo Alan Puhan
Jonas Feldmann
Margot Mütsch
author_facet Milo Alan Puhan
Jonas Feldmann
Margot Mütsch
author_sort Milo Alan Puhan
collection DOAJ
description Objective Engaging stakeholders in reviews is considered to generate more relevant evidence and to facilitate dissemination and use. As little is known about stakeholder involvement, we assessed the characteristics of their engagement in systematic and rapid reviews and the methodological quality of included studies. Stakeholders were people with a particular interest in the research topic.Design Methodological review.Search strategy Four databases (Medline, Embase, Cochrane database of systematic reviews, databases of the University of York, Center for Reviews and Dissemination (CRD)) were searched based on an a priori protocol. Four types of reviews (Cochrane and non-Cochrane systematic reviews, rapid and CRD rapid reviews) were retrieved between January 2011 and October 2015, pooled by potential review type and duplicates excluded. Articles were randomly ordered and screened for inclusion and exclusion criteria until 30 reviews per group were reached. Their methodological quality was assessed using AMSTAR and stakeholder characteristics were collected.Results In total, 57 822 deduplicated citations were detected with potential non-Cochrane systematic reviews being the biggest group (56 986 records). We found stakeholder involvement in 13% (4/30) of Cochrane, 20% (6/30) of non-Cochrane, 43% (13/30) of rapid and 93% (28/30) of CRD reviews. Overall, 33% (17/51) of the responding contact authors mentioned positive effects of stakeholder involvement. A conflict of interest statement remained unmentioned in 40% (12/30) of non-Cochrane and in 27% (8/30) of rapid reviews, but not in Cochrane or CRD reviews. At most, half of non-Cochrane and rapid reviews mentioned an a priori study protocol in contrast to all Cochrane reviews.Conclusion Stakeholder engagement was not general practice, except for CRD reviews, although it was more common in rapid reviews. Reporting factors, such as including an a priori study protocol and a conflict of interest statement should be considered in conjunction with involving stakeholders.
format Article
id doaj-art-24df7ff57b014579ac3c9cc9d6bdc973
institution OA Journals
issn 2044-6055
language English
publishDate 2019-08-01
publisher BMJ Publishing Group
record_format Article
series BMJ Open
spelling doaj-art-24df7ff57b014579ac3c9cc9d6bdc9732025-08-20T01:53:31ZengBMJ Publishing GroupBMJ Open2044-60552019-08-019810.1136/bmjopen-2018-024587Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services researchMilo Alan Puhan0Jonas Feldmann1Margot Mütsch2Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, SwitzerlandEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, SwitzerlandEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, SwitzerlandObjective Engaging stakeholders in reviews is considered to generate more relevant evidence and to facilitate dissemination and use. As little is known about stakeholder involvement, we assessed the characteristics of their engagement in systematic and rapid reviews and the methodological quality of included studies. Stakeholders were people with a particular interest in the research topic.Design Methodological review.Search strategy Four databases (Medline, Embase, Cochrane database of systematic reviews, databases of the University of York, Center for Reviews and Dissemination (CRD)) were searched based on an a priori protocol. Four types of reviews (Cochrane and non-Cochrane systematic reviews, rapid and CRD rapid reviews) were retrieved between January 2011 and October 2015, pooled by potential review type and duplicates excluded. Articles were randomly ordered and screened for inclusion and exclusion criteria until 30 reviews per group were reached. Their methodological quality was assessed using AMSTAR and stakeholder characteristics were collected.Results In total, 57 822 deduplicated citations were detected with potential non-Cochrane systematic reviews being the biggest group (56 986 records). We found stakeholder involvement in 13% (4/30) of Cochrane, 20% (6/30) of non-Cochrane, 43% (13/30) of rapid and 93% (28/30) of CRD reviews. Overall, 33% (17/51) of the responding contact authors mentioned positive effects of stakeholder involvement. A conflict of interest statement remained unmentioned in 40% (12/30) of non-Cochrane and in 27% (8/30) of rapid reviews, but not in Cochrane or CRD reviews. At most, half of non-Cochrane and rapid reviews mentioned an a priori study protocol in contrast to all Cochrane reviews.Conclusion Stakeholder engagement was not general practice, except for CRD reviews, although it was more common in rapid reviews. Reporting factors, such as including an a priori study protocol and a conflict of interest statement should be considered in conjunction with involving stakeholders.https://bmjopen.bmj.com/content/9/8/e024587.full
spellingShingle Milo Alan Puhan
Jonas Feldmann
Margot Mütsch
Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services research
BMJ Open
title Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services research
title_full Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services research
title_fullStr Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services research
title_full_unstemmed Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services research
title_short Characteristics of stakeholder involvement in systematic and rapid reviews: a methodological review in the area of health services research
title_sort characteristics of stakeholder involvement in systematic and rapid reviews a methodological review in the area of health services research
url https://bmjopen.bmj.com/content/9/8/e024587.full
work_keys_str_mv AT miloalanpuhan characteristicsofstakeholderinvolvementinsystematicandrapidreviewsamethodologicalreviewintheareaofhealthservicesresearch
AT jonasfeldmann characteristicsofstakeholderinvolvementinsystematicandrapidreviewsamethodologicalreviewintheareaofhealthservicesresearch
AT margotmutsch characteristicsofstakeholderinvolvementinsystematicandrapidreviewsamethodologicalreviewintheareaofhealthservicesresearch