Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments.
<h4>Introduction</h4>The Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recomm...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2017-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0174831 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849434711031545856 |
|---|---|
| author | Wiebke Hoffmann-Eßer Ulrich Siering Edmund A M Neugebauer Anne Catharina Brockhaus Ulrike Lampert Michaela Eikermann |
| author_facet | Wiebke Hoffmann-Eßer Ulrich Siering Edmund A M Neugebauer Anne Catharina Brockhaus Ulrike Lampert Michaela Eikermann |
| author_sort | Wiebke Hoffmann-Eßer |
| collection | DOAJ |
| description | <h4>Introduction</h4>The Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recommendation for use). The aim of this systematic review was twofold. Firstly, to investigate how often AGREE II users conduct the 2 overall assessments. Secondly, to investigate the influence of the 6 domain scores on each of the 2 overall assessments.<h4>Materials and methods</h4>A systematic bibliographic search was conducted for publications reporting guideline appraisals with AGREE II. The impact of the 6 domain scores on the overall assessment of guideline quality was examined using a multiple linear regression model. Their impact on the recommendation for use (possible answers: "yes", "yes, with modifications", "no") was examined using a multinomial regression model.<h4>Results</h4>118 relevant publications including 1453 guidelines were identified. 77.1% of the publications reported results for at least one overall assessment, but only 32.2% reported results for both overall assessments. The results of the regression analyses showed a statistically significant influence of all domains on overall guideline quality, with Domain 3 (rigour of development) having the strongest influence. For the recommendation for use, the results showed a significant influence of Domains 3 to 5 ("yes" vs. "no") and Domains 3 and 5 ("yes, with modifications" vs. "no").<h4>Conclusions</h4>The 2 overall assessments of AGREE II are underreported by guideline assessors. Domains 3 and 5 have the strongest influence on the results of the 2 overall assessments, while the other domains have a varying influence. Within a normative approach, our findings could be used as guidance for weighting individual domains in AGREE II to make the overall assessments more objective. Alternatively, a stronger content analysis of the individual domains could clarify their importance in terms of guideline quality. Moreover, AGREE II should require users to transparently present how they conducted the assessments. |
| format | Article |
| id | doaj-art-db37fc32497f481d8a6086d0f404cd6e |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2017-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-db37fc32497f481d8a6086d0f404cd6e2025-08-20T03:26:34ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01123e017483110.1371/journal.pone.0174831Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments.Wiebke Hoffmann-EßerUlrich SieringEdmund A M NeugebauerAnne Catharina BrockhausUlrike LampertMichaela Eikermann<h4>Introduction</h4>The Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recommendation for use). The aim of this systematic review was twofold. Firstly, to investigate how often AGREE II users conduct the 2 overall assessments. Secondly, to investigate the influence of the 6 domain scores on each of the 2 overall assessments.<h4>Materials and methods</h4>A systematic bibliographic search was conducted for publications reporting guideline appraisals with AGREE II. The impact of the 6 domain scores on the overall assessment of guideline quality was examined using a multiple linear regression model. Their impact on the recommendation for use (possible answers: "yes", "yes, with modifications", "no") was examined using a multinomial regression model.<h4>Results</h4>118 relevant publications including 1453 guidelines were identified. 77.1% of the publications reported results for at least one overall assessment, but only 32.2% reported results for both overall assessments. The results of the regression analyses showed a statistically significant influence of all domains on overall guideline quality, with Domain 3 (rigour of development) having the strongest influence. For the recommendation for use, the results showed a significant influence of Domains 3 to 5 ("yes" vs. "no") and Domains 3 and 5 ("yes, with modifications" vs. "no").<h4>Conclusions</h4>The 2 overall assessments of AGREE II are underreported by guideline assessors. Domains 3 and 5 have the strongest influence on the results of the 2 overall assessments, while the other domains have a varying influence. Within a normative approach, our findings could be used as guidance for weighting individual domains in AGREE II to make the overall assessments more objective. Alternatively, a stronger content analysis of the individual domains could clarify their importance in terms of guideline quality. Moreover, AGREE II should require users to transparently present how they conducted the assessments.https://doi.org/10.1371/journal.pone.0174831 |
| spellingShingle | Wiebke Hoffmann-Eßer Ulrich Siering Edmund A M Neugebauer Anne Catharina Brockhaus Ulrike Lampert Michaela Eikermann Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. PLoS ONE |
| title | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_full | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_fullStr | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_full_unstemmed | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_short | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_sort | guideline appraisal with agree ii systematic review of the current evidence on how users handle the 2 overall assessments |
| url | https://doi.org/10.1371/journal.pone.0174831 |
| work_keys_str_mv | AT wiebkehoffmanneßer guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT ulrichsiering guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT edmundamneugebauer guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT annecatharinabrockhaus guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT ulrikelampert guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT michaelaeikermann guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments |