Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review
Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis,...
Saved in:
Main Authors: | , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2018-01-01
|
Series: | Journal of Obesity |
Online Access: | http://dx.doi.org/10.1155/2018/8767315 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832561723034304512 |
---|---|
author | Moonseong Heo Singh R. Nair Judith Wylie-Rosett Myles S. Faith Angelo Pietrobelli Nancy R. Glassman Sarah N. Martin Stephanie Dickinson David B. Allison |
author_facet | Moonseong Heo Singh R. Nair Judith Wylie-Rosett Myles S. Faith Angelo Pietrobelli Nancy R. Glassman Sarah N. Martin Stephanie Dickinson David B. Allison |
author_sort | Moonseong Heo |
collection | DOAJ |
description | Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5%) of studies incorporated ICC values for power analysis, fewer studies (8.3%) reported the estimated ICC, and 68.6% of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013–2017) compared to the prior years (74.1% versus 63.5%, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages. |
format | Article |
id | doaj-art-9cb5f4a36cff4207a13b8291410b8102 |
institution | Kabale University |
issn | 2090-0708 2090-0716 |
language | English |
publishDate | 2018-01-01 |
publisher | Wiley |
record_format | Article |
series | Journal of Obesity |
spelling | doaj-art-9cb5f4a36cff4207a13b8291410b81022025-02-03T01:24:26ZengWileyJournal of Obesity2090-07082090-07162018-01-01201810.1155/2018/87673158767315Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature ReviewMoonseong Heo0Singh R. Nair1Judith Wylie-Rosett2Myles S. Faith3Angelo Pietrobelli4Nancy R. Glassman5Sarah N. Martin6Stephanie Dickinson7David B. Allison8Department of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Anesthesiology, Montefiore Medical Center, Bronx, NY, USADepartment of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Counseling, School, and Educational Psychology, Graduate School of Education, University at Buffalo-SUNY, Buffalo, NY, USADepartment of Pediatrics, University of Verona, Verona, ItalyD. Samuel Gottesman Library, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Epidemiology and Biostatistics, School of Public Health, Indiana University-Bloomington, Bloomington, IN, USADepartment of Epidemiology and Biostatistics, School of Public Health, Indiana University-Bloomington, Bloomington, IN, USAObjective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5%) of studies incorporated ICC values for power analysis, fewer studies (8.3%) reported the estimated ICC, and 68.6% of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013–2017) compared to the prior years (74.1% versus 63.5%, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages.http://dx.doi.org/10.1155/2018/8767315 |
spellingShingle | Moonseong Heo Singh R. Nair Judith Wylie-Rosett Myles S. Faith Angelo Pietrobelli Nancy R. Glassman Sarah N. Martin Stephanie Dickinson David B. Allison Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review Journal of Obesity |
title | Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review |
title_full | Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review |
title_fullStr | Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review |
title_full_unstemmed | Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review |
title_short | Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review |
title_sort | trial characteristics and appropriateness of statistical methods applied for design and analysis of randomized school based studies addressing weight related issues a literature review |
url | http://dx.doi.org/10.1155/2018/8767315 |
work_keys_str_mv | AT moonseongheo trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT singhrnair trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT judithwylierosett trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT mylessfaith trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT angelopietrobelli trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT nancyrglassman trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT sarahnmartin trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT stephaniedickinson trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview AT davidballison trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview |