Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review

Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis,...

Full description

Saved in:
Bibliographic Details
Main Authors: Moonseong Heo, Singh R. Nair, Judith Wylie-Rosett, Myles S. Faith, Angelo Pietrobelli, Nancy R. Glassman, Sarah N. Martin, Stephanie Dickinson, David B. Allison
Format: Article
Language:English
Published: Wiley 2018-01-01
Series:Journal of Obesity
Online Access:http://dx.doi.org/10.1155/2018/8767315
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832561723034304512
author Moonseong Heo
Singh R. Nair
Judith Wylie-Rosett
Myles S. Faith
Angelo Pietrobelli
Nancy R. Glassman
Sarah N. Martin
Stephanie Dickinson
David B. Allison
author_facet Moonseong Heo
Singh R. Nair
Judith Wylie-Rosett
Myles S. Faith
Angelo Pietrobelli
Nancy R. Glassman
Sarah N. Martin
Stephanie Dickinson
David B. Allison
author_sort Moonseong Heo
collection DOAJ
description Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5%) of studies incorporated ICC values for power analysis, fewer studies (8.3%) reported the estimated ICC, and 68.6% of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013–2017) compared to the prior years (74.1% versus 63.5%, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages.
format Article
id doaj-art-9cb5f4a36cff4207a13b8291410b8102
institution Kabale University
issn 2090-0708
2090-0716
language English
publishDate 2018-01-01
publisher Wiley
record_format Article
series Journal of Obesity
spelling doaj-art-9cb5f4a36cff4207a13b8291410b81022025-02-03T01:24:26ZengWileyJournal of Obesity2090-07082090-07162018-01-01201810.1155/2018/87673158767315Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature ReviewMoonseong Heo0Singh R. Nair1Judith Wylie-Rosett2Myles S. Faith3Angelo Pietrobelli4Nancy R. Glassman5Sarah N. Martin6Stephanie Dickinson7David B. Allison8Department of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Anesthesiology, Montefiore Medical Center, Bronx, NY, USADepartment of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Counseling, School, and Educational Psychology, Graduate School of Education, University at Buffalo-SUNY, Buffalo, NY, USADepartment of Pediatrics, University of Verona, Verona, ItalyD. Samuel Gottesman Library, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, NY, USADepartment of Epidemiology and Biostatistics, School of Public Health, Indiana University-Bloomington, Bloomington, IN, USADepartment of Epidemiology and Biostatistics, School of Public Health, Indiana University-Bloomington, Bloomington, IN, USAObjective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5%) of studies incorporated ICC values for power analysis, fewer studies (8.3%) reported the estimated ICC, and 68.6% of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013–2017) compared to the prior years (74.1% versus 63.5%, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages.http://dx.doi.org/10.1155/2018/8767315
spellingShingle Moonseong Heo
Singh R. Nair
Judith Wylie-Rosett
Myles S. Faith
Angelo Pietrobelli
Nancy R. Glassman
Sarah N. Martin
Stephanie Dickinson
David B. Allison
Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review
Journal of Obesity
title Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review
title_full Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review
title_fullStr Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review
title_full_unstemmed Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review
title_short Trial Characteristics and Appropriateness of Statistical Methods Applied for Design and Analysis of Randomized School-Based Studies Addressing Weight-Related Issues: A Literature Review
title_sort trial characteristics and appropriateness of statistical methods applied for design and analysis of randomized school based studies addressing weight related issues a literature review
url http://dx.doi.org/10.1155/2018/8767315
work_keys_str_mv AT moonseongheo trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT singhrnair trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT judithwylierosett trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT mylessfaith trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT angelopietrobelli trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT nancyrglassman trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT sarahnmartin trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT stephaniedickinson trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview
AT davidballison trialcharacteristicsandappropriatenessofstatisticalmethodsappliedfordesignandanalysisofrandomizedschoolbasedstudiesaddressingweightrelatedissuesaliteraturereview