Baseline-dependent improvement in CF studies, plausibility of bias
Background:: It has been commonly reported that therapeutic treatments in cystic fibrosis (CF) have ceiling effects, such that their efficacy is diminished for persons with high pre-treatment health (Montgomery et al., 2012 and Newsome et al., 2019). Floor effects have also been reported where decli...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-12-01
|
| Series: | Contemporary Clinical Trials Communications |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S245186542400125X |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850063255760797696 |
|---|---|
| author | Ellen Graham Sonya L. Heltshe Amalia S. Magaret |
| author_facet | Ellen Graham Sonya L. Heltshe Amalia S. Magaret |
| author_sort | Ellen Graham |
| collection | DOAJ |
| description | Background:: It has been commonly reported that therapeutic treatments in cystic fibrosis (CF) have ceiling effects, such that their efficacy is diminished for persons with high pre-treatment health (Montgomery et al., 2012 and Newsome et al., 2019). Floor effects have also been reported where decline is of lower magnitude in those with below-average pre-treatment health (Harun et al., 2016; Konstan et al., 2012 and Szczesniak et al., 2017). When measurement error is present, the statistical literature has warned of exaggerated or spurious associations between pre-treatment measures and subsequent change (Chambless and Davis, 2003 and Yanez et al., 1998). Measurement error, equivalently described as day-to-day variation, has been described to occur in CF outcome measurements such as forced expiratory volume in 1 s taken by spirometry (FEV1pp) (Magaret et al., 2024; Stanojevic et al., 2020 and Thornton et al., 2023). Methods:: We conducted a simulation study to assess the potential for spurious floor or ceiling effects in studies of CF therapeutics. We considered uncontrolled or single-arm studies, and evaluated estimated association between pre-treatment FEV1pp and treatment-induced change: post-versus pre-treatment. Results:: When day-to-day variation was present in FEV1pp, at levels equivalent to those reported in large studies measuring spirometry both at home and in clinic, naive analytic approaches found spurious associations of change with baseline (Paynter et al., 2022 and Saiman et al., 2003). Type I error ranged from 31.9% to 98.3% for day-to-day variation as high as 3% to 15% relative to biological variation. Incorporating known day-to-day variation, the regression calibration approach corrected bias and controlled type I error (Chambless and Davis, 2003). Conclusion:: Exaggerated ceiling effects are possible. Further studies could provide meaningful confirmation of ceiling effects in CF, perhaps reducing day-to-day variation by incorporating multiple pre- and post-treatment measurements. |
| format | Article |
| id | doaj-art-fb807b97fa344b1397242527eb442129 |
| institution | DOAJ |
| issn | 2451-8654 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Contemporary Clinical Trials Communications |
| spelling | doaj-art-fb807b97fa344b1397242527eb4421292025-08-20T02:49:41ZengElsevierContemporary Clinical Trials Communications2451-86542024-12-014210137810.1016/j.conctc.2024.101378Baseline-dependent improvement in CF studies, plausibility of biasEllen Graham0Sonya L. Heltshe1Amalia S. Magaret2MS University of Washington, Department of Biostatistics, United States of AmericaUniversity of Washington, Departments of Pediatrics and Biostatistics Seattle Children’s Research Institute, Center for Respiratory Biology and Therapeutics, United States of AmericaUniversity of Washington, Departments of Pediatrics and Biostatistics Seattle Children’s Research Institute, Center for Respiratory Biology and Therapeutics, United States of America; Corresponding author.Background:: It has been commonly reported that therapeutic treatments in cystic fibrosis (CF) have ceiling effects, such that their efficacy is diminished for persons with high pre-treatment health (Montgomery et al., 2012 and Newsome et al., 2019). Floor effects have also been reported where decline is of lower magnitude in those with below-average pre-treatment health (Harun et al., 2016; Konstan et al., 2012 and Szczesniak et al., 2017). When measurement error is present, the statistical literature has warned of exaggerated or spurious associations between pre-treatment measures and subsequent change (Chambless and Davis, 2003 and Yanez et al., 1998). Measurement error, equivalently described as day-to-day variation, has been described to occur in CF outcome measurements such as forced expiratory volume in 1 s taken by spirometry (FEV1pp) (Magaret et al., 2024; Stanojevic et al., 2020 and Thornton et al., 2023). Methods:: We conducted a simulation study to assess the potential for spurious floor or ceiling effects in studies of CF therapeutics. We considered uncontrolled or single-arm studies, and evaluated estimated association between pre-treatment FEV1pp and treatment-induced change: post-versus pre-treatment. Results:: When day-to-day variation was present in FEV1pp, at levels equivalent to those reported in large studies measuring spirometry both at home and in clinic, naive analytic approaches found spurious associations of change with baseline (Paynter et al., 2022 and Saiman et al., 2003). Type I error ranged from 31.9% to 98.3% for day-to-day variation as high as 3% to 15% relative to biological variation. Incorporating known day-to-day variation, the regression calibration approach corrected bias and controlled type I error (Chambless and Davis, 2003). Conclusion:: Exaggerated ceiling effects are possible. Further studies could provide meaningful confirmation of ceiling effects in CF, perhaps reducing day-to-day variation by incorporating multiple pre- and post-treatment measurements.http://www.sciencedirect.com/science/article/pii/S245186542400125XCystic fibrosisSingle-armClinical trialMeasurement error |
| spellingShingle | Ellen Graham Sonya L. Heltshe Amalia S. Magaret Baseline-dependent improvement in CF studies, plausibility of bias Contemporary Clinical Trials Communications Cystic fibrosis Single-arm Clinical trial Measurement error |
| title | Baseline-dependent improvement in CF studies, plausibility of bias |
| title_full | Baseline-dependent improvement in CF studies, plausibility of bias |
| title_fullStr | Baseline-dependent improvement in CF studies, plausibility of bias |
| title_full_unstemmed | Baseline-dependent improvement in CF studies, plausibility of bias |
| title_short | Baseline-dependent improvement in CF studies, plausibility of bias |
| title_sort | baseline dependent improvement in cf studies plausibility of bias |
| topic | Cystic fibrosis Single-arm Clinical trial Measurement error |
| url | http://www.sciencedirect.com/science/article/pii/S245186542400125X |
| work_keys_str_mv | AT ellengraham baselinedependentimprovementincfstudiesplausibilityofbias AT sonyalheltshe baselinedependentimprovementincfstudiesplausibilityofbias AT amaliasmagaret baselinedependentimprovementincfstudiesplausibilityofbias |