Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication study
Machine learning combined with large-scale neuroimaging databases has been proposed as a promising tool for improving our understanding of the behavioural emergence and early prediction of the neurodevelopmental outcome. A recent example of this strategy is a study by Ouyang et al. (2020) which sugg...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-06-01
|
| Series: | NeuroImage: Reports |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2666956023000156 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849738027510792192 |
|---|---|
| author | Andrea Gondová Sara Neumane Yann Leprince Jean-François Mangin Tomoki Arichi Jessica Dubois |
| author_facet | Andrea Gondová Sara Neumane Yann Leprince Jean-François Mangin Tomoki Arichi Jessica Dubois |
| author_sort | Andrea Gondová |
| collection | DOAJ |
| description | Machine learning combined with large-scale neuroimaging databases has been proposed as a promising tool for improving our understanding of the behavioural emergence and early prediction of the neurodevelopmental outcome. A recent example of this strategy is a study by Ouyang et al. (2020) which suggested that cortical microstructure quantified by diffusion MRI through fractional anisotropy (FA) metric in preterm and full-term neonates can lead to effective prediction of language and cognitive outcomes at 2 years of corrected age as assessed by Bayley Scales of Infant and Toddler Development, Third Edition (BSID-III) composite scores. Given the important need for robust and generalisable tools which can reliably predict the neurodevelopmental outcome of preterm infants, we aimed to replicate the conclusions of this work using a larger independent dataset from the developing Human Connectome Project dataset (dHCP, third release) with early MRI and BSID-III evaluation at 18 months of corrected age. We then aimed to extend the validation of the proposed predictive pipeline through the study of different cohorts (the largest one included 295 neonates, with gestational age between 29 and 42 week and post-menstrual age at MRI between 31 and 45 weeks). This allowed us to evaluate whether some limitations of the original study (mainly small sample size and limited variability in the input and output features used in the predictive models) would influence the prediction results. In contrast to the original study that inspired the current work, our prediction results did not outcompete the random levels. Furthermore, these negative results persisted even when the study settings were expanded. Our findings suggest that the cortical microstructure close to birth described by DTI-FA measures might not be sufficient for a reliable prediction of BSID-III scores during toddlerhood, at least in the current setting, i.e. generally older cohorts and a different processing pipeline. Our inability to conceptually replicate the results of the original study is in line with the previously reported replicability issues within the machine learning field and demonstrates the challenges in defining the good set of practices for the implementation and validation of reliable predictive tools in the neurodevelopmental (and other) fields. |
| format | Article |
| id | doaj-art-7fd2cd6584e24e1faa3552d9729b3659 |
| institution | DOAJ |
| issn | 2666-9560 |
| language | English |
| publishDate | 2023-06-01 |
| publisher | Elsevier |
| record_format | Article |
| series | NeuroImage: Reports |
| spelling | doaj-art-7fd2cd6584e24e1faa3552d9729b36592025-08-20T03:06:44ZengElsevierNeuroImage: Reports2666-95602023-06-013210017010.1016/j.ynirp.2023.100170Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication studyAndrea Gondová0Sara Neumane1Yann Leprince2Jean-François Mangin3Tomoki Arichi4Jessica Dubois5Université Paris Cité, Inserm, NeuroDiderot, F-75019, Paris, France; Université Paris-Saclay, CEA, NeuroSpin UNIACT, F-91191, Gif-sur-Yvette, France; Corresponding author. Université Paris Cité, Inserm, NeuroDiderot, F-75019, Paris, France.Université Paris Cité, Inserm, NeuroDiderot, F-75019, Paris, France; Université Paris-Saclay, CEA, NeuroSpin UNIACT, F-91191, Gif-sur-Yvette, France; Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, SE1 7EH, United KingdomUniversité Paris-Saclay, CEA, NeuroSpin UNIACT, F-91191, Gif-sur-Yvette, FranceUniversité Paris-Saclay, CEA, CNRS, NeuroSpin, BAOBAB, Gif-sur-Yvette, FranceCentre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, SE1 7EH, United Kingdom; Paediatric Neurosciences, Evelina London Children's Hospital, Guy's and St Thomas' NHS Foundation Trust, London, SE1 7EH, United KingdomUniversité Paris Cité, Inserm, NeuroDiderot, F-75019, Paris, France; Université Paris-Saclay, CEA, NeuroSpin UNIACT, F-91191, Gif-sur-Yvette, FranceMachine learning combined with large-scale neuroimaging databases has been proposed as a promising tool for improving our understanding of the behavioural emergence and early prediction of the neurodevelopmental outcome. A recent example of this strategy is a study by Ouyang et al. (2020) which suggested that cortical microstructure quantified by diffusion MRI through fractional anisotropy (FA) metric in preterm and full-term neonates can lead to effective prediction of language and cognitive outcomes at 2 years of corrected age as assessed by Bayley Scales of Infant and Toddler Development, Third Edition (BSID-III) composite scores. Given the important need for robust and generalisable tools which can reliably predict the neurodevelopmental outcome of preterm infants, we aimed to replicate the conclusions of this work using a larger independent dataset from the developing Human Connectome Project dataset (dHCP, third release) with early MRI and BSID-III evaluation at 18 months of corrected age. We then aimed to extend the validation of the proposed predictive pipeline through the study of different cohorts (the largest one included 295 neonates, with gestational age between 29 and 42 week and post-menstrual age at MRI between 31 and 45 weeks). This allowed us to evaluate whether some limitations of the original study (mainly small sample size and limited variability in the input and output features used in the predictive models) would influence the prediction results. In contrast to the original study that inspired the current work, our prediction results did not outcompete the random levels. Furthermore, these negative results persisted even when the study settings were expanded. Our findings suggest that the cortical microstructure close to birth described by DTI-FA measures might not be sufficient for a reliable prediction of BSID-III scores during toddlerhood, at least in the current setting, i.e. generally older cohorts and a different processing pipeline. Our inability to conceptually replicate the results of the original study is in line with the previously reported replicability issues within the machine learning field and demonstrates the challenges in defining the good set of practices for the implementation and validation of reliable predictive tools in the neurodevelopmental (and other) fields.http://www.sciencedirect.com/science/article/pii/S2666956023000156Brain developmentNeonatesPrematurityDTI (Diffusion tensor imaging)ML (machine learning)Prediction |
| spellingShingle | Andrea Gondová Sara Neumane Yann Leprince Jean-François Mangin Tomoki Arichi Jessica Dubois Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication study NeuroImage: Reports Brain development Neonates Prematurity DTI (Diffusion tensor imaging) ML (machine learning) Prediction |
| title | Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication study |
| title_full | Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication study |
| title_fullStr | Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication study |
| title_full_unstemmed | Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication study |
| title_short | Predicting neurodevelopmental outcomes from neonatal cortical microstructure: A conceptual replication study |
| title_sort | predicting neurodevelopmental outcomes from neonatal cortical microstructure a conceptual replication study |
| topic | Brain development Neonates Prematurity DTI (Diffusion tensor imaging) ML (machine learning) Prediction |
| url | http://www.sciencedirect.com/science/article/pii/S2666956023000156 |
| work_keys_str_mv | AT andreagondova predictingneurodevelopmentaloutcomesfromneonatalcorticalmicrostructureaconceptualreplicationstudy AT saraneumane predictingneurodevelopmentaloutcomesfromneonatalcorticalmicrostructureaconceptualreplicationstudy AT yannleprince predictingneurodevelopmentaloutcomesfromneonatalcorticalmicrostructureaconceptualreplicationstudy AT jeanfrancoismangin predictingneurodevelopmentaloutcomesfromneonatalcorticalmicrostructureaconceptualreplicationstudy AT tomokiarichi predictingneurodevelopmentaloutcomesfromneonatalcorticalmicrostructureaconceptualreplicationstudy AT jessicadubois predictingneurodevelopmentaloutcomesfromneonatalcorticalmicrostructureaconceptualreplicationstudy |