Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale.
Spontaneous preterm birth (sPTB) remains a significant global health challenge and a leading cause of neonatal mortality and morbidity. Despite advancements in neonatal care, the prediction of sPTB remains elusive, in part due to complex etiologies and heterogeneous patient populations. This study a...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0310937 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849427399935000576 |
|---|---|
| author | Kylie K Hornaday Ty Werbicki Suzanne C Tough Stephen L Wood David W Anderson Constance H Li Donna M Slater |
| author_facet | Kylie K Hornaday Ty Werbicki Suzanne C Tough Stephen L Wood David W Anderson Constance H Li Donna M Slater |
| author_sort | Kylie K Hornaday |
| collection | DOAJ |
| description | Spontaneous preterm birth (sPTB) remains a significant global health challenge and a leading cause of neonatal mortality and morbidity. Despite advancements in neonatal care, the prediction of sPTB remains elusive, in part due to complex etiologies and heterogeneous patient populations. This study aimed to validate and extend information on gene expression biomarkers previously described for predicting sPTB using maternal whole blood from the All Our Families pregnancy cohort study based in Calgary, Canada. The results of this study are two-fold: first, using additional replicates of maternal blood samples from the All Our Families cohort, we were unable to repeat the findings of a 2016 study which identified top maternal gene expression predictors for sPTB. Second, we conducted a secondary analysis of the original gene expression dataset from the 2016 study using five modelling approaches (random forest, elastic net regression, unregularized logistic regression, L2-regularized logistic regression, and multilayer perceptron neural network) followed by external validation using a pregnancy cohort based in Detroit, USA. The top performing model (random forest classification) suggested promising performance (area under the receiver operating curve, AUROC 0.99 in the training set), but performance was significantly degraded on the test set (AUROC 0.54) and further degraded in external validation (AUROC 0.50), suggesting poor generalizability, likely due to overfitting exacerbated by a low feature-to-noise ratio. Similar performance was observed in the other four learning models. Prediction was not improved when using higher complexity machine learning (e.g., neural network) approaches over traditional statistical learning (e.g., logistic regression). These findings underscore the challenges in translating biomarker discovery into clinically useful predictive models for sPTB. This study highlights the critical need for rigorous methodological safeguards and external validation in biomarker research. It also emphasizes the impact of data noise and overfitting on model performance, particularly in high-dimensional omics datasets. Future research should prioritize robust validation strategies and explore mechanistic insights to improve our understanding and prediction of sPTB. |
| format | Article |
| id | doaj-art-5f43da2dc83b4bc78aed2407d72e5bd1 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-5f43da2dc83b4bc78aed2407d72e5bd12025-08-20T03:29:03ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01206e031093710.1371/journal.pone.0310937Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale.Kylie K HornadayTy WerbickiSuzanne C ToughStephen L WoodDavid W AndersonConstance H LiDonna M SlaterSpontaneous preterm birth (sPTB) remains a significant global health challenge and a leading cause of neonatal mortality and morbidity. Despite advancements in neonatal care, the prediction of sPTB remains elusive, in part due to complex etiologies and heterogeneous patient populations. This study aimed to validate and extend information on gene expression biomarkers previously described for predicting sPTB using maternal whole blood from the All Our Families pregnancy cohort study based in Calgary, Canada. The results of this study are two-fold: first, using additional replicates of maternal blood samples from the All Our Families cohort, we were unable to repeat the findings of a 2016 study which identified top maternal gene expression predictors for sPTB. Second, we conducted a secondary analysis of the original gene expression dataset from the 2016 study using five modelling approaches (random forest, elastic net regression, unregularized logistic regression, L2-regularized logistic regression, and multilayer perceptron neural network) followed by external validation using a pregnancy cohort based in Detroit, USA. The top performing model (random forest classification) suggested promising performance (area under the receiver operating curve, AUROC 0.99 in the training set), but performance was significantly degraded on the test set (AUROC 0.54) and further degraded in external validation (AUROC 0.50), suggesting poor generalizability, likely due to overfitting exacerbated by a low feature-to-noise ratio. Similar performance was observed in the other four learning models. Prediction was not improved when using higher complexity machine learning (e.g., neural network) approaches over traditional statistical learning (e.g., logistic regression). These findings underscore the challenges in translating biomarker discovery into clinically useful predictive models for sPTB. This study highlights the critical need for rigorous methodological safeguards and external validation in biomarker research. It also emphasizes the impact of data noise and overfitting on model performance, particularly in high-dimensional omics datasets. Future research should prioritize robust validation strategies and explore mechanistic insights to improve our understanding and prediction of sPTB.https://doi.org/10.1371/journal.pone.0310937 |
| spellingShingle | Kylie K Hornaday Ty Werbicki Suzanne C Tough Stephen L Wood David W Anderson Constance H Li Donna M Slater Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale. PLoS ONE |
| title | Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale. |
| title_full | Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale. |
| title_fullStr | Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale. |
| title_full_unstemmed | Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale. |
| title_short | Machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression: A cautionary tale. |
| title_sort | machine learning for the prediction of spontaneous preterm birth using early second and third trimester maternal blood gene expression a cautionary tale |
| url | https://doi.org/10.1371/journal.pone.0310937 |
| work_keys_str_mv | AT kyliekhornaday machinelearningforthepredictionofspontaneouspretermbirthusingearlysecondandthirdtrimestermaternalbloodgeneexpressionacautionarytale AT tywerbicki machinelearningforthepredictionofspontaneouspretermbirthusingearlysecondandthirdtrimestermaternalbloodgeneexpressionacautionarytale AT suzannectough machinelearningforthepredictionofspontaneouspretermbirthusingearlysecondandthirdtrimestermaternalbloodgeneexpressionacautionarytale AT stephenlwood machinelearningforthepredictionofspontaneouspretermbirthusingearlysecondandthirdtrimestermaternalbloodgeneexpressionacautionarytale AT davidwanderson machinelearningforthepredictionofspontaneouspretermbirthusingearlysecondandthirdtrimestermaternalbloodgeneexpressionacautionarytale AT constancehli machinelearningforthepredictionofspontaneouspretermbirthusingearlysecondandthirdtrimestermaternalbloodgeneexpressionacautionarytale AT donnamslater machinelearningforthepredictionofspontaneouspretermbirthusingearlysecondandthirdtrimestermaternalbloodgeneexpressionacautionarytale |