Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRI
Glioma survival risk prediction is of great significance for the individualized treatment and assessment programs. Currently, most deep learning based survival prediction paradigms rely on invasive and expensive histopathology and genomics methods. However, magnetic resonance imaging (MRI) has emerg...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Tsinghua University Press
2025-04-01
|
| Series: | Big Data Mining and Analytics |
| Subjects: | |
| Online Access: | https://www.sciopen.com/article/10.26599/BDMA.2024.9020083 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850228508724297728 |
|---|---|
| author | Jianhong Cheng Hulin Kuang Songhan Yang Hailin Yue Jin Liu Jianxin Wang |
| author_facet | Jianhong Cheng Hulin Kuang Songhan Yang Hailin Yue Jin Liu Jianxin Wang |
| author_sort | Jianhong Cheng |
| collection | DOAJ |
| description | Glioma survival risk prediction is of great significance for the individualized treatment and assessment programs. Currently, most deep learning based survival prediction paradigms rely on invasive and expensive histopathology and genomics methods. However, magnetic resonance imaging (MRI) has emerged as a promising non-invasive alternative with significant prognostic potential. To leverage the benefits of MRI, we propose a segmentation-guided fully automated multimodal MRI-based survival network (SGS-Net), which can simultaneously perform glioma segmentation and survival risk prediction. Specifically, the task interrelation is addressed using a hybrid convolutional neural network-Transformer (CNN-Transformer) encoder to represent the shared high-level semantic features by co-training a decoder for glioma segmentation and a Cox model for survival prediction. Then, to ensure the effective representation of the high-level features, glioma segmentation as an auxiliary task is utilized to guide survival prediction by jointly optimizing the segmentation loss and the Cox partial log-likelihood loss. Furthermore, a pair-wise ranking loss is designed to allow the network to learn the survival difference between patients. To balance the multi-task losses, an uncertain weight manner is adopted to adaptively adjust the weights for preventing task bias. Finally, the proposed SGS-Net is assessed using a publicly available multi-institutional dataset. Experimental and visual results show that SGS-Net achieves promising segmentation performance and obtains a C-index of 81.07% for survival risk prediction, which outperforms several existing state-of-the-art methods and even histopathology-based methods. In addition, Kaplan-Meier survival analysis confirms that the prognosis risk generated by SGS-Net is consistent with the prior prognosis based on the grading or genotyping paradigms. |
| format | Article |
| id | doaj-art-d89daa1ee01a4e9bbf63c5db4ccfae6e |
| institution | OA Journals |
| issn | 2096-0654 2097-406X |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Tsinghua University Press |
| record_format | Article |
| series | Big Data Mining and Analytics |
| spelling | doaj-art-d89daa1ee01a4e9bbf63c5db4ccfae6e2025-08-20T02:04:30ZengTsinghua University PressBig Data Mining and Analytics2096-06542097-406X2025-04-018236438210.26599/BDMA.2024.9020083Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRIJianhong Cheng0Hulin Kuang1Songhan Yang2Hailin Yue3Jin Liu4Jianxin Wang5Institute of Guizhou Aerospace Measuring and Testing Technology, Guiyang 550009, ChinaHunan Provincial Key Laboratory on Bioinformatics, School of Computer Science and Engineering, Central South University, Changsha 410083, ChinaInstitute of Guizhou Aerospace Measuring and Testing Technology, Guiyang 550009, ChinaHunan Provincial Key Laboratory on Bioinformatics, School of Computer Science and Engineering, Central South University, Changsha 410083, ChinaHunan Provincial Key Laboratory on Bioinformatics, School of Computer Science and Engineering, Central South University, Changsha 410083, ChinaHunan Provincial Key Laboratory on Bioinformatics, School of Computer Science and Engineering, Central South University, Changsha 410083, ChinaGlioma survival risk prediction is of great significance for the individualized treatment and assessment programs. Currently, most deep learning based survival prediction paradigms rely on invasive and expensive histopathology and genomics methods. However, magnetic resonance imaging (MRI) has emerged as a promising non-invasive alternative with significant prognostic potential. To leverage the benefits of MRI, we propose a segmentation-guided fully automated multimodal MRI-based survival network (SGS-Net), which can simultaneously perform glioma segmentation and survival risk prediction. Specifically, the task interrelation is addressed using a hybrid convolutional neural network-Transformer (CNN-Transformer) encoder to represent the shared high-level semantic features by co-training a decoder for glioma segmentation and a Cox model for survival prediction. Then, to ensure the effective representation of the high-level features, glioma segmentation as an auxiliary task is utilized to guide survival prediction by jointly optimizing the segmentation loss and the Cox partial log-likelihood loss. Furthermore, a pair-wise ranking loss is designed to allow the network to learn the survival difference between patients. To balance the multi-task losses, an uncertain weight manner is adopted to adaptively adjust the weights for preventing task bias. Finally, the proposed SGS-Net is assessed using a publicly available multi-institutional dataset. Experimental and visual results show that SGS-Net achieves promising segmentation performance and obtains a C-index of 81.07% for survival risk prediction, which outperforms several existing state-of-the-art methods and even histopathology-based methods. In addition, Kaplan-Meier survival analysis confirms that the prognosis risk generated by SGS-Net is consistent with the prior prognosis based on the grading or genotyping paradigms.https://www.sciopen.com/article/10.26599/BDMA.2024.9020083deep learningglioma segmentationsurvival riskmultimodal magnetic resonance imaging (mri) |
| spellingShingle | Jianhong Cheng Hulin Kuang Songhan Yang Hailin Yue Jin Liu Jianxin Wang Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRI Big Data Mining and Analytics deep learning glioma segmentation survival risk multimodal magnetic resonance imaging (mri) |
| title | Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRI |
| title_full | Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRI |
| title_fullStr | Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRI |
| title_full_unstemmed | Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRI |
| title_short | Segmentation-Guided Deep Learning for Glioma Survival Risk Prediction with Multimodal MRI |
| title_sort | segmentation guided deep learning for glioma survival risk prediction with multimodal mri |
| topic | deep learning glioma segmentation survival risk multimodal magnetic resonance imaging (mri) |
| url | https://www.sciopen.com/article/10.26599/BDMA.2024.9020083 |
| work_keys_str_mv | AT jianhongcheng segmentationguideddeeplearningforgliomasurvivalriskpredictionwithmultimodalmri AT hulinkuang segmentationguideddeeplearningforgliomasurvivalriskpredictionwithmultimodalmri AT songhanyang segmentationguideddeeplearningforgliomasurvivalriskpredictionwithmultimodalmri AT hailinyue segmentationguideddeeplearningforgliomasurvivalriskpredictionwithmultimodalmri AT jinliu segmentationguideddeeplearningforgliomasurvivalriskpredictionwithmultimodalmri AT jianxinwang segmentationguideddeeplearningforgliomasurvivalriskpredictionwithmultimodalmri |