Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice

Objective·To construct a cervical vertebra image segmentation model by using a diffusion model with the Transformer deep learning algorithm, and evaluate its segmentation performance, to address the clinical challenge of accurately assessing complex changes in skeletal morphology during the growth a...

Full description

Saved in:
Bibliographic Details
Main Authors: LIU Yang, WU Mengyi, HU Yao, QI Kun, WANG Yubin, ZHAO Yue, SONG Jinlin
Format: Article
Language:zho
Published: Editorial Office of Journal of Shanghai Jiao Tong University (Medical Science) 2024-12-01
Series:Shanghai Jiaotong Daxue xuebao. Yixue ban
Subjects:
Online Access:https://xuebao.shsmu.edu.cn/article/2024/1674-8115/1674-8115-2024-44-12-1579.shtml
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841555257024315392
author LIU Yang
WU Mengyi
HU Yao
QI Kun
WANG Yubin
ZHAO Yue
SONG Jinlin
author_facet LIU Yang
WU Mengyi
HU Yao
QI Kun
WANG Yubin
ZHAO Yue
SONG Jinlin
author_sort LIU Yang
collection DOAJ
description Objective·To construct a cervical vertebra image segmentation model by using a diffusion model with the Transformer deep learning algorithm, and evaluate its segmentation performance, to address the clinical challenge of accurately assessing complex changes in skeletal morphology during the growth and developmental peaks of malocclusion.Methods·Accurate cervical vertebra segmentation was performed on cephalometric radiographs from 185 orthodontic patients (44 cases from the Stomatological Hospital of Chongqing Medical University and 141 cases from the Stomatological Hospital of Xi'an Jiaotong University) by using a method combining Transformer and diffusion models. First, the images were preprocessed to crop out the cervical vertebra region of interest, and all data were randomly divided into a training set (79.6%) and a test set (20.4%). The diffusion model and a conditional model based on U-Net were utilized for feature extraction, with a Transformer module introduced to learn the interaction between noise and semantic features. Multi-scale images were fused to enhance fine structure and boundary texture features in low-contrast images. The proposed method was compared with U-Net and SOLOv2 methods. The segmentation performance was quantitatively evaluated by two metrics, Dice Similarity Coefficient (DSC) and Intersection over Union (IoU), and also qualitatively assessed through physicians' manual annotations and model visualization results.Results·The cervical vertebra segmentation method based on Transformer and diffusion models achieved DSC and IoU scores of 93.3% and 87.5%, respectively, significantly outperforming the U-Net and SOLOv2 methods (with improvements of 3.0% and 4.1% in DSC, and 5.2% and 7.1% in loU, respectively). Despite the longer processing time for a single image, segmentation accuracy was significantly improved. Compared with U-Net and SOLOv2, the proposed method also showed higher stability and robustness in processing complex, low-contrast and blurred-boundary images, and was able to accurately segment the cervical vertebrae with clear boundaries and complete structures.Conclusion·The Transformer-based diffusion model for cervical vertebra segmentation can enhance the edge and texture features in cervical vertebra images and recognize the boundaries of different vertebrae more easily. Thus, automatic, accurate, and robust cervical vertebra segmentation results are achieved, which can assist in cervical vertebral maturation analysis.
format Article
id doaj-art-a5af0ec93d024ef48bcab990cc3c8620
institution Kabale University
issn 1674-8115
language zho
publishDate 2024-12-01
publisher Editorial Office of Journal of Shanghai Jiao Tong University (Medical Science)
record_format Article
series Shanghai Jiaotong Daxue xuebao. Yixue ban
spelling doaj-art-a5af0ec93d024ef48bcab990cc3c86202025-01-08T05:52:54ZzhoEditorial Office of Journal of Shanghai Jiao Tong University (Medical Science)Shanghai Jiaotong Daxue xuebao. Yixue ban1674-81152024-12-0144121579158610.3969/j.issn.1674-8115.2024.12.0111674-8115(2024)12-1579-08Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practiceLIU Yang0WU Mengyi1HU Yao2QI Kun3WANG Yubin4ZHAO Yue5SONG Jinlin6Department of Orthodontics, Stomatological Hospital of Chongqing Medical University, Chongqing401147, ChinaSchool of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing400065, ChinaSchool of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing400065, ChinaDepartment of Orthodontics, Stomatological Hospital of Xi'an Jiaotong University, Xi'an710004, ChinaSchool of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing400065, ChinaSchool of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing400065, ChinaDepartment of Orthodontics, Stomatological Hospital of Chongqing Medical University, Chongqing401147, ChinaObjective·To construct a cervical vertebra image segmentation model by using a diffusion model with the Transformer deep learning algorithm, and evaluate its segmentation performance, to address the clinical challenge of accurately assessing complex changes in skeletal morphology during the growth and developmental peaks of malocclusion.Methods·Accurate cervical vertebra segmentation was performed on cephalometric radiographs from 185 orthodontic patients (44 cases from the Stomatological Hospital of Chongqing Medical University and 141 cases from the Stomatological Hospital of Xi'an Jiaotong University) by using a method combining Transformer and diffusion models. First, the images were preprocessed to crop out the cervical vertebra region of interest, and all data were randomly divided into a training set (79.6%) and a test set (20.4%). The diffusion model and a conditional model based on U-Net were utilized for feature extraction, with a Transformer module introduced to learn the interaction between noise and semantic features. Multi-scale images were fused to enhance fine structure and boundary texture features in low-contrast images. The proposed method was compared with U-Net and SOLOv2 methods. The segmentation performance was quantitatively evaluated by two metrics, Dice Similarity Coefficient (DSC) and Intersection over Union (IoU), and also qualitatively assessed through physicians' manual annotations and model visualization results.Results·The cervical vertebra segmentation method based on Transformer and diffusion models achieved DSC and IoU scores of 93.3% and 87.5%, respectively, significantly outperforming the U-Net and SOLOv2 methods (with improvements of 3.0% and 4.1% in DSC, and 5.2% and 7.1% in loU, respectively). Despite the longer processing time for a single image, segmentation accuracy was significantly improved. Compared with U-Net and SOLOv2, the proposed method also showed higher stability and robustness in processing complex, low-contrast and blurred-boundary images, and was able to accurately segment the cervical vertebrae with clear boundaries and complete structures.Conclusion·The Transformer-based diffusion model for cervical vertebra segmentation can enhance the edge and texture features in cervical vertebra images and recognize the boundaries of different vertebrae more easily. Thus, automatic, accurate, and robust cervical vertebra segmentation results are achieved, which can assist in cervical vertebral maturation analysis.https://xuebao.shsmu.edu.cn/article/2024/1674-8115/1674-8115-2024-44-12-1579.shtmldiffusion modelcervical vertebra segmentationdeep learninglateral cephalometric radiograph
spellingShingle LIU Yang
WU Mengyi
HU Yao
QI Kun
WANG Yubin
ZHAO Yue
SONG Jinlin
Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice
Shanghai Jiaotong Daxue xuebao. Yixue ban
diffusion model
cervical vertebra segmentation
deep learning
lateral cephalometric radiograph
title Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice
title_full Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice
title_fullStr Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice
title_full_unstemmed Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice
title_short Preliminary application of a cervical vertebra segmentation method based on Transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice
title_sort preliminary application of a cervical vertebra segmentation method based on transformer and diffusion model for lateral cephalometric radiographs in orthodontic clinical practice
topic diffusion model
cervical vertebra segmentation
deep learning
lateral cephalometric radiograph
url https://xuebao.shsmu.edu.cn/article/2024/1674-8115/1674-8115-2024-44-12-1579.shtml
work_keys_str_mv AT liuyang preliminaryapplicationofacervicalvertebrasegmentationmethodbasedontransformeranddiffusionmodelforlateralcephalometricradiographsinorthodonticclinicalpractice
AT wumengyi preliminaryapplicationofacervicalvertebrasegmentationmethodbasedontransformeranddiffusionmodelforlateralcephalometricradiographsinorthodonticclinicalpractice
AT huyao preliminaryapplicationofacervicalvertebrasegmentationmethodbasedontransformeranddiffusionmodelforlateralcephalometricradiographsinorthodonticclinicalpractice
AT qikun preliminaryapplicationofacervicalvertebrasegmentationmethodbasedontransformeranddiffusionmodelforlateralcephalometricradiographsinorthodonticclinicalpractice
AT wangyubin preliminaryapplicationofacervicalvertebrasegmentationmethodbasedontransformeranddiffusionmodelforlateralcephalometricradiographsinorthodonticclinicalpractice
AT zhaoyue preliminaryapplicationofacervicalvertebrasegmentationmethodbasedontransformeranddiffusionmodelforlateralcephalometricradiographsinorthodonticclinicalpractice
AT songjinlin preliminaryapplicationofacervicalvertebrasegmentationmethodbasedontransformeranddiffusionmodelforlateralcephalometricradiographsinorthodonticclinicalpractice