Optimized segmentation of overlapping cervical cells based on Mask2Former and denoising
Abstract Cell instances segmentation in cervical cytology images have crucial importance for cancer screening and automatic biomedical image analysis. However, that the highly overlapping cells cause ambiguous boundaries makes accurate cell segmentation still a challenging task. This paper proposes...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-05-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-025-02379-z |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Abstract Cell instances segmentation in cervical cytology images have crucial importance for cancer screening and automatic biomedical image analysis. However, that the highly overlapping cells cause ambiguous boundaries makes accurate cell segmentation still a challenging task. This paper proposes a novel transformer-based neural network to segment overlapping cervical cells, by using the technique of denoising with Mask2Former. The model optimization includes two aspects. One is that class embeddings of ground truth categories are used as extra content queries to transformer decoder. The other is that noised ground truth masks are fed into each layer of transformer decoder and then the model is trained to reconstruct the original masks. Compared with the best result on ISBI2014 dataset, the proposed model obtains performance improvement by $$3.4\%$$ on DSC, $$2.3\%$$ on TPRp and $$2\%$$ on FNRo, respectively. Especially, the masks predicted by our model are more precise than other methods and our previous models. Those results show that the proposed method could be effective in segmenting overlapping cells and help pathologists detect cell lesions. |
|---|---|
| ISSN: | 2045-2322 |