Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labels
Urban mesh data comprises large-scale textured meshes representing outdoor urban environments. Semantic segmentation of urban meshes is becoming increasingly important in urban analysis. However, many existing studies predominantly employ fully supervised methods, which typically require substantial...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-08-01
|
| Series: | International Journal of Applied Earth Observations and Geoinformation |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1569843225003218 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849240742626590720 |
|---|---|
| author | Wenjie Zi Jun Li Hao Chen Qingren Jia |
| author_facet | Wenjie Zi Jun Li Hao Chen Qingren Jia |
| author_sort | Wenjie Zi |
| collection | DOAJ |
| description | Urban mesh data comprises large-scale textured meshes representing outdoor urban environments. Semantic segmentation of urban meshes is becoming increasingly important in urban analysis. However, many existing studies predominantly employ fully supervised methods, which typically require substantial facet-level annotations that are challenging to acquire in practice. To address this issue, we propose a novel semi-supervised learning approach, Semi-MeshSeg, to tackle the problem of insufficiently labeled data. Urban meshes are irregular and susceptible to distortion, leading to blurred boundaries and surface features. To solve this challenge, we introduce a novel semi-supervised method for 3D mesh semantic segmentation, capable of leveraging all pseudo-labels, rather than relying solely on a small subset of high-confidence ones, to more effectively capture the inherent variability and irregularity of urban meshes. Given that pseudo-labels, particularly low-confidence ones, often contain substantial noise, we design dual-stream perturbation branches, a noise reduction loss, and a distribution alignment loss to mitigate this noise. The dual-stream perturbation branches enhance the semantic segmentation performance of the model by exploring extensive three-dimensional (3D) perturbation spaces, while the noise reduction loss and distribution alignment loss are designed to enhance the quality of noisy pseudo-labels. Compared to state-of-the-art (SOTA) methods, our approach achieves superior performance with only one tile of labeled data, improving mIoU by at least 3.0% on the SUM dataset and 4.5% on the seMet dataset, demonstrating its effectiveness under limited labeled data conditions. |
| format | Article |
| id | doaj-art-91156a2f1b6a42fba573b5fa466b3b3e |
| institution | Kabale University |
| issn | 1569-8432 |
| language | English |
| publishDate | 2025-08-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Journal of Applied Earth Observations and Geoinformation |
| spelling | doaj-art-91156a2f1b6a42fba573b5fa466b3b3e2025-08-20T04:00:27ZengElsevierInternational Journal of Applied Earth Observations and Geoinformation1569-84322025-08-0114210467410.1016/j.jag.2025.104674Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labelsWenjie Zi0Jun Li1Hao Chen2Qingren Jia3College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, Hunan, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, Hunan, ChinaCorresponding author.; College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, Hunan, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, Hunan, ChinaUrban mesh data comprises large-scale textured meshes representing outdoor urban environments. Semantic segmentation of urban meshes is becoming increasingly important in urban analysis. However, many existing studies predominantly employ fully supervised methods, which typically require substantial facet-level annotations that are challenging to acquire in practice. To address this issue, we propose a novel semi-supervised learning approach, Semi-MeshSeg, to tackle the problem of insufficiently labeled data. Urban meshes are irregular and susceptible to distortion, leading to blurred boundaries and surface features. To solve this challenge, we introduce a novel semi-supervised method for 3D mesh semantic segmentation, capable of leveraging all pseudo-labels, rather than relying solely on a small subset of high-confidence ones, to more effectively capture the inherent variability and irregularity of urban meshes. Given that pseudo-labels, particularly low-confidence ones, often contain substantial noise, we design dual-stream perturbation branches, a noise reduction loss, and a distribution alignment loss to mitigate this noise. The dual-stream perturbation branches enhance the semantic segmentation performance of the model by exploring extensive three-dimensional (3D) perturbation spaces, while the noise reduction loss and distribution alignment loss are designed to enhance the quality of noisy pseudo-labels. Compared to state-of-the-art (SOTA) methods, our approach achieves superior performance with only one tile of labeled data, improving mIoU by at least 3.0% on the SUM dataset and 4.5% on the seMet dataset, demonstrating its effectiveness under limited labeled data conditions.http://www.sciencedirect.com/science/article/pii/S15698432250032183D urban meshesSemantic segmentationAll pseudo-labelsNoise reduction lossDistribution alignment loss |
| spellingShingle | Wenjie Zi Jun Li Hao Chen Qingren Jia Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labels International Journal of Applied Earth Observations and Geoinformation 3D urban meshes Semantic segmentation All pseudo-labels Noise reduction loss Distribution alignment loss |
| title | Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labels |
| title_full | Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labels |
| title_fullStr | Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labels |
| title_full_unstemmed | Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labels |
| title_short | Semi-MeshSeg: A semi-supervised semantic segmentation network for large-scale urban textured meshes using all pseudo-labels |
| title_sort | semi meshseg a semi supervised semantic segmentation network for large scale urban textured meshes using all pseudo labels |
| topic | 3D urban meshes Semantic segmentation All pseudo-labels Noise reduction loss Distribution alignment loss |
| url | http://www.sciencedirect.com/science/article/pii/S1569843225003218 |
| work_keys_str_mv | AT wenjiezi semimeshsegasemisupervisedsemanticsegmentationnetworkforlargescaleurbantexturedmeshesusingallpseudolabels AT junli semimeshsegasemisupervisedsemanticsegmentationnetworkforlargescaleurbantexturedmeshesusingallpseudolabels AT haochen semimeshsegasemisupervisedsemanticsegmentationnetworkforlargescaleurbantexturedmeshesusingallpseudolabels AT qingrenjia semimeshsegasemisupervisedsemanticsegmentationnetworkforlargescaleurbantexturedmeshesusingallpseudolabels |