A Real-Time Road Scene Semantic Segmentation Model Based on Spatial Context Learning

A Real-Time Road Scene Semantic Segmentation Model Based on Spatial Context Learning

To address the issues of high computational complexity and insufficient aggregation of global and local information in existing image segmentation methods, this paper proposes an efficient segmentation model based on Spatial Context Learning, named SCLSeg. The main idea is to aggregate local regions...

Full description

Saved in:
Bibliographic Details
Main Authors: Xiaomei Xiao, Jialiang Tang, Xiaoyan Lu, Zhengyong Feng, Yi Li
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Real-time semantic segmentation
spatial context guidance
feature attention
feature alignment
Online Access:https://ieeexplore.ieee.org/document/10759633/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:To address the issues of high computational complexity and insufficient aggregation of global and local information in existing image segmentation methods, this paper proposes an efficient segmentation model based on Spatial Context Learning, named SCLSeg. The main idea is to aggregate local regions into higher-level semantic regions in a learnable manner. The proposed Spatial Context Guided Feature Alignment module (SC-FA) learns aligned features from image-level to local regions, exploring and integrating contextual information. During training, a multi-scale strategy is used to group semantic regions, and a Channel Aggregation Block (CAB) is designed to dynamically capture semantic groups through a mechanism of feature separation and fusion, thereby aggregating multi-level pixel features to generate the final segmentation results. We further introduce a boundary loss to optimize the accuracy of segmentation edges. To meet real-time processing requirements, a series of lightweight strategies and simplified structures are adopted to reduce computational costs, including lightweight encoding, channel compression, and simplified neck. Our method achieves good performance on the Cityscapes and Camvid datasets, specifically achieving 76.45% mIoU & 237 FPS on the Cityscapes test set, and 73.95% mIoU & 300.4 FPS on the CamVid test set.
ISSN:2169-3536

Similar Items