Interactive Maintenance of Space Station Devices Using Scene Semantic Segmentation

A novel interactive maintenance method for space station in-orbit devices using scene semantic segmentation technology is proposed. First, a wearable and handheld system is designed to capture images from the astronaut in the space station’s front view scene and play these images on a handheld termi...

Full description

Saved in:
Bibliographic Details
Main Authors: Haoting Liu, Chuanxin Liao, Xikang Li, Zhen Tian, Mengmeng Wang, Haiguang Li, Xiaofei Lu, Zhenhui Guo, Qing Li
Format: Article
Language:English
Published: MDPI AG 2025-06-01
Series:Aerospace
Subjects:
Online Access:https://www.mdpi.com/2226-4310/12/6/542
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A novel interactive maintenance method for space station in-orbit devices using scene semantic segmentation technology is proposed. First, a wearable and handheld system is designed to capture images from the astronaut in the space station’s front view scene and play these images on a handheld terminal in real-time. Second, the proposed system quantitatively evaluates the environmental lighting condition in the scene by calculating image quality evaluation parameters. If the lighting condition is not proper, a prompt message will be given to the astronaut to remind him or her to adjust the environment illumination. Third, our system adopts an improved DeepLabV3+ network for semantic segmentation of these astronauts’ forward view scene images. Regarding the improved network, the original backbone network is replaced with a lightweight convolutional neural network, i.e., the MobileNetV2, with a smaller model scale and computational complexity. The convolutional block attention module (CBAM) is introduced to improve the network’s feature perception ability. The atrous spatial pyramid pooling (ASPP) module is also considered to enable an accurate calculation of encoding multi-scale information. Extensive simulation experiment results indicate that the accuracy, precision, and average intersection over the union of the proposed algorithm can be better than 95.0%, 96.0%, and 89.0%, respectively. And the ground application experiments have also shown that our proposed technique can effectively shorten the working time of the system user.
ISSN:2226-4310