ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian Environments
This paper proposes a digital twin platform for Mars environment based on NVIDIA Isaac Sim to create a unique random environment with multi-scale fine-grained terrain features through programmed terrain generation and asset management. The SiaT-Hough module was added to the ORB-SLAM2 system for Mars...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11071669/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849713622459088896 |
|---|---|
| author | Wei Liu Gang Wan Jia Liu Dianwei Cong |
| author_facet | Wei Liu Gang Wan Jia Liu Dianwei Cong |
| author_sort | Wei Liu |
| collection | DOAJ |
| description | This paper proposes a digital twin platform for Mars environment based on NVIDIA Isaac Sim to create a unique random environment with multi-scale fine-grained terrain features through programmed terrain generation and asset management. The SiaT-Hough module was added to the ORB-SLAM2 system for Mars rock segmentation and 3D modeling, as well as rock counting. We propose a lightweight Siamese Transformer (SiaT) network combined with Hough transform for small sample semantic segmentation tasks, especially for rock counting in Mars exploration scenarios. Experimental results demonstrate that the SiaT-Hough model achieves an average segmentation accuracy of 87.8<sc>6</sc>% and a processing speed of 57.34 FPS on the Mars simulation dataset, striking an optimal balance between accuracy and real-time performance. In addition, we also carried out 3D reconstruction positioning accuracy evaluation and point cloud quality evaluation, and the positioning absolute track error on the two public data sets was less than 0.1m, 0.0639m and 0.0106m, respectively. The Pearson linear correlation coefficient of mean point cloud mass in Mars rendering dataset reaches 0.852, and the mean relative error of rock count is 8.63%, which proves the feasibility of the improved ORB-SLAM2 system for rock count in Mars environment. |
| format | Article |
| id | doaj-art-7badae1c554d4e24b04fba04fb47ebc4 |
| institution | DOAJ |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-7badae1c554d4e24b04fba04fb47ebc42025-08-20T03:13:55ZengIEEEIEEE Access2169-35362025-01-011312782412783610.1109/ACCESS.2025.358591811071669ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian EnvironmentsWei Liu0Gang Wan1https://orcid.org/0000-0002-5166-9439Jia Liu2Dianwei Cong3Department of Surveying and Mapping and Space Environment, Space Engineering University, Beijing, ChinaDepartment of Surveying and Mapping and Space Environment, Space Engineering University, Beijing, ChinaDepartment of Surveying and Mapping and Space Environment, Space Engineering University, Beijing, ChinaDepartment of Surveying and Mapping and Space Environment, Space Engineering University, Beijing, ChinaThis paper proposes a digital twin platform for Mars environment based on NVIDIA Isaac Sim to create a unique random environment with multi-scale fine-grained terrain features through programmed terrain generation and asset management. The SiaT-Hough module was added to the ORB-SLAM2 system for Mars rock segmentation and 3D modeling, as well as rock counting. We propose a lightweight Siamese Transformer (SiaT) network combined with Hough transform for small sample semantic segmentation tasks, especially for rock counting in Mars exploration scenarios. Experimental results demonstrate that the SiaT-Hough model achieves an average segmentation accuracy of 87.8<sc>6</sc>% and a processing speed of 57.34 FPS on the Mars simulation dataset, striking an optimal balance between accuracy and real-time performance. In addition, we also carried out 3D reconstruction positioning accuracy evaluation and point cloud quality evaluation, and the positioning absolute track error on the two public data sets was less than 0.1m, 0.0639m and 0.0106m, respectively. The Pearson linear correlation coefficient of mean point cloud mass in Mars rendering dataset reaches 0.852, and the mean relative error of rock count is 8.63%, which proves the feasibility of the improved ORB-SLAM2 system for rock count in Mars environment.https://ieeexplore.ieee.org/document/11071669/Mars explorationdigital twinORB-SLAM2semantic segmentation |
| spellingShingle | Wei Liu Gang Wan Jia Liu Dianwei Cong ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian Environments IEEE Access Mars exploration digital twin ORB-SLAM2 semantic segmentation |
| title | ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian Environments |
| title_full | ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian Environments |
| title_fullStr | ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian Environments |
| title_full_unstemmed | ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian Environments |
| title_short | ORB-SLAM2 System Enhanced With SiaT-Hough Module on Mars Digital Twin Platform: For Rock Counting and 3D Reconstruction in Martian Environments |
| title_sort | orb slam2 system enhanced with siat hough module on mars digital twin platform for rock counting and 3d reconstruction in martian environments |
| topic | Mars exploration digital twin ORB-SLAM2 semantic segmentation |
| url | https://ieeexplore.ieee.org/document/11071669/ |
| work_keys_str_mv | AT weiliu orbslam2systemenhancedwithsiathoughmoduleonmarsdigitaltwinplatformforrockcountingand3dreconstructioninmartianenvironments AT gangwan orbslam2systemenhancedwithsiathoughmoduleonmarsdigitaltwinplatformforrockcountingand3dreconstructioninmartianenvironments AT jialiu orbslam2systemenhancedwithsiathoughmoduleonmarsdigitaltwinplatformforrockcountingand3dreconstructioninmartianenvironments AT dianweicong orbslam2systemenhancedwithsiathoughmoduleonmarsdigitaltwinplatformforrockcountingand3dreconstructioninmartianenvironments |