Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban Environments
Urban environments are dynamic and complex, posing constant challenges for the localization and navigation of autonomous vehicles (AV). This demands more innovative sensor systems for effective autonomous navigation. Autonomous vehicles use sensors like LiDAR, cameras, and radar to traverse complica...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2025-07-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://isprs-archives.copernicus.org/articles/XLVIII-G-2025/1255/2025/isprs-archives-XLVIII-G-2025-1255-2025.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849707003125956608 |
|---|---|
| author | A. Rai E. Mounier E. Mounier P. R. M. de Araujo A. Noureldin A. Noureldin K. Jain |
| author_facet | A. Rai E. Mounier E. Mounier P. R. M. de Araujo A. Noureldin A. Noureldin K. Jain |
| author_sort | A. Rai |
| collection | DOAJ |
| description | Urban environments are dynamic and complex, posing constant challenges for the localization and navigation of autonomous vehicles (AV). This demands more innovative sensor systems for effective autonomous navigation. Autonomous vehicles use sensors like LiDAR, cameras, and radar to traverse complicated urban environments with precision. These technologies have advantages in improving perception and localization, but they have their own shortcomings – LiDAR can be costly and falters under adverse weather conditions, cameras are sensitive to lighting conditions, and radars lack high-resolution details. Beyond these complexities, environmental conditions like signal-blocking skyscrapers, unpredictable obstacles, and the high costs of precision sensing add further convolution. A multi-sensor integrated solution can be a reliable option to overcome these challenges. Our work explores the use of a multi-stereo camera array that provides a 360° perception for localization in dense urban environments. We use computer vision algorithms to derive 3D point clouds from stereo-images and localize the cameras using a prior 3D map to balance cost and performance. We tested the system in Calgary’s urban setting with various lighting conditions and GNSS-denied zones. Our approach provided accurate localization in 85% of the cases we tested. The results demonstrate that our multi-stereo camera system can help to achieve robust localization in challenging urban situations. This approach offers a cost-effective alternative to LiDAR-based systems while ensuring adequate accuracy. |
| format | Article |
| id | doaj-art-ed56092a461b49efb4d74eeed0cb7d20 |
| institution | DOAJ |
| issn | 1682-1750 2194-9034 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj-art-ed56092a461b49efb4d74eeed0cb7d202025-08-20T03:16:03ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342025-07-01XLVIII-G-20251255126210.5194/isprs-archives-XLVIII-G-2025-1255-2025Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban EnvironmentsA. Rai0E. Mounier1E. Mounier2P. R. M. de Araujo3A. Noureldin4A. Noureldin5K. Jain6Department of Civil Engineering, Indian Institute of Technology Roorkee, Roorkee, Uttarakhand, IndiaQueen’s University, Kingston, ON, CanadaAin Shams University, Cairo, EgyptQueen’s University, Kingston, ON, CanadaQueen’s University, Kingston, ON, CanadaRoyal Military College, Kingston, ON, CanadaDepartment of Civil Engineering, Indian Institute of Technology Roorkee, Roorkee, Uttarakhand, IndiaUrban environments are dynamic and complex, posing constant challenges for the localization and navigation of autonomous vehicles (AV). This demands more innovative sensor systems for effective autonomous navigation. Autonomous vehicles use sensors like LiDAR, cameras, and radar to traverse complicated urban environments with precision. These technologies have advantages in improving perception and localization, but they have their own shortcomings – LiDAR can be costly and falters under adverse weather conditions, cameras are sensitive to lighting conditions, and radars lack high-resolution details. Beyond these complexities, environmental conditions like signal-blocking skyscrapers, unpredictable obstacles, and the high costs of precision sensing add further convolution. A multi-sensor integrated solution can be a reliable option to overcome these challenges. Our work explores the use of a multi-stereo camera array that provides a 360° perception for localization in dense urban environments. We use computer vision algorithms to derive 3D point clouds from stereo-images and localize the cameras using a prior 3D map to balance cost and performance. We tested the system in Calgary’s urban setting with various lighting conditions and GNSS-denied zones. Our approach provided accurate localization in 85% of the cases we tested. The results demonstrate that our multi-stereo camera system can help to achieve robust localization in challenging urban situations. This approach offers a cost-effective alternative to LiDAR-based systems while ensuring adequate accuracy.https://isprs-archives.copernicus.org/articles/XLVIII-G-2025/1255/2025/isprs-archives-XLVIII-G-2025-1255-2025.pdf |
| spellingShingle | A. Rai E. Mounier E. Mounier P. R. M. de Araujo A. Noureldin A. Noureldin K. Jain Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban Environments The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban Environments |
| title_full | Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban Environments |
| title_fullStr | Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban Environments |
| title_full_unstemmed | Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban Environments |
| title_short | Investigation and Implementation of Multi-Stereo Camera System Integration for Robust Localization in Urban Environments |
| title_sort | investigation and implementation of multi stereo camera system integration for robust localization in urban environments |
| url | https://isprs-archives.copernicus.org/articles/XLVIII-G-2025/1255/2025/isprs-archives-XLVIII-G-2025-1255-2025.pdf |
| work_keys_str_mv | AT arai investigationandimplementationofmultistereocamerasystemintegrationforrobustlocalizationinurbanenvironments AT emounier investigationandimplementationofmultistereocamerasystemintegrationforrobustlocalizationinurbanenvironments AT emounier investigationandimplementationofmultistereocamerasystemintegrationforrobustlocalizationinurbanenvironments AT prmdearaujo investigationandimplementationofmultistereocamerasystemintegrationforrobustlocalizationinurbanenvironments AT anoureldin investigationandimplementationofmultistereocamerasystemintegrationforrobustlocalizationinurbanenvironments AT anoureldin investigationandimplementationofmultistereocamerasystemintegrationforrobustlocalizationinurbanenvironments AT kjain investigationandimplementationofmultistereocamerasystemintegrationforrobustlocalizationinurbanenvironments |