Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data

Navigation for autonomous robots in hazardous environments demands robust localization solutions. In challenging environments such as tunnels and urban disaster areas, autonomous robots and vehicles are particularly important for search and rescue operations. However, especially in these environment...

Full description

Saved in:
Bibliographic Details
Main Authors: Lukas Schichler, Karin Festl, Selim Solmaz
Format: Article
Language:English
Published: MDPI AG 2025-03-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/25/7/2032
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850212283769159680
author Lukas Schichler
Karin Festl
Selim Solmaz
author_facet Lukas Schichler
Karin Festl
Selim Solmaz
author_sort Lukas Schichler
collection DOAJ
description Navigation for autonomous robots in hazardous environments demands robust localization solutions. In challenging environments such as tunnels and urban disaster areas, autonomous robots and vehicles are particularly important for search and rescue operations. However, especially in these environments, sensor failures and errors make the localization task particularly difficult. We propose a robust sensor fusion algorithm that integrates data from a thermal camera, a LiDAR sensor, and a GNSS to provide reliable localization, even in environments where individual sensor data may be compromised. The thermal camera and LiDAR sensor employ distinct SLAM and odometry techniques to estimate movement and positioning, while an extended Kalman filter (EKF) fuses all three sensor inputs, accommodating varying sampling rates and potential sensor outages. To evaluate the algorithm, we conduct a field test in an urban environment using a vehicle equipped with the appropriate sensor suite while simulating an outage one at a time, to demonstrate the approach’s effectiveness under real-world conditions.
format Article
id doaj-art-0babbc4cfe6d44ef8c8ccdf0e1bdc700
institution OA Journals
issn 1424-8220
language English
publishDate 2025-03-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj-art-0babbc4cfe6d44ef8c8ccdf0e1bdc7002025-08-20T02:09:22ZengMDPI AGSensors1424-82202025-03-01257203210.3390/s25072032Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS DataLukas Schichler0Karin Festl1Selim Solmaz2Virtual Vehicle Research GmbH, 8010 Graz, AustriaVirtual Vehicle Research GmbH, 8010 Graz, AustriaVirtual Vehicle Research GmbH, 8010 Graz, AustriaNavigation for autonomous robots in hazardous environments demands robust localization solutions. In challenging environments such as tunnels and urban disaster areas, autonomous robots and vehicles are particularly important for search and rescue operations. However, especially in these environments, sensor failures and errors make the localization task particularly difficult. We propose a robust sensor fusion algorithm that integrates data from a thermal camera, a LiDAR sensor, and a GNSS to provide reliable localization, even in environments where individual sensor data may be compromised. The thermal camera and LiDAR sensor employ distinct SLAM and odometry techniques to estimate movement and positioning, while an extended Kalman filter (EKF) fuses all three sensor inputs, accommodating varying sampling rates and potential sensor outages. To evaluate the algorithm, we conduct a field test in an urban environment using a vehicle equipped with the appropriate sensor suite while simulating an outage one at a time, to demonstrate the approach’s effectiveness under real-world conditions.https://www.mdpi.com/1424-8220/25/7/2032thermal camera odometryrobust localizationsensor fusionextended Kalman filter (EKF)
spellingShingle Lukas Schichler
Karin Festl
Selim Solmaz
Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data
Sensors
thermal camera odometry
robust localization
sensor fusion
extended Kalman filter (EKF)
title Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data
title_full Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data
title_fullStr Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data
title_full_unstemmed Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data
title_short Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data
title_sort robust multi sensor fusion for localization in hazardous environments using thermal lidar and gnss data
topic thermal camera odometry
robust localization
sensor fusion
extended Kalman filter (EKF)
url https://www.mdpi.com/1424-8220/25/7/2032
work_keys_str_mv AT lukasschichler robustmultisensorfusionforlocalizationinhazardousenvironmentsusingthermallidarandgnssdata
AT karinfestl robustmultisensorfusionforlocalizationinhazardousenvironmentsusingthermallidarandgnssdata
AT selimsolmaz robustmultisensorfusionforlocalizationinhazardousenvironmentsusingthermallidarandgnssdata