Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor
An important aspect of the perception system for intelligent vehicles is the detection and signal measurement of vehicle taillights. In this work, we present a novel vision-based measurement (VBM) system, using an event-based neuromorphic vision sensor, which is able to detect and measure the vehicl...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2022-01-01
|
| Series: | Journal of Advanced Transportation |
| Online Access: | http://dx.doi.org/10.1155/2022/2673191 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849308131759226880 |
|---|---|
| author | Zhengfa Liu Guang Chen Ya Wu Jiatong Du Jörg Conradt Alois Knoll |
| author_facet | Zhengfa Liu Guang Chen Ya Wu Jiatong Du Jörg Conradt Alois Knoll |
| author_sort | Zhengfa Liu |
| collection | DOAJ |
| description | An important aspect of the perception system for intelligent vehicles is the detection and signal measurement of vehicle taillights. In this work, we present a novel vision-based measurement (VBM) system, using an event-based neuromorphic vision sensor, which is able to detect and measure the vehicle taillight signal robustly. To the best of our knowledge, it is for the first time the neuromorphic vision sensor is paid attention to for utilizing in the field of vehicle taillight signal measurement. The event-based neuromorphic vision sensor is a bioinspired sensor that records pixel-level intensity changes, called events, as well as the whole picture of the scene. The events naturally respond to illumination changes (such as the ON and OFF state of taillights) in the scene with very low latency. Moreover, the property of a higher dynamic range increases the sensor sensitivity and performance in poor lighting conditions. In this paper, we consider an event-driven solution to measure vehicle taillight signals. In contrast to most existing work that relies purely on standard frame-based cameras for the taillight signal measurement, the presented mixed event/frame system extracts the frequency domain features from the spatial and temporal signal of each taillight region and measures the taillight signal by combining the active-pixel sensor (APS) frames and dynamic vision sensor (DVS) events. A thresholding algorithm and a learned classifier are proposed to jointly achieve the brake-light and turn-light signal measurement. Experiments with real traffic scenes demonstrate the performance of measuring taillight signals under different traffic conditions with a single event-based neuromorphic vision sensor. The results show the high potential of the event-based neuromorphic vision sensor being used for optical signal measurement applications, especially in dynamic environments. |
| format | Article |
| id | doaj-art-14170f4c2ff94c9ca194ca2563f809c8 |
| institution | Kabale University |
| issn | 2042-3195 |
| language | English |
| publishDate | 2022-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Advanced Transportation |
| spelling | doaj-art-14170f4c2ff94c9ca194ca2563f809c82025-08-20T03:54:33ZengWileyJournal of Advanced Transportation2042-31952022-01-01202210.1155/2022/2673191Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision SensorZhengfa Liu0Guang Chen1Ya Wu2Jiatong Du3Jörg Conradt4Alois Knoll5College of Automotive EngineeringCollege of Automotive EngineeringCollege of Automotive EngineeringCollege of Automotive EngineeringKTH Royal Institute of TechnologyChair of RoboticsAn important aspect of the perception system for intelligent vehicles is the detection and signal measurement of vehicle taillights. In this work, we present a novel vision-based measurement (VBM) system, using an event-based neuromorphic vision sensor, which is able to detect and measure the vehicle taillight signal robustly. To the best of our knowledge, it is for the first time the neuromorphic vision sensor is paid attention to for utilizing in the field of vehicle taillight signal measurement. The event-based neuromorphic vision sensor is a bioinspired sensor that records pixel-level intensity changes, called events, as well as the whole picture of the scene. The events naturally respond to illumination changes (such as the ON and OFF state of taillights) in the scene with very low latency. Moreover, the property of a higher dynamic range increases the sensor sensitivity and performance in poor lighting conditions. In this paper, we consider an event-driven solution to measure vehicle taillight signals. In contrast to most existing work that relies purely on standard frame-based cameras for the taillight signal measurement, the presented mixed event/frame system extracts the frequency domain features from the spatial and temporal signal of each taillight region and measures the taillight signal by combining the active-pixel sensor (APS) frames and dynamic vision sensor (DVS) events. A thresholding algorithm and a learned classifier are proposed to jointly achieve the brake-light and turn-light signal measurement. Experiments with real traffic scenes demonstrate the performance of measuring taillight signals under different traffic conditions with a single event-based neuromorphic vision sensor. The results show the high potential of the event-based neuromorphic vision sensor being used for optical signal measurement applications, especially in dynamic environments.http://dx.doi.org/10.1155/2022/2673191 |
| spellingShingle | Zhengfa Liu Guang Chen Ya Wu Jiatong Du Jörg Conradt Alois Knoll Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor Journal of Advanced Transportation |
| title | Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor |
| title_full | Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor |
| title_fullStr | Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor |
| title_full_unstemmed | Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor |
| title_short | Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor |
| title_sort | mixed event frame vision system for daytime preceding vehicle taillight signal measurement using event based neuromorphic vision sensor |
| url | http://dx.doi.org/10.1155/2022/2673191 |
| work_keys_str_mv | AT zhengfaliu mixedeventframevisionsystemfordaytimeprecedingvehicletaillightsignalmeasurementusingeventbasedneuromorphicvisionsensor AT guangchen mixedeventframevisionsystemfordaytimeprecedingvehicletaillightsignalmeasurementusingeventbasedneuromorphicvisionsensor AT yawu mixedeventframevisionsystemfordaytimeprecedingvehicletaillightsignalmeasurementusingeventbasedneuromorphicvisionsensor AT jiatongdu mixedeventframevisionsystemfordaytimeprecedingvehicletaillightsignalmeasurementusingeventbasedneuromorphicvisionsensor AT jorgconradt mixedeventframevisionsystemfordaytimeprecedingvehicletaillightsignalmeasurementusingeventbasedneuromorphicvisionsensor AT aloisknoll mixedeventframevisionsystemfordaytimeprecedingvehicletaillightsignalmeasurementusingeventbasedneuromorphicvisionsensor |