A novel traffic sign recognition approach for open scenarios

Traffic sign recognition systems based on the traditional deep learning technologies typically follow the complete data-driven mode, resulting in their unstable performances and significant security risks when applied to the real-world open scenarios. To alleviate this problem, a novel method is pro...

Full description

Saved in:
Bibliographic Details
Main Authors: CAO Weipeng, WU Yuhao, LI Dachuan, MING Zhong, CHEN Zhenru, YE Xuan
Format: Article
Language:English
Published: Science Press (China Science Publishing & Media Ltd.) 2023-05-01
Series:Shenzhen Daxue xuebao. Ligong ban
Subjects:
Online Access:https://journal.szu.edu.cn/en/#/digest?ArticleID=2512
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849770742419292160
author CAO Weipeng
WU Yuhao
LI Dachuan
MING Zhong
CHEN Zhenru
YE Xuan
author_facet CAO Weipeng
WU Yuhao
LI Dachuan
MING Zhong
CHEN Zhenru
YE Xuan
author_sort CAO Weipeng
collection DOAJ
description Traffic sign recognition systems based on the traditional deep learning technologies typically follow the complete data-driven mode, resulting in their unstable performances and significant security risks when applied to the real-world open scenarios. To alleviate this problem, a novel method is proposed by constructing the semantic data set based on road traffic sign design standards and using the zero-shot learning (ZSL) mechanism to develop a general TSR framework with reasoning and interpretation capabilities. This method can effectively overcome the problems of dynamic update of road traffic signs and classes missing in practice. Furthermore, the national standard for road traffic signs is used to abstract the general attributes of all classes and then the information is injected into the training process of traditional data-driven model as domain knowledge. With the help of domain knowledge, the proposed ZSL-based TSR method can recognize traffic signs that have not been seen in the training stage more accurately than random prediction and traditional deep learning models. Experimental results on the Chinese traffic sign database (CTSDB) and the German traffic sign recognition benchmark (GTSRB) demonstrate that our method, which trains a semantic auto-encoder model, can significantly improve the accuracy in traditional zero-shot learning settings. Specifically, when identifying previously unseen traffic signs in the training set, our approach achieves an improvement in accuracy of at least 29.96% and 24.25% on CTSDB and GTSRB, respectively, compared to random prediction. The study verifies the feasibility and effectiveness of the proposed scheme.
format Article
id doaj-art-024bb408ea3a456a90a9e3b2d6faca30
institution DOAJ
issn 1000-2618
language English
publishDate 2023-05-01
publisher Science Press (China Science Publishing & Media Ltd.)
record_format Article
series Shenzhen Daxue xuebao. Ligong ban
spelling doaj-art-024bb408ea3a456a90a9e3b2d6faca302025-08-20T03:02:55ZengScience Press (China Science Publishing & Media Ltd.)Shenzhen Daxue xuebao. Ligong ban1000-26182023-05-0140325826510.3724/SP.J.1249.2023.032581000-2618(2023)03-0258-08A novel traffic sign recognition approach for open scenariosCAO WeipengWU YuhaoLI DachuanMING ZhongCHEN ZhenruYE XuanTraffic sign recognition systems based on the traditional deep learning technologies typically follow the complete data-driven mode, resulting in their unstable performances and significant security risks when applied to the real-world open scenarios. To alleviate this problem, a novel method is proposed by constructing the semantic data set based on road traffic sign design standards and using the zero-shot learning (ZSL) mechanism to develop a general TSR framework with reasoning and interpretation capabilities. This method can effectively overcome the problems of dynamic update of road traffic signs and classes missing in practice. Furthermore, the national standard for road traffic signs is used to abstract the general attributes of all classes and then the information is injected into the training process of traditional data-driven model as domain knowledge. With the help of domain knowledge, the proposed ZSL-based TSR method can recognize traffic signs that have not been seen in the training stage more accurately than random prediction and traditional deep learning models. Experimental results on the Chinese traffic sign database (CTSDB) and the German traffic sign recognition benchmark (GTSRB) demonstrate that our method, which trains a semantic auto-encoder model, can significantly improve the accuracy in traditional zero-shot learning settings. Specifically, when identifying previously unseen traffic signs in the training set, our approach achieves an improvement in accuracy of at least 29.96% and 24.25% on CTSDB and GTSRB, respectively, compared to random prediction. The study verifies the feasibility and effectiveness of the proposed scheme.https://journal.szu.edu.cn/en/#/digest?ArticleID=2512artificial intelligencetraffic sign recognitionzero-shot learningopen scenariosautonomous drivingdeep learningassisted driving
spellingShingle CAO Weipeng
WU Yuhao
LI Dachuan
MING Zhong
CHEN Zhenru
YE Xuan
A novel traffic sign recognition approach for open scenarios
Shenzhen Daxue xuebao. Ligong ban
artificial intelligence
traffic sign recognition
zero-shot learning
open scenarios
autonomous driving
deep learning
assisted driving
title A novel traffic sign recognition approach for open scenarios
title_full A novel traffic sign recognition approach for open scenarios
title_fullStr A novel traffic sign recognition approach for open scenarios
title_full_unstemmed A novel traffic sign recognition approach for open scenarios
title_short A novel traffic sign recognition approach for open scenarios
title_sort novel traffic sign recognition approach for open scenarios
topic artificial intelligence
traffic sign recognition
zero-shot learning
open scenarios
autonomous driving
deep learning
assisted driving
url https://journal.szu.edu.cn/en/#/digest?ArticleID=2512
work_keys_str_mv AT caoweipeng anoveltrafficsignrecognitionapproachforopenscenarios
AT wuyuhao anoveltrafficsignrecognitionapproachforopenscenarios
AT lidachuan anoveltrafficsignrecognitionapproachforopenscenarios
AT mingzhong anoveltrafficsignrecognitionapproachforopenscenarios
AT chenzhenru anoveltrafficsignrecognitionapproachforopenscenarios
AT yexuan anoveltrafficsignrecognitionapproachforopenscenarios
AT caoweipeng noveltrafficsignrecognitionapproachforopenscenarios
AT wuyuhao noveltrafficsignrecognitionapproachforopenscenarios
AT lidachuan noveltrafficsignrecognitionapproachforopenscenarios
AT mingzhong noveltrafficsignrecognitionapproachforopenscenarios
AT chenzhenru noveltrafficsignrecognitionapproachforopenscenarios
AT yexuan noveltrafficsignrecognitionapproachforopenscenarios