A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution

The decision-making models that are able to deal with complex and dynamic urban intersections are critical for the development of autonomous vehicles. A key challenge in operating autonomous vehicles robustly is to accurately detect the trajectories of other participants and to consider safety and e...

Full description

Saved in:
Bibliographic Details
Main Authors: Zi-jia Wang, Xue-mei Chen, Pin Wang, Meng-xi Li, Yang-jia-xin Ou, Han Zhang
Format: Article
Language:English
Published: Wiley 2021-01-01
Series:Journal of Advanced Transportation
Online Access:http://dx.doi.org/10.1155/2021/8894563
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832550839543136256
author Zi-jia Wang
Xue-mei Chen
Pin Wang
Meng-xi Li
Yang-jia-xin Ou
Han Zhang
author_facet Zi-jia Wang
Xue-mei Chen
Pin Wang
Meng-xi Li
Yang-jia-xin Ou
Han Zhang
author_sort Zi-jia Wang
collection DOAJ
description The decision-making models that are able to deal with complex and dynamic urban intersections are critical for the development of autonomous vehicles. A key challenge in operating autonomous vehicles robustly is to accurately detect the trajectories of other participants and to consider safety and efficiency concurrently into interactions between vehicles. In this work, we propose an approach for developing a tactical decision-making model for vehicles which is capable of predicting the trajectories of incoming vehicles and employs the conflict resolution theory to model vehicle interactions. The proposed algorithm can help autonomous vehicles cross intersections safely. Firstly, Gaussian process regression models were trained with the data collected at intersections using subgrade sensors and a retrofit autonomous vehicle to predict the trajectories of incoming vehicles. Then, we proposed a multiobjective optimization problem (MOP) decision-making model based on efficient conflict resolution theory at intersections. After that, a nondominated sorting genetic algorithm (NSGA-II) and deep deterministic policy gradient (DDPG) are employed to select the optimal motions in comparison with each other. Finally, a simulation and verification platform was built based on Matlab/Simulink and PreScan. The reliability and effectiveness of the tactical decision-making model was verified by simulations. The results indicate that DDPG is more reliable and effective than NSGA-II to solve the MOP model, which provides a theoretical basis for the in-depth study of decision-making in a complex and uncertain intersection environment.
format Article
id doaj-art-70ff1dd2e9fd473db2d84542f38c18ba
institution Kabale University
issn 0197-6729
2042-3195
language English
publishDate 2021-01-01
publisher Wiley
record_format Article
series Journal of Advanced Transportation
spelling doaj-art-70ff1dd2e9fd473db2d84542f38c18ba2025-02-03T06:05:35ZengWileyJournal of Advanced Transportation0197-67292042-31952021-01-01202110.1155/2021/88945638894563A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict ResolutionZi-jia Wang0Xue-mei Chen1Pin Wang2Meng-xi Li3Yang-jia-xin Ou4Han Zhang5Beijing Institute of Technology, School of Mechanical Engineering, Intelligent Vehicle Research Institute, 5 South Zhong Guan Cun Street, Haidian District, Beijing 100081, ChinaBeijing Institute of Technology, School of Mechanical Engineering, Intelligent Vehicle Research Institute, 5 South Zhong Guan Cun Street, Haidian District, Beijing 100081, ChinaUniversity of California, Berkeley, 1357 South 46th Street, Richmond, CA 94804, USABeijing Institute of Technology, School of Mechanical Engineering, Intelligent Vehicle Research Institute, 5 South Zhong Guan Cun Street, Haidian District, Beijing 100081, ChinaBeijing Institute of Technology, School of Mechanical Engineering, Intelligent Vehicle Research Institute, 5 South Zhong Guan Cun Street, Haidian District, Beijing 100081, ChinaShandong Hi-Speed Construction Management Group Co., Ltd., Jinan 250001, Shandong, ChinaThe decision-making models that are able to deal with complex and dynamic urban intersections are critical for the development of autonomous vehicles. A key challenge in operating autonomous vehicles robustly is to accurately detect the trajectories of other participants and to consider safety and efficiency concurrently into interactions between vehicles. In this work, we propose an approach for developing a tactical decision-making model for vehicles which is capable of predicting the trajectories of incoming vehicles and employs the conflict resolution theory to model vehicle interactions. The proposed algorithm can help autonomous vehicles cross intersections safely. Firstly, Gaussian process regression models were trained with the data collected at intersections using subgrade sensors and a retrofit autonomous vehicle to predict the trajectories of incoming vehicles. Then, we proposed a multiobjective optimization problem (MOP) decision-making model based on efficient conflict resolution theory at intersections. After that, a nondominated sorting genetic algorithm (NSGA-II) and deep deterministic policy gradient (DDPG) are employed to select the optimal motions in comparison with each other. Finally, a simulation and verification platform was built based on Matlab/Simulink and PreScan. The reliability and effectiveness of the tactical decision-making model was verified by simulations. The results indicate that DDPG is more reliable and effective than NSGA-II to solve the MOP model, which provides a theoretical basis for the in-depth study of decision-making in a complex and uncertain intersection environment.http://dx.doi.org/10.1155/2021/8894563
spellingShingle Zi-jia Wang
Xue-mei Chen
Pin Wang
Meng-xi Li
Yang-jia-xin Ou
Han Zhang
A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
Journal of Advanced Transportation
title A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
title_full A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
title_fullStr A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
title_full_unstemmed A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
title_short A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
title_sort decision making model for autonomous vehicles at urban intersections based on conflict resolution
url http://dx.doi.org/10.1155/2021/8894563
work_keys_str_mv AT zijiawang adecisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT xuemeichen adecisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT pinwang adecisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT mengxili adecisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT yangjiaxinou adecisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT hanzhang adecisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT zijiawang decisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT xuemeichen decisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT pinwang decisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT mengxili decisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT yangjiaxinou decisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution
AT hanzhang decisionmakingmodelforautonomousvehiclesaturbanintersectionsbasedonconflictresolution