Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning
Work zone areas are frequent congested sections considered as the freeway bottleneck. Connected and autonomous vehicle (CAV) trajectory optimization can improve the operating efficiency in bottleneck areas by harmonizing vehicles’ manipulations. This study presents a joint trajectory optimization of...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-01-01
|
| Series: | Journal of Advanced Transportation |
| Online Access: | http://dx.doi.org/10.1155/2021/9805560 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832559937360756736 |
|---|---|
| author | Tong Zhu Xiaohu Li Wei Fan Changshuai Wang Haoxue Liu Runqing Zhao |
| author_facet | Tong Zhu Xiaohu Li Wei Fan Changshuai Wang Haoxue Liu Runqing Zhao |
| author_sort | Tong Zhu |
| collection | DOAJ |
| description | Work zone areas are frequent congested sections considered as the freeway bottleneck. Connected and autonomous vehicle (CAV) trajectory optimization can improve the operating efficiency in bottleneck areas by harmonizing vehicles’ manipulations. This study presents a joint trajectory optimization of cooperative lane changing, merging, and car-following actions for CAV control at a local merging point together with upstream points. The multiagent reinforcement learning (MARL) method is applied in this system, with one agent providing a merging advisory service at the merging point and controlling the inner-lane vehicles’ headway for smooth outer-lane vehicle merging, while other agents provide lane-changing advisory services at advance lane-changing points to control how vehicles make lane changes in advance and perform corresponding headway adjustment, similar to and jointly with the merging advisory service. Uniting all agents, the coordination graph (CG) method is applied to seek the global optimum, overcoming the exponential growth problem in MARL. Using MATLAB and the VISSIM COM interface, an online simulation platform is established. The simulation results show that MARL is effective for online computation with in-timing response. More importantly, comparisons of the results obtained in various scenarios demonstrate that the proposed system obtained smoother vehicle trajectories in all controlled sections, rather than only in the merging area, indicating that it can achieve better traffic conditions in freeway work zone areas. |
| format | Article |
| id | doaj-art-e2e97a5be77d4336b48d20777a9a8414 |
| institution | Kabale University |
| issn | 2042-3195 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Advanced Transportation |
| spelling | doaj-art-e2e97a5be77d4336b48d20777a9a84142025-02-03T01:28:54ZengWileyJournal of Advanced Transportation2042-31952021-01-01202110.1155/2021/9805560Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement LearningTong Zhu0Xiaohu Li1Wei Fan2Changshuai Wang3Haoxue Liu4Runqing Zhao5College of Transportation EngineeringChina Automotive Technology & Research CenterBeijing Jingdong Century Trading Co., Ltd.School of TransportationSchool of AutomobileSchool of AviationWork zone areas are frequent congested sections considered as the freeway bottleneck. Connected and autonomous vehicle (CAV) trajectory optimization can improve the operating efficiency in bottleneck areas by harmonizing vehicles’ manipulations. This study presents a joint trajectory optimization of cooperative lane changing, merging, and car-following actions for CAV control at a local merging point together with upstream points. The multiagent reinforcement learning (MARL) method is applied in this system, with one agent providing a merging advisory service at the merging point and controlling the inner-lane vehicles’ headway for smooth outer-lane vehicle merging, while other agents provide lane-changing advisory services at advance lane-changing points to control how vehicles make lane changes in advance and perform corresponding headway adjustment, similar to and jointly with the merging advisory service. Uniting all agents, the coordination graph (CG) method is applied to seek the global optimum, overcoming the exponential growth problem in MARL. Using MATLAB and the VISSIM COM interface, an online simulation platform is established. The simulation results show that MARL is effective for online computation with in-timing response. More importantly, comparisons of the results obtained in various scenarios demonstrate that the proposed system obtained smoother vehicle trajectories in all controlled sections, rather than only in the merging area, indicating that it can achieve better traffic conditions in freeway work zone areas.http://dx.doi.org/10.1155/2021/9805560 |
| spellingShingle | Tong Zhu Xiaohu Li Wei Fan Changshuai Wang Haoxue Liu Runqing Zhao Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning Journal of Advanced Transportation |
| title | Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning |
| title_full | Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning |
| title_fullStr | Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning |
| title_full_unstemmed | Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning |
| title_short | Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning |
| title_sort | trajectory optimization of cavs in freeway work zone considering car following behaviors using online multiagent reinforcement learning |
| url | http://dx.doi.org/10.1155/2021/9805560 |
| work_keys_str_mv | AT tongzhu trajectoryoptimizationofcavsinfreewayworkzoneconsideringcarfollowingbehaviorsusingonlinemultiagentreinforcementlearning AT xiaohuli trajectoryoptimizationofcavsinfreewayworkzoneconsideringcarfollowingbehaviorsusingonlinemultiagentreinforcementlearning AT weifan trajectoryoptimizationofcavsinfreewayworkzoneconsideringcarfollowingbehaviorsusingonlinemultiagentreinforcementlearning AT changshuaiwang trajectoryoptimizationofcavsinfreewayworkzoneconsideringcarfollowingbehaviorsusingonlinemultiagentreinforcementlearning AT haoxueliu trajectoryoptimizationofcavsinfreewayworkzoneconsideringcarfollowingbehaviorsusingonlinemultiagentreinforcementlearning AT runqingzhao trajectoryoptimizationofcavsinfreewayworkzoneconsideringcarfollowingbehaviorsusingonlinemultiagentreinforcementlearning |