Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search Approach
This paper studies a dynamic capacitated arc routing problem for battery replacement in an e-bike sharing system, where workers replace batteries for underpowered e-bikes along street segments dynamically. The objective is to replace as many batteries as possible and minimize pickup failures. The te...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-01-01
|
| Series: | Journal of Advanced Transportation |
| Online Access: | http://dx.doi.org/10.1155/2021/9665340 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849408171517411328 |
|---|---|
| author | Shiqi Tan Zhiheng Li Na Xie |
| author_facet | Shiqi Tan Zhiheng Li Na Xie |
| author_sort | Shiqi Tan |
| collection | DOAJ |
| description | This paper studies a dynamic capacitated arc routing problem for battery replacement in an e-bike sharing system, where workers replace batteries for underpowered e-bikes along street segments dynamically. The objective is to replace as many batteries as possible and minimize pickup failures. The temporal dependency of the routing decisions, the conflict of the workers’ operations, and the stochastic and dynamic nature of user demands all make this a difficult problem. To cope with these difficulties, a “Partition-First, Route-Second” bi-level solution framework is adopted to describe the problem in two different time scales. On the large time scale, a spatiotemporal partitioning method, which divides the road network into nonoverlapping subzones, is proposed to decompose the problem. On the small time scale, this paper models the routing decision process of individual worker as a Markov Decision Process. We adopt a lookahead policy that simulates future information and decisions over some horizons to evaluate the long-term influence of current feasible decisions. A Monte Carlo Tree Search algorithm is also used to improve the simulation efficiency. By performing numerical computation experiments on a test case study and comparing with some benchmarking policies, we demonstrate the effectiveness and efficiency of the suggested method. |
| format | Article |
| id | doaj-art-3d7ff4e971cb439b9a51b7dc329edf30 |
| institution | Kabale University |
| issn | 0197-6729 2042-3195 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Advanced Transportation |
| spelling | doaj-art-3d7ff4e971cb439b9a51b7dc329edf302025-08-20T03:35:51ZengWileyJournal of Advanced Transportation0197-67292042-31952021-01-01202110.1155/2021/96653409665340Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search ApproachShiqi Tan0Zhiheng Li1Na Xie2Department of Automation, Tsinghua University, Beijing 100084, ChinaTsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, ChinaSchool of Management Science and Engineering, Central University of Finance and Economics, Beijing 100081, ChinaThis paper studies a dynamic capacitated arc routing problem for battery replacement in an e-bike sharing system, where workers replace batteries for underpowered e-bikes along street segments dynamically. The objective is to replace as many batteries as possible and minimize pickup failures. The temporal dependency of the routing decisions, the conflict of the workers’ operations, and the stochastic and dynamic nature of user demands all make this a difficult problem. To cope with these difficulties, a “Partition-First, Route-Second” bi-level solution framework is adopted to describe the problem in two different time scales. On the large time scale, a spatiotemporal partitioning method, which divides the road network into nonoverlapping subzones, is proposed to decompose the problem. On the small time scale, this paper models the routing decision process of individual worker as a Markov Decision Process. We adopt a lookahead policy that simulates future information and decisions over some horizons to evaluate the long-term influence of current feasible decisions. A Monte Carlo Tree Search algorithm is also used to improve the simulation efficiency. By performing numerical computation experiments on a test case study and comparing with some benchmarking policies, we demonstrate the effectiveness and efficiency of the suggested method.http://dx.doi.org/10.1155/2021/9665340 |
| spellingShingle | Shiqi Tan Zhiheng Li Na Xie Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search Approach Journal of Advanced Transportation |
| title | Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search Approach |
| title_full | Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search Approach |
| title_fullStr | Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search Approach |
| title_full_unstemmed | Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search Approach |
| title_short | Dynamic Capacitated Arc Routing Problem in E-Bike Sharing System: A Monte Carlo Tree Search Approach |
| title_sort | dynamic capacitated arc routing problem in e bike sharing system a monte carlo tree search approach |
| url | http://dx.doi.org/10.1155/2021/9665340 |
| work_keys_str_mv | AT shiqitan dynamiccapacitatedarcroutingprobleminebikesharingsystemamontecarlotreesearchapproach AT zhihengli dynamiccapacitatedarcroutingprobleminebikesharingsystemamontecarlotreesearchapproach AT naxie dynamiccapacitatedarcroutingprobleminebikesharingsystemamontecarlotreesearchapproach |