A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method
The electric vehicle (EV) has been popular in recent years, which also brings huge challenges to the distribution network due to its energy instability. In order to consider the economic factors of dispatching these distributed renewable resources, the voltage variation is also important. A novel mo...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-01-01
|
| Series: | International Transactions on Electrical Energy Systems |
| Online Access: | http://dx.doi.org/10.1155/2024/7765710 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849434869814263808 |
|---|---|
| author | Ruien Bian Xiuchen Jiang Guoying Zhao Yadong Liu Zhou Dai |
| author_facet | Ruien Bian Xiuchen Jiang Guoying Zhao Yadong Liu Zhou Dai |
| author_sort | Ruien Bian |
| collection | DOAJ |
| description | The electric vehicle (EV) has been popular in recent years, which also brings huge challenges to the distribution network due to its energy instability. In order to consider the economic factors of dispatching these distributed renewable resources, the voltage variation is also important. A novel model-free method is put forward for collaborative management of EV resources of aggregators in the distribution network. The economic costs and physical network constraints for this energy management issue are considered at the same time. A Multiagent Deep Deterministic Policy Gradient (MADDPG) algorithm is applied to learn the cooperative energy control strategies. A transfer learning technique is used to fine-tune the trained policy when more aggregators join in the network. The proposed method can achieve close results to the traditional optimization methods, while it takes less than one second to take control actions, making it is more suitable for real-time online energy management. Compared to other advanced reinforcement learning (RL) models, numerical simulations conducted on IEEE test cases greatly illustrate the effectiveness and superiority of the proposed method. |
| format | Article |
| id | doaj-art-dd58721ac0544aae8f7e4a6ddb5893ba |
| institution | Kabale University |
| issn | 2050-7038 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | International Transactions on Electrical Energy Systems |
| spelling | doaj-art-dd58721ac0544aae8f7e4a6ddb5893ba2025-08-20T03:26:30ZengWileyInternational Transactions on Electrical Energy Systems2050-70382024-01-01202410.1155/2024/7765710A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning MethodRuien Bian0Xiuchen Jiang1Guoying Zhao2Yadong Liu3Zhou Dai4College of Electronic Information and Electrical EngineeringCollege of Electronic Information and Electrical EngineeringCollege of Management Science and EngineeringCollege of Electronic Information and Electrical EngineeringCollege of Management Science and EngineeringThe electric vehicle (EV) has been popular in recent years, which also brings huge challenges to the distribution network due to its energy instability. In order to consider the economic factors of dispatching these distributed renewable resources, the voltage variation is also important. A novel model-free method is put forward for collaborative management of EV resources of aggregators in the distribution network. The economic costs and physical network constraints for this energy management issue are considered at the same time. A Multiagent Deep Deterministic Policy Gradient (MADDPG) algorithm is applied to learn the cooperative energy control strategies. A transfer learning technique is used to fine-tune the trained policy when more aggregators join in the network. The proposed method can achieve close results to the traditional optimization methods, while it takes less than one second to take control actions, making it is more suitable for real-time online energy management. Compared to other advanced reinforcement learning (RL) models, numerical simulations conducted on IEEE test cases greatly illustrate the effectiveness and superiority of the proposed method.http://dx.doi.org/10.1155/2024/7765710 |
| spellingShingle | Ruien Bian Xiuchen Jiang Guoying Zhao Yadong Liu Zhou Dai A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method International Transactions on Electrical Energy Systems |
| title | A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method |
| title_full | A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method |
| title_fullStr | A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method |
| title_full_unstemmed | A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method |
| title_short | A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method |
| title_sort | scalable and coordinated energy management for electric vehicles based on multiagent reinforcement learning method |
| url | http://dx.doi.org/10.1155/2024/7765710 |
| work_keys_str_mv | AT ruienbian ascalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT xiuchenjiang ascalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT guoyingzhao ascalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT yadongliu ascalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT zhoudai ascalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT ruienbian scalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT xiuchenjiang scalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT guoyingzhao scalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT yadongliu scalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod AT zhoudai scalableandcoordinatedenergymanagementforelectricvehiclesbasedonmultiagentreinforcementlearningmethod |