Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning Algorithm

To address the issue of economic dispatch imbalance in virtual power plant (VPP) systems caused by the influence of operators and distribution networks, this study introduces an optimized economic dispatch method based on bi-level game theory. Firstly, a bi-level game model is formulated, which inte...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhu Liu, Guowei Guo, Dehuang Gong, Lingfeng Xuan, Feiwu He, Xinglin Wan, Dongguo Zhou
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Energies
Subjects:
Online Access:https://www.mdpi.com/1996-1073/18/2/374
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588553655156736
author Zhu Liu
Guowei Guo
Dehuang Gong
Lingfeng Xuan
Feiwu He
Xinglin Wan
Dongguo Zhou
author_facet Zhu Liu
Guowei Guo
Dehuang Gong
Lingfeng Xuan
Feiwu He
Xinglin Wan
Dongguo Zhou
author_sort Zhu Liu
collection DOAJ
description To address the issue of economic dispatch imbalance in virtual power plant (VPP) systems caused by the influence of operators and distribution networks, this study introduces an optimized economic dispatch method based on bi-level game theory. Firstly, a bi-level game model is formulated, which integrates the operational and environmental expenses of VPPs with the revenues of system operators. To avoid local optima during the search process, an enhanced reinforcement learning algorithm is developed to achieve rapid convergence and obtain the optimal solution. Finally, case analyses illustrate that the proposed method effectively accomplishes multi-objective optimization for various decision-making stakeholders, including VPP and system operators, while significantly reducing curtailment costs associated with the extensive integration of distributed renewable energy. Furthermore, the proposed algorithm achieves fast iteration and yields superior dispatch outcomes under the same modeling conditions.
format Article
id doaj-art-5f4fdf20895e4bc982aebb1224690365
institution Kabale University
issn 1996-1073
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Energies
spelling doaj-art-5f4fdf20895e4bc982aebb12246903652025-01-24T13:31:15ZengMDPI AGEnergies1996-10732025-01-0118237410.3390/en18020374Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning AlgorithmZhu Liu0Guowei Guo1Dehuang Gong2Lingfeng Xuan3Feiwu He4Xinglin Wan5Dongguo Zhou6China Southern Power Grid Research Technology Co., Ltd., Guangzhou 510663, ChinaGuangdong Electric Power Co., Ltd., Foshan Power Supply Bureau, Foshan 528061, ChinaGuangdong Electric Power Co., Ltd., Qingyuan Yingde Power Supply Bureau, Yingde 513099, ChinaGuangdong Electric Power Co., Ltd., Qingyuan Yingde Power Supply Bureau, Yingde 513099, ChinaGuangdong Electric Power Co., Ltd., Qingyuan Yingde Power Supply Bureau, Yingde 513099, ChinaSchool of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, ChinaSchool of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, ChinaTo address the issue of economic dispatch imbalance in virtual power plant (VPP) systems caused by the influence of operators and distribution networks, this study introduces an optimized economic dispatch method based on bi-level game theory. Firstly, a bi-level game model is formulated, which integrates the operational and environmental expenses of VPPs with the revenues of system operators. To avoid local optima during the search process, an enhanced reinforcement learning algorithm is developed to achieve rapid convergence and obtain the optimal solution. Finally, case analyses illustrate that the proposed method effectively accomplishes multi-objective optimization for various decision-making stakeholders, including VPP and system operators, while significantly reducing curtailment costs associated with the extensive integration of distributed renewable energy. Furthermore, the proposed algorithm achieves fast iteration and yields superior dispatch outcomes under the same modeling conditions.https://www.mdpi.com/1996-1073/18/2/374virtual power plantbi-level gamereinforcement learningpower trading
spellingShingle Zhu Liu
Guowei Guo
Dehuang Gong
Lingfeng Xuan
Feiwu He
Xinglin Wan
Dongguo Zhou
Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning Algorithm
Energies
virtual power plant
bi-level game
reinforcement learning
power trading
title Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning Algorithm
title_full Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning Algorithm
title_fullStr Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning Algorithm
title_full_unstemmed Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning Algorithm
title_short Bi-Level Game Strategy for Virtual Power Plants Based on an Improved Reinforcement Learning Algorithm
title_sort bi level game strategy for virtual power plants based on an improved reinforcement learning algorithm
topic virtual power plant
bi-level game
reinforcement learning
power trading
url https://www.mdpi.com/1996-1073/18/2/374
work_keys_str_mv AT zhuliu bilevelgamestrategyforvirtualpowerplantsbasedonanimprovedreinforcementlearningalgorithm
AT guoweiguo bilevelgamestrategyforvirtualpowerplantsbasedonanimprovedreinforcementlearningalgorithm
AT dehuanggong bilevelgamestrategyforvirtualpowerplantsbasedonanimprovedreinforcementlearningalgorithm
AT lingfengxuan bilevelgamestrategyforvirtualpowerplantsbasedonanimprovedreinforcementlearningalgorithm
AT feiwuhe bilevelgamestrategyforvirtualpowerplantsbasedonanimprovedreinforcementlearningalgorithm
AT xinglinwan bilevelgamestrategyforvirtualpowerplantsbasedonanimprovedreinforcementlearningalgorithm
AT dongguozhou bilevelgamestrategyforvirtualpowerplantsbasedonanimprovedreinforcementlearningalgorithm