DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage Equipment
A scheme of load frequency control (LFC) is proposed based on the deep deterministic policy gradient (DDPG) and active disturbance rejection control (ADRC) for multi-region interconnected power systems considering the renewable energy sources (RESs) and energy storage (ES). The dynamic models of mul...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-07-01
|
| Series: | Energies |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1996-1073/18/14/3610 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850077658957742080 |
|---|---|
| author | Zhenlan Dou Chunyan Zhang Xichao Zhou Dan Gao Xinghua Liu |
| author_facet | Zhenlan Dou Chunyan Zhang Xichao Zhou Dan Gao Xinghua Liu |
| author_sort | Zhenlan Dou |
| collection | DOAJ |
| description | A scheme of load frequency control (LFC) is proposed based on the deep deterministic policy gradient (DDPG) and active disturbance rejection control (ADRC) for multi-region interconnected power systems considering the renewable energy sources (RESs) and energy storage (ES). The dynamic models of multi-region interconnected power systems are analyzed, which provides a basis for the subsequent RES access. Superconducting magnetic energy storage (SMES) and capacitor energy storage (CES) are adopted due to their rapid response capabilities and fast charge–discharge characteristics. To stabilize the frequency fluctuation, a first-order ADRC is designed, utilizing the anti-perturbation estimation capability of the first-order ADRC to achieve effective control. In addition, the system states are estimated using a linear expansion state observer. Based on the output of the observer, the appropriate feedback control law is selected. The DDPG-ADRC parameter optimization model is constructed to adaptively adjust the control parameters of ADRC based on the target frequency deviation and power deviation. The actor and critic networks are continuously updated according to the actual system response to ensure stable system operation. Finally, the experiment demonstrated that the proposed method outperforms traditional methods across all performance indicators, particularly excelling in reducing adjustment time (45.8% decrease) and overshoot (60% reduction). |
| format | Article |
| id | doaj-art-fd42a92764ce441289778b8fbd2dac7b |
| institution | DOAJ |
| issn | 1996-1073 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Energies |
| spelling | doaj-art-fd42a92764ce441289778b8fbd2dac7b2025-08-20T02:45:45ZengMDPI AGEnergies1996-10732025-07-011814361010.3390/en18143610DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage EquipmentZhenlan Dou0Chunyan Zhang1Xichao Zhou2Dan Gao3Xinghua Liu4State Grid Shanghai Municipal Electric Power Company, Shanghai 200120, ChinaState Grid Shanghai Municipal Electric Power Company, Shanghai 200120, ChinaState Grid Integrated Energy Services Group Co., Ltd., Beijing 100032, ChinaSchool of Electrical Engineering, Xi’an University of Technology, Xi’an 710048, ChinaSchool of Electrical Engineering, Xi’an University of Technology, Xi’an 710048, ChinaA scheme of load frequency control (LFC) is proposed based on the deep deterministic policy gradient (DDPG) and active disturbance rejection control (ADRC) for multi-region interconnected power systems considering the renewable energy sources (RESs) and energy storage (ES). The dynamic models of multi-region interconnected power systems are analyzed, which provides a basis for the subsequent RES access. Superconducting magnetic energy storage (SMES) and capacitor energy storage (CES) are adopted due to their rapid response capabilities and fast charge–discharge characteristics. To stabilize the frequency fluctuation, a first-order ADRC is designed, utilizing the anti-perturbation estimation capability of the first-order ADRC to achieve effective control. In addition, the system states are estimated using a linear expansion state observer. Based on the output of the observer, the appropriate feedback control law is selected. The DDPG-ADRC parameter optimization model is constructed to adaptively adjust the control parameters of ADRC based on the target frequency deviation and power deviation. The actor and critic networks are continuously updated according to the actual system response to ensure stable system operation. Finally, the experiment demonstrated that the proposed method outperforms traditional methods across all performance indicators, particularly excelling in reducing adjustment time (45.8% decrease) and overshoot (60% reduction).https://www.mdpi.com/1996-1073/18/14/3610multi-region interconnected power systemenergy storage equipmentload frequency controlfirst-order active disturbance rejection controllerdeep deterministic policy gradient algorithm |
| spellingShingle | Zhenlan Dou Chunyan Zhang Xichao Zhou Dan Gao Xinghua Liu DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage Equipment Energies multi-region interconnected power system energy storage equipment load frequency control first-order active disturbance rejection controller deep deterministic policy gradient algorithm |
| title | DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage Equipment |
| title_full | DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage Equipment |
| title_fullStr | DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage Equipment |
| title_full_unstemmed | DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage Equipment |
| title_short | DDPG-ADRC-Based Load Frequency Control for Multi-Region Power Systems with Renewable Energy Sources and Energy Storage Equipment |
| title_sort | ddpg adrc based load frequency control for multi region power systems with renewable energy sources and energy storage equipment |
| topic | multi-region interconnected power system energy storage equipment load frequency control first-order active disturbance rejection controller deep deterministic policy gradient algorithm |
| url | https://www.mdpi.com/1996-1073/18/14/3610 |
| work_keys_str_mv | AT zhenlandou ddpgadrcbasedloadfrequencycontrolformultiregionpowersystemswithrenewableenergysourcesandenergystorageequipment AT chunyanzhang ddpgadrcbasedloadfrequencycontrolformultiregionpowersystemswithrenewableenergysourcesandenergystorageequipment AT xichaozhou ddpgadrcbasedloadfrequencycontrolformultiregionpowersystemswithrenewableenergysourcesandenergystorageequipment AT dangao ddpgadrcbasedloadfrequencycontrolformultiregionpowersystemswithrenewableenergysourcesandenergystorageequipment AT xinghualiu ddpgadrcbasedloadfrequencycontrolformultiregionpowersystemswithrenewableenergysourcesandenergystorageequipment |