Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems
INTRODUCTION: Power systems are complex due to their time-varying and uncertain parameters, challenging conventional control methods. OBJECTIVES: This study proposes an adaptive dynamic programming (ADP) controller to address this limitation. The ADP controller eliminates the need for pre-existing k...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
European Alliance for Innovation (EAI)
2025-03-01
|
| Series: | EAI Endorsed Transactions on Energy Web |
| Subjects: | |
| Online Access: | https://publications.eai.eu/index.php/ew/article/view/7500 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850232711359234048 |
|---|---|
| author | Yi Zhao |
| author_facet | Yi Zhao |
| author_sort | Yi Zhao |
| collection | DOAJ |
| description | INTRODUCTION: Power systems are complex due to their time-varying and uncertain parameters, challenging conventional control methods.
OBJECTIVES: This study proposes an adaptive dynamic programming (ADP) controller to address this limitation. The ADP controller eliminates the need for pre-existing knowledge of the system dynamics, a significant advantage in real-world applications.
METHODS: By iteratively solving the Riccati equation using only system state and input data, the controller learns an approximate optimal control strategy. In this study, we use an iterative computational approach with an online adaptive optimal controller designed for unknown power system dynamics.
RESULTS: Utilizing real-time collected system states and input information, even in the absence of knowledge about the power system matrix, we achieve iterative solutions for the algebraic Riccati equation, enabling the computation of an optimal controller. Simulation results demonstrate the ease of implementation of this approach in power system load frequency control (LFC).
CONCLUSION: The proposed ADP controller exhibits good control performance of grid stability, making it a valuable reference for LFC, especially in scenarios with unknown system parameters.
|
| format | Article |
| id | doaj-art-3e665486ed8a4b86874b138cff9d729f |
| institution | OA Journals |
| issn | 2032-944X |
| language | English |
| publishDate | 2025-03-01 |
| publisher | European Alliance for Innovation (EAI) |
| record_format | Article |
| series | EAI Endorsed Transactions on Energy Web |
| spelling | doaj-art-3e665486ed8a4b86874b138cff9d729f2025-08-20T02:03:06ZengEuropean Alliance for Innovation (EAI)EAI Endorsed Transactions on Energy Web2032-944X2025-03-011210.4108/ew.7500Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power SystemsYi Zhao0Northeast Agricultural University INTRODUCTION: Power systems are complex due to their time-varying and uncertain parameters, challenging conventional control methods. OBJECTIVES: This study proposes an adaptive dynamic programming (ADP) controller to address this limitation. The ADP controller eliminates the need for pre-existing knowledge of the system dynamics, a significant advantage in real-world applications. METHODS: By iteratively solving the Riccati equation using only system state and input data, the controller learns an approximate optimal control strategy. In this study, we use an iterative computational approach with an online adaptive optimal controller designed for unknown power system dynamics. RESULTS: Utilizing real-time collected system states and input information, even in the absence of knowledge about the power system matrix, we achieve iterative solutions for the algebraic Riccati equation, enabling the computation of an optimal controller. Simulation results demonstrate the ease of implementation of this approach in power system load frequency control (LFC). CONCLUSION: The proposed ADP controller exhibits good control performance of grid stability, making it a valuable reference for LFC, especially in scenarios with unknown system parameters. https://publications.eai.eu/index.php/ew/article/view/7500Power systemreinforcement learningdata-drivendynamic programmingLoad frequency control |
| spellingShingle | Yi Zhao Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems EAI Endorsed Transactions on Energy Web Power system reinforcement learning data-driven dynamic programming Load frequency control |
| title | Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems |
| title_full | Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems |
| title_fullStr | Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems |
| title_full_unstemmed | Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems |
| title_short | Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems |
| title_sort | reinforcement learning data driven optimal load frequency control for power systems |
| topic | Power system reinforcement learning data-driven dynamic programming Load frequency control |
| url | https://publications.eai.eu/index.php/ew/article/view/7500 |
| work_keys_str_mv | AT yizhao reinforcementlearningdatadrivenoptimalloadfrequencycontrolforpowersystems |