Reinforcement Learning Data-Driven Optimal Load-Frequency Control for Power Systems

INTRODUCTION: Power systems are complex due to their time-varying and uncertain parameters, challenging conventional control methods. OBJECTIVES: This study proposes an adaptive dynamic programming (ADP) controller to address this limitation. The ADP controller eliminates the need for pre-existing k...

Full description

Saved in:
Bibliographic Details
Main Author: Yi Zhao
Format: Article
Language:English
Published: European Alliance for Innovation (EAI) 2025-03-01
Series:EAI Endorsed Transactions on Energy Web
Subjects:
Online Access:https://publications.eai.eu/index.php/ew/article/view/7500
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:INTRODUCTION: Power systems are complex due to their time-varying and uncertain parameters, challenging conventional control methods. OBJECTIVES: This study proposes an adaptive dynamic programming (ADP) controller to address this limitation. The ADP controller eliminates the need for pre-existing knowledge of the system dynamics, a significant advantage in real-world applications. METHODS: By iteratively solving the Riccati equation using only system state and input data, the controller learns an approximate optimal control strategy. In this study, we use an iterative computational approach with an online adaptive optimal controller designed for unknown power system dynamics. RESULTS: Utilizing real-time collected system states and input information, even in the absence of knowledge about the power system matrix, we achieve iterative solutions for the algebraic Riccati equation, enabling the computation of an optimal controller. Simulation results demonstrate the ease of implementation of this approach in power system load frequency control (LFC). CONCLUSION: The proposed ADP controller exhibits good control performance of grid stability, making it a valuable reference for LFC, especially in scenarios with unknown system parameters.
ISSN:2032-944X