Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimization
Centralized energy systems are often limited by their dependence on large, centralized power plants and extensive transmission networks, making them vulnerable to single points of failure and less resilient to disruptions. Microgrids offer resilience, enhanced energy efficiency, and improved integra...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2025-07-01
|
| Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://isprs-annals.copernicus.org/articles/X-G-2025/427/2025/isprs-annals-X-G-2025-427-2025.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849321167947563008 |
|---|---|
| author | T. Kaal A. Rafiee |
| author_facet | T. Kaal A. Rafiee |
| author_sort | T. Kaal |
| collection | DOAJ |
| description | Centralized energy systems are often limited by their dependence on large, centralized power plants and extensive transmission networks, making them vulnerable to single points of failure and less resilient to disruptions. Microgrids offer resilience, enhanced energy efficiency, and improved integration of renewable resources compared to centralized energy systems, enabling localized energy management and reduced reliance on fossil fuels. Deep Reinforcement Learning (DRL) has shown its potential for microgrid energy optimization by enabling intelligent, adaptive control over energy resources and energy exchange. By learning from interactions with the environment, the DRL agent dynamically adjusts the power outputs of distributed energy resources, manages energy storage systems, and balances energy exchange between microgrid elements and with the main grid, aiming to minimize costs and ensure reliable power availability. However, incorporating spatial relationships into DRL action space significantly increases computational demands. In line with this, we have introduced a novel method that integrates DRL, Graph Neural Network (GNN) and dynamic clustering to optimize microgrid operations. GNNs are specialized deep learning models that adapt to graphs of varying sizes and structures. This adaptability enables GNN-equipped DRL agents to effectively learn from and apply knowledge to a wide range of network topologies. The agent can be used for subsets, or sub-microgrids, taking into account the scalability and efficiency of the optimization process, enabling distance and routing optimization without an aggregated model. This approach addresses the computational challenges associated with large action spaces and varying topologies in microgrid management. |
| format | Article |
| id | doaj-art-423d42415f4a4102b43c7d2de2a438d8 |
| institution | Kabale University |
| issn | 2194-9042 2194-9050 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj-art-423d42415f4a4102b43c7d2de2a438d82025-08-20T03:49:50ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502025-07-01X-G-202542743310.5194/isprs-annals-X-G-2025-427-2025Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimizationT. Kaal0A. Rafiee1Department of Architectural Engineering and Technology, Delft University of Technology, The NetherlandsDepartment of Architectural Engineering and Technology, Delft University of Technology, The NetherlandsCentralized energy systems are often limited by their dependence on large, centralized power plants and extensive transmission networks, making them vulnerable to single points of failure and less resilient to disruptions. Microgrids offer resilience, enhanced energy efficiency, and improved integration of renewable resources compared to centralized energy systems, enabling localized energy management and reduced reliance on fossil fuels. Deep Reinforcement Learning (DRL) has shown its potential for microgrid energy optimization by enabling intelligent, adaptive control over energy resources and energy exchange. By learning from interactions with the environment, the DRL agent dynamically adjusts the power outputs of distributed energy resources, manages energy storage systems, and balances energy exchange between microgrid elements and with the main grid, aiming to minimize costs and ensure reliable power availability. However, incorporating spatial relationships into DRL action space significantly increases computational demands. In line with this, we have introduced a novel method that integrates DRL, Graph Neural Network (GNN) and dynamic clustering to optimize microgrid operations. GNNs are specialized deep learning models that adapt to graphs of varying sizes and structures. This adaptability enables GNN-equipped DRL agents to effectively learn from and apply knowledge to a wide range of network topologies. The agent can be used for subsets, or sub-microgrids, taking into account the scalability and efficiency of the optimization process, enabling distance and routing optimization without an aggregated model. This approach addresses the computational challenges associated with large action spaces and varying topologies in microgrid management.https://isprs-annals.copernicus.org/articles/X-G-2025/427/2025/isprs-annals-X-G-2025-427-2025.pdf |
| spellingShingle | T. Kaal A. Rafiee Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimization ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimization |
| title_full | Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimization |
| title_fullStr | Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimization |
| title_full_unstemmed | Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimization |
| title_short | Deep Reinforcement Learning-Graph Neural Networks-Dynamic Clustering triplet for Adaptive Multi Energy Microgrid optimization |
| title_sort | deep reinforcement learning graph neural networks dynamic clustering triplet for adaptive multi energy microgrid optimization |
| url | https://isprs-annals.copernicus.org/articles/X-G-2025/427/2025/isprs-annals-X-G-2025-427-2025.pdf |
| work_keys_str_mv | AT tkaal deepreinforcementlearninggraphneuralnetworksdynamicclusteringtripletforadaptivemultienergymicrogridoptimization AT arafiee deepreinforcementlearninggraphneuralnetworksdynamicclusteringtripletforadaptivemultienergymicrogridoptimization |