Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time control

Reducing combined sewer overflows and flooding is crucial for the efficient operation of urban drainage systems. Traditional real-time control (RTC) methods often fall short in efficiency and performance, which prompts the exploration of innovative approaches. Deep reinforcement learning (DRL) has r...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhenyu Huang, Yiming Wang, Xin Dong
Format: Article
Language:English
Published: Elsevier 2025-09-01
Series:Water Research X
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S258991472500012X
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823864276203339776
author Zhenyu Huang
Yiming Wang
Xin Dong
author_facet Zhenyu Huang
Yiming Wang
Xin Dong
author_sort Zhenyu Huang
collection DOAJ
description Reducing combined sewer overflows and flooding is crucial for the efficient operation of urban drainage systems. Traditional real-time control (RTC) methods often fall short in efficiency and performance, which prompts the exploration of innovative approaches. Deep reinforcement learning (DRL) has recently emerged as a promising technique to enhance RTC performance. This study evaluates the effectiveness of RTC using a multi-agent-based DRL approach. We developed a comprehensive evaluation framework incorporating multiple quantitative indicators, including control objectives, decision time, robustness, and adaptability. To validate our framework, we conducted a case study on an urban drainage system in Suzhou, China, analyzing 31 historical rainfall events. Our findings reveal that DRL can reduce flooding and overflow risks by 15.1 % to 43.5 % on average compared to conventional RTC methods. Additionally, DRL demonstrates superior efficiency, robustness, and adaptability. This study not only highlights the potential of DRL in urban drainage management but also provides insights into its broader application in enhancing the resilience of urban infrastructure systems.
format Article
id doaj-art-cd6c23f0e40c4b44ab0d9ced111728ac
institution Kabale University
issn 2589-9147
language English
publishDate 2025-09-01
publisher Elsevier
record_format Article
series Water Research X
spelling doaj-art-cd6c23f0e40c4b44ab0d9ced111728ac2025-02-09T05:01:01ZengElsevierWater Research X2589-91472025-09-0128100313Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time controlZhenyu Huang0Yiming Wang1Xin Dong2School of Environment, Tsinghua University, Beijing 10084, PR ChinaSchool of Environment, Tsinghua University, Beijing 10084, PR ChinaSchool of Environment, Tsinghua University, Beijing 10084, PR China; Environmental Simulation and Pollution Control State Key Joint Laboratory, School of Environment, Tsinghua University, Beijing 100084, PR China; Corresponding author.Reducing combined sewer overflows and flooding is crucial for the efficient operation of urban drainage systems. Traditional real-time control (RTC) methods often fall short in efficiency and performance, which prompts the exploration of innovative approaches. Deep reinforcement learning (DRL) has recently emerged as a promising technique to enhance RTC performance. This study evaluates the effectiveness of RTC using a multi-agent-based DRL approach. We developed a comprehensive evaluation framework incorporating multiple quantitative indicators, including control objectives, decision time, robustness, and adaptability. To validate our framework, we conducted a case study on an urban drainage system in Suzhou, China, analyzing 31 historical rainfall events. Our findings reveal that DRL can reduce flooding and overflow risks by 15.1 % to 43.5 % on average compared to conventional RTC methods. Additionally, DRL demonstrates superior efficiency, robustness, and adaptability. This study not only highlights the potential of DRL in urban drainage management but also provides insights into its broader application in enhancing the resilience of urban infrastructure systems.http://www.sciencedirect.com/science/article/pii/S258991472500012XUrban drainage systemsReal-time controlDeep reinforcement learningMulti-agentEvaluation framework
spellingShingle Zhenyu Huang
Yiming Wang
Xin Dong
Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time control
Water Research X
Urban drainage systems
Real-time control
Deep reinforcement learning
Multi-agent
Evaluation framework
title Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time control
title_full Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time control
title_fullStr Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time control
title_full_unstemmed Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time control
title_short Dimensions of superiority: How deep reinforcement learning excels in urban drainage system real-time control
title_sort dimensions of superiority how deep reinforcement learning excels in urban drainage system real time control
topic Urban drainage systems
Real-time control
Deep reinforcement learning
Multi-agent
Evaluation framework
url http://www.sciencedirect.com/science/article/pii/S258991472500012X
work_keys_str_mv AT zhenyuhuang dimensionsofsuperiorityhowdeepreinforcementlearningexcelsinurbandrainagesystemrealtimecontrol
AT yimingwang dimensionsofsuperiorityhowdeepreinforcementlearningexcelsinurbandrainagesystemrealtimecontrol
AT xindong dimensionsofsuperiorityhowdeepreinforcementlearningexcelsinurbandrainagesystemrealtimecontrol