Study on Liutex-driven reward for intelligent flow control by dynamic feature-based deep reinforcement learning

The issue of flow separation over an airfoil under weak turbulent conditions is addressed and resolved through the deep reinforcement learning (DRL) strategy. To suppress the generation of separation flow and the instability of the vortex shedding alley over an airfoil, a novel reward function named...

Full description

Saved in:
Bibliographic Details
Main Authors: Qi Wang, Xiangrui Dong, Sunyu You, Xiaoshu Cai
Format: Article
Language:English
Published: AIP Publishing LLC 2025-05-01
Series:AIP Advances
Online Access:http://dx.doi.org/10.1063/5.0271616
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The issue of flow separation over an airfoil under weak turbulent conditions is addressed and resolved through the deep reinforcement learning (DRL) strategy. To suppress the generation of separation flow and the instability of the vortex shedding alley over an airfoil, a novel reward function named RLiutex, considering the suppression of the rigid rotation intensity and core size of the vortex, is first proposed in this paper. The great potential of this Liutex-driven reward for effective large eddy elimination and aerodynamic optimization is verified in this work. Furthermore, a dynamic feature-based DRL (DF-DRL) framework is redeveloped to markedly enhance the learning efficiency and convergence speed. The combination of the Liutex-driven reward function with the DF-DRL framework results in an exceptional aerodynamic performance, with minimal fluctuations in both drag and lift coefficients, highlighting the potential of this approach for advanced flow control strategies.
ISSN:2158-3226