DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems
Fluid-structure interaction (FSI) problems are characterized by strong nonlinearities arising from complex interactions between fluids and structures. These pose significant challenges for traditional control strategies in optimizing structural motion, often leading to suboptimal performance. In con...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2025-12-01
|
| Series: | Engineering Applications of Computational Fluid Mechanics |
| Subjects: | |
| Online Access: | https://www.tandfonline.com/doi/10.1080/19942060.2025.2460677 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849719547888664576 |
|---|---|
| author | Mai Ye Hao Ma Yaru Ren Chi Zhang Oskar J. Haidn Xiangyu Hu |
| author_facet | Mai Ye Hao Ma Yaru Ren Chi Zhang Oskar J. Haidn Xiangyu Hu |
| author_sort | Mai Ye |
| collection | DOAJ |
| description | Fluid-structure interaction (FSI) problems are characterized by strong nonlinearities arising from complex interactions between fluids and structures. These pose significant challenges for traditional control strategies in optimizing structural motion, often leading to suboptimal performance. In contrast, deep reinforcement learning (DRL), through agent interactions within numerical simulation environments and the approximation of control policies using deep neural networks (DNNs), has shown considerable promise in addressing high-dimensional FSI problems. Furthermore, the training of DRL models necessitates a stable numerical environment, particularly for FSI problems. Smoothed particle hydrodynamics (SPH) offers a flexible and efficient computational approach for modeling large deformations, fractures, and complex interface movements inherent in FSI, outperforming traditional grid-based methods. This work presents DRLinSPH, an open-source Python platform that integrates the SPH-based numerical environment provided by the open-source software SPHinXsys with the mature DRL platform Tianshou to enable parallel training for FSI problems. DRLinSPH has been successfully applied to four FSI scenarios: sloshing suppression using rigid and elastic baffles by controlling displacement or introducing deformation, achieving a maximum wave height reduction of 68.81% and 42.92%, respectively; wave energy harvesting optimization with an 8.25% improvement through an oscillating wave surge converter (OWSC) by regulating the damping characteristics of the Power Take-Off (PTO) system; and muscle-driven fish swimming control in a straight line within vortices. The results demonstrate the platform's accuracy, stability, and scalability, highlighting its potential to advance industrial solutions for complex FSI challenges. |
| format | Article |
| id | doaj-art-f1dceda0a4bb45fd8b9e2a12a4d1d579 |
| institution | DOAJ |
| issn | 1994-2060 1997-003X |
| language | English |
| publishDate | 2025-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Engineering Applications of Computational Fluid Mechanics |
| spelling | doaj-art-f1dceda0a4bb45fd8b9e2a12a4d1d5792025-08-20T03:12:08ZengTaylor & Francis GroupEngineering Applications of Computational Fluid Mechanics1994-20601997-003X2025-12-0119110.1080/19942060.2025.2460677DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problemsMai Ye0Hao Ma1Yaru Ren2Chi Zhang3Oskar J. Haidn4Xiangyu Hu5TUM School of Engineering and Design, Technical University of Munich, Garching, GermanyTUM School of Engineering and Design, Technical University of Munich, Garching, GermanyState Key Laboratory of Hydraulics and Mountain River Engineering, Sichuan University, Chengdu, People's Republic of ChinaHuawei Technologies Munich Research Center, Munich, GermanyTUM School of Engineering and Design, Technical University of Munich, Garching, GermanyTUM School of Engineering and Design, Technical University of Munich, Garching, GermanyFluid-structure interaction (FSI) problems are characterized by strong nonlinearities arising from complex interactions between fluids and structures. These pose significant challenges for traditional control strategies in optimizing structural motion, often leading to suboptimal performance. In contrast, deep reinforcement learning (DRL), through agent interactions within numerical simulation environments and the approximation of control policies using deep neural networks (DNNs), has shown considerable promise in addressing high-dimensional FSI problems. Furthermore, the training of DRL models necessitates a stable numerical environment, particularly for FSI problems. Smoothed particle hydrodynamics (SPH) offers a flexible and efficient computational approach for modeling large deformations, fractures, and complex interface movements inherent in FSI, outperforming traditional grid-based methods. This work presents DRLinSPH, an open-source Python platform that integrates the SPH-based numerical environment provided by the open-source software SPHinXsys with the mature DRL platform Tianshou to enable parallel training for FSI problems. DRLinSPH has been successfully applied to four FSI scenarios: sloshing suppression using rigid and elastic baffles by controlling displacement or introducing deformation, achieving a maximum wave height reduction of 68.81% and 42.92%, respectively; wave energy harvesting optimization with an 8.25% improvement through an oscillating wave surge converter (OWSC) by regulating the damping characteristics of the Power Take-Off (PTO) system; and muscle-driven fish swimming control in a straight line within vortices. The results demonstrate the platform's accuracy, stability, and scalability, highlighting its potential to advance industrial solutions for complex FSI challenges.https://www.tandfonline.com/doi/10.1080/19942060.2025.2460677Smoothed particle hydrodynamicsfluid-structure interactiondeep reinforcement learningsloshing suppressionoscillating wave surge converterfish swimming |
| spellingShingle | Mai Ye Hao Ma Yaru Ren Chi Zhang Oskar J. Haidn Xiangyu Hu DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems Engineering Applications of Computational Fluid Mechanics Smoothed particle hydrodynamics fluid-structure interaction deep reinforcement learning sloshing suppression oscillating wave surge converter fish swimming |
| title | DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems |
| title_full | DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems |
| title_fullStr | DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems |
| title_full_unstemmed | DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems |
| title_short | DRLinSPH: an open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems |
| title_sort | drlinsph an open source platform using deep reinforcement learning and sphinxsys for fluid structure interaction problems |
| topic | Smoothed particle hydrodynamics fluid-structure interaction deep reinforcement learning sloshing suppression oscillating wave surge converter fish swimming |
| url | https://www.tandfonline.com/doi/10.1080/19942060.2025.2460677 |
| work_keys_str_mv | AT maiye drlinsphanopensourceplatformusingdeepreinforcementlearningandsphinxsysforfluidstructureinteractionproblems AT haoma drlinsphanopensourceplatformusingdeepreinforcementlearningandsphinxsysforfluidstructureinteractionproblems AT yaruren drlinsphanopensourceplatformusingdeepreinforcementlearningandsphinxsysforfluidstructureinteractionproblems AT chizhang drlinsphanopensourceplatformusingdeepreinforcementlearningandsphinxsysforfluidstructureinteractionproblems AT oskarjhaidn drlinsphanopensourceplatformusingdeepreinforcementlearningandsphinxsysforfluidstructureinteractionproblems AT xiangyuhu drlinsphanopensourceplatformusingdeepreinforcementlearningandsphinxsysforfluidstructureinteractionproblems |