Short term vs. long term: Optimization of microswimmer navigation on different time horizons
We use reinforcement learning to find strategies that allow microswimmers in turbulence to avoid regions of large strain. This question is motivated by the hypothesis that swimming microorganisms tend to avoid such regions to minimize the risk of predation. We ask which local cues a microswimmer mus...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Physical Society
2025-03-01
|
| Series: | Physical Review Research |
| Online Access: | http://doi.org/10.1103/PhysRevResearch.7.013258 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850034405464080384 |
|---|---|
| author | N. Mousavi J. Qiu L. Zhao B. Mehlig K. Gustavsson |
| author_facet | N. Mousavi J. Qiu L. Zhao B. Mehlig K. Gustavsson |
| author_sort | N. Mousavi |
| collection | DOAJ |
| description | We use reinforcement learning to find strategies that allow microswimmers in turbulence to avoid regions of large strain. This question is motivated by the hypothesis that swimming microorganisms tend to avoid such regions to minimize the risk of predation. We ask which local cues a microswimmer must measure to efficiently avoid such straining regions. We find that it can succeed without directional information, merely by measuring the magnitude of the local strain. However, the swimmer avoids straining regions more efficiently if it can measure the sign of local strain gradients. We compare our results with those of an earlier study [N. Mousavi et al., Phys. Rev. Res. 6, L022034 (2024)2643-156410.1103/PhysRevResearch.6.L022034] where a short-time expansion was used to find optimal strategies. We find that the short-time strategies work well in some cases, but not in others. We derive a theory that explains when the time horizon matters for our optimization problem and when it does not. We find the strategy with best performance when the time horizon coincides with the correlation time of the turbulent fluctuations. We also explain how the update frequency (the frequency at which the swimmer updates its strategy) affects the found strategies. We find that higher update frequencies yield better performance. |
| format | Article |
| id | doaj-art-4137cc89ea824fa2b004381ea541b1b7 |
| institution | DOAJ |
| issn | 2643-1564 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | American Physical Society |
| record_format | Article |
| series | Physical Review Research |
| spelling | doaj-art-4137cc89ea824fa2b004381ea541b1b72025-08-20T02:57:51ZengAmerican Physical SocietyPhysical Review Research2643-15642025-03-017101325810.1103/PhysRevResearch.7.013258Short term vs. long term: Optimization of microswimmer navigation on different time horizonsN. MousaviJ. QiuL. ZhaoB. MehligK. GustavssonWe use reinforcement learning to find strategies that allow microswimmers in turbulence to avoid regions of large strain. This question is motivated by the hypothesis that swimming microorganisms tend to avoid such regions to minimize the risk of predation. We ask which local cues a microswimmer must measure to efficiently avoid such straining regions. We find that it can succeed without directional information, merely by measuring the magnitude of the local strain. However, the swimmer avoids straining regions more efficiently if it can measure the sign of local strain gradients. We compare our results with those of an earlier study [N. Mousavi et al., Phys. Rev. Res. 6, L022034 (2024)2643-156410.1103/PhysRevResearch.6.L022034] where a short-time expansion was used to find optimal strategies. We find that the short-time strategies work well in some cases, but not in others. We derive a theory that explains when the time horizon matters for our optimization problem and when it does not. We find the strategy with best performance when the time horizon coincides with the correlation time of the turbulent fluctuations. We also explain how the update frequency (the frequency at which the swimmer updates its strategy) affects the found strategies. We find that higher update frequencies yield better performance.http://doi.org/10.1103/PhysRevResearch.7.013258 |
| spellingShingle | N. Mousavi J. Qiu L. Zhao B. Mehlig K. Gustavsson Short term vs. long term: Optimization of microswimmer navigation on different time horizons Physical Review Research |
| title | Short term vs. long term: Optimization of microswimmer navigation on different time horizons |
| title_full | Short term vs. long term: Optimization of microswimmer navigation on different time horizons |
| title_fullStr | Short term vs. long term: Optimization of microswimmer navigation on different time horizons |
| title_full_unstemmed | Short term vs. long term: Optimization of microswimmer navigation on different time horizons |
| title_short | Short term vs. long term: Optimization of microswimmer navigation on different time horizons |
| title_sort | short term vs long term optimization of microswimmer navigation on different time horizons |
| url | http://doi.org/10.1103/PhysRevResearch.7.013258 |
| work_keys_str_mv | AT nmousavi shorttermvslongtermoptimizationofmicroswimmernavigationondifferenttimehorizons AT jqiu shorttermvslongtermoptimizationofmicroswimmernavigationondifferenttimehorizons AT lzhao shorttermvslongtermoptimizationofmicroswimmernavigationondifferenttimehorizons AT bmehlig shorttermvslongtermoptimizationofmicroswimmernavigationondifferenttimehorizons AT kgustavsson shorttermvslongtermoptimizationofmicroswimmernavigationondifferenttimehorizons |