Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning Approach
A deep reinforcement learning approach is used to analyze the optimal 3-dimensional interplanetary transfers of a solar sail, accounting for various sources of uncertainty. The propulsive acceleration of the sail is described using an optical thrust model, with nominal optical coefficients derived f...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Association for the Advancement of Science (AAAS)
2025-01-01
|
| Series: | Space: Science & Technology |
| Online Access: | https://spj.science.org/doi/10.34133/space.0297 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850074678790455296 |
|---|---|
| author | Christian Bianchi Lorenzo Niccolai Giovanni Mengali |
| author_facet | Christian Bianchi Lorenzo Niccolai Giovanni Mengali |
| author_sort | Christian Bianchi |
| collection | DOAJ |
| description | A deep reinforcement learning approach is used to analyze the optimal 3-dimensional interplanetary transfers of a solar sail, accounting for various sources of uncertainty. The propulsive acceleration of the sail is described using an optical thrust model, with nominal optical coefficients derived from recently published experimental measurements. Two primary sources of uncertainty in the solar sail are considered: the imprecise knowledge of the sail’s optical properties, which impacts both the magnitude and direction of the propulsive acceleration, and the presence of wrinkles on the sail due to the folding (prior to launch) and unfolding (after release on orbit) of the ultrathin membrane. The study begins with a minimum-time interplanetary trajectory obtained using an indirect optimization technique in an unperturbed scenario, serving as the reference trajectory for the sail in the presence of model uncertainties. To account for these uncertainties, a proximal policy optimization algorithm is used to train an agent that learns a control policy associating any orbital state with the corresponding sail attitude, minimizing deviations from the reference trajectory. Two distinct scenarios are analyzed, each incorporating the aforementioned sources of uncertainty. The trained control policies are then tested through Monte Carlo simulations to evaluate their effectiveness and robustness. As a case study, a 3-dimensional transfer from Earth’s orbit to Venus’ orbit is examined, demonstrating that the control policy derived from reinforcement learning is capable of guiding the sail to its target with good accuracy, providing real-time control with relatively low computational effort. |
| format | Article |
| id | doaj-art-e1b1048ccd6e474da0b9cce9485e95ac |
| institution | DOAJ |
| issn | 2692-7659 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | American Association for the Advancement of Science (AAAS) |
| record_format | Article |
| series | Space: Science & Technology |
| spelling | doaj-art-e1b1048ccd6e474da0b9cce9485e95ac2025-08-20T02:46:29ZengAmerican Association for the Advancement of Science (AAAS)Space: Science & Technology2692-76592025-01-01510.34133/space.0297Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning ApproachChristian Bianchi0Lorenzo Niccolai1Giovanni Mengali2Department of Civil and Industrial Engineering, University of Pisa, Pisa, Italy.Department of Civil and Industrial Engineering, University of Pisa, Pisa, Italy.Department of Civil and Industrial Engineering, University of Pisa, Pisa, Italy.A deep reinforcement learning approach is used to analyze the optimal 3-dimensional interplanetary transfers of a solar sail, accounting for various sources of uncertainty. The propulsive acceleration of the sail is described using an optical thrust model, with nominal optical coefficients derived from recently published experimental measurements. Two primary sources of uncertainty in the solar sail are considered: the imprecise knowledge of the sail’s optical properties, which impacts both the magnitude and direction of the propulsive acceleration, and the presence of wrinkles on the sail due to the folding (prior to launch) and unfolding (after release on orbit) of the ultrathin membrane. The study begins with a minimum-time interplanetary trajectory obtained using an indirect optimization technique in an unperturbed scenario, serving as the reference trajectory for the sail in the presence of model uncertainties. To account for these uncertainties, a proximal policy optimization algorithm is used to train an agent that learns a control policy associating any orbital state with the corresponding sail attitude, minimizing deviations from the reference trajectory. Two distinct scenarios are analyzed, each incorporating the aforementioned sources of uncertainty. The trained control policies are then tested through Monte Carlo simulations to evaluate their effectiveness and robustness. As a case study, a 3-dimensional transfer from Earth’s orbit to Venus’ orbit is examined, demonstrating that the control policy derived from reinforcement learning is capable of guiding the sail to its target with good accuracy, providing real-time control with relatively low computational effort.https://spj.science.org/doi/10.34133/space.0297 |
| spellingShingle | Christian Bianchi Lorenzo Niccolai Giovanni Mengali Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning Approach Space: Science & Technology |
| title | Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning Approach |
| title_full | Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning Approach |
| title_fullStr | Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning Approach |
| title_full_unstemmed | Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning Approach |
| title_short | Solar Sail Transfers under Uncertainties: A Deep Reinforcement Learning Approach |
| title_sort | solar sail transfers under uncertainties a deep reinforcement learning approach |
| url | https://spj.science.org/doi/10.34133/space.0297 |
| work_keys_str_mv | AT christianbianchi solarsailtransfersunderuncertaintiesadeepreinforcementlearningapproach AT lorenzoniccolai solarsailtransfersunderuncertaintiesadeepreinforcementlearningapproach AT giovannimengali solarsailtransfersunderuncertaintiesadeepreinforcementlearningapproach |