Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports Game
In 3 vs. 3 online basketball games, finite state machine (FSM)-based Game artificial intelligence (AI) has traditionally been employed. However, limitations such as repetitive behavior patterns and challenges in maintaining systems during redesigns have led to increased research into reinforcement l...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10845766/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832583962435780608 |
|---|---|
| author | Seongbeen Lee Gyuhyuk Lee Wongyeom Kim Junoh Kim Jisun Park Kyungeun Cho |
| author_facet | Seongbeen Lee Gyuhyuk Lee Wongyeom Kim Junoh Kim Jisun Park Kyungeun Cho |
| author_sort | Seongbeen Lee |
| collection | DOAJ |
| description | In 3 vs. 3 online basketball games, finite state machine (FSM)-based Game artificial intelligence (AI) has traditionally been employed. However, limitations such as repetitive behavior patterns and challenges in maintaining systems during redesigns have led to increased research into reinforcement learning-based AI. This shift aims to address the shortcomings of FSM-based approaches. Nevertheless, applying multi-agent reinforcement learning-based AI in commercial online basketball games presents significant challenges, particularly in ensuring real-time processing, which requires efficient methods for managing observational data. In addition, the stochastic nature of action selection in reinforcement learning complicates the accurate learning of behaviors through explicit decision data. Moreover, reinforcement learning, which self-optimizes through exploration and develops its own rules, struggles to mimic human-like behavior patterns that follow predefined strategies in Sports Game. This study introduces a human strategy-based reinforcement learning method designed to address these challenges and replicate human gameplay that adheres to human-defined strategies. The learning of human strategies is enhanced using Ray for the real-time processing of observational data and a multi-phase reward system that distinctly defines rewards based on specific objectives. Furthermore, the proposed method enables real-time, strategy-based action guidance through a Human Strategy AI trained on human-defined strategies. Experimental results demonstrate that in a stochastic basketball game environment, this approach enabled the determination of precise actions and achieved human-like gameplay through the Human Strategy AI. |
| format | Article |
| id | doaj-art-19724a70d25b4a01b55229315f7911b4 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-19724a70d25b4a01b55229315f7911b42025-01-28T00:01:46ZengIEEEIEEE Access2169-35362025-01-0113154371545210.1109/ACCESS.2025.353143510845766Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports GameSeongbeen Lee0https://orcid.org/0009-0007-4851-910XGyuhyuk Lee1Wongyeom Kim2https://orcid.org/0009-0008-4788-935XJunoh Kim3https://orcid.org/0000-0003-0882-3485Jisun Park4https://orcid.org/0000-0002-4304-1780Kyungeun Cho5https://orcid.org/0000-0003-2219-0848Department of Autonomous Things Intelligence, Dongguk University, Seoul Campus, Seoul, Republic of KoreaDepartment of Computer Science and Artificial Intelligence, Dongguk University, Seoul Campus, Seoul, Republic of KoreaDepartment of Computer Science and Artificial Intelligence, Dongguk University, Seoul Campus, Seoul, Republic of KoreaNUI/NUX Platform Research Center, Dongguk University, Seoul Campus, Seoul, Republic of KoreaNUI/NUX Platform Research Center, Dongguk University, Seoul Campus, Seoul, Republic of KoreaDivision of AI Software Convergence, Dongguk University, Seoul Campus, Seoul, Republic of KoreaIn 3 vs. 3 online basketball games, finite state machine (FSM)-based Game artificial intelligence (AI) has traditionally been employed. However, limitations such as repetitive behavior patterns and challenges in maintaining systems during redesigns have led to increased research into reinforcement learning-based AI. This shift aims to address the shortcomings of FSM-based approaches. Nevertheless, applying multi-agent reinforcement learning-based AI in commercial online basketball games presents significant challenges, particularly in ensuring real-time processing, which requires efficient methods for managing observational data. In addition, the stochastic nature of action selection in reinforcement learning complicates the accurate learning of behaviors through explicit decision data. Moreover, reinforcement learning, which self-optimizes through exploration and develops its own rules, struggles to mimic human-like behavior patterns that follow predefined strategies in Sports Game. This study introduces a human strategy-based reinforcement learning method designed to address these challenges and replicate human gameplay that adheres to human-defined strategies. The learning of human strategies is enhanced using Ray for the real-time processing of observational data and a multi-phase reward system that distinctly defines rewards based on specific objectives. Furthermore, the proposed method enables real-time, strategy-based action guidance through a Human Strategy AI trained on human-defined strategies. Experimental results demonstrate that in a stochastic basketball game environment, this approach enabled the determination of precise actions and achieved human-like gameplay through the Human Strategy AI.https://ieeexplore.ieee.org/document/10845766/Game AImulti-agent reinforcement learningsports game |
| spellingShingle | Seongbeen Lee Gyuhyuk Lee Wongyeom Kim Junoh Kim Jisun Park Kyungeun Cho Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports Game IEEE Access Game AI multi-agent reinforcement learning sports game |
| title | Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports Game |
| title_full | Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports Game |
| title_fullStr | Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports Game |
| title_full_unstemmed | Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports Game |
| title_short | Human Strategy Learning-Based Multi-Agent Deep Reinforcement Learning for Online Team Sports Game |
| title_sort | human strategy learning based multi agent deep reinforcement learning for online team sports game |
| topic | Game AI multi-agent reinforcement learning sports game |
| url | https://ieeexplore.ieee.org/document/10845766/ |
| work_keys_str_mv | AT seongbeenlee humanstrategylearningbasedmultiagentdeepreinforcementlearningforonlineteamsportsgame AT gyuhyuklee humanstrategylearningbasedmultiagentdeepreinforcementlearningforonlineteamsportsgame AT wongyeomkim humanstrategylearningbasedmultiagentdeepreinforcementlearningforonlineteamsportsgame AT junohkim humanstrategylearningbasedmultiagentdeepreinforcementlearningforonlineteamsportsgame AT jisunpark humanstrategylearningbasedmultiagentdeepreinforcementlearningforonlineteamsportsgame AT kyungeuncho humanstrategylearningbasedmultiagentdeepreinforcementlearningforonlineteamsportsgame |