Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHA
This paper proposes a Multi-Agent Quantum Deep Reinforcement Learning (MA-QDRL) framework to optimize uplink access in Irregular Repetition Slotted ALOHA with Non-Orthogonal Multiple Access (IRSA-NOMA) systems under practical constraints such as finite frame lengths and fading channels. IRSA enhance...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Open Journal of the Communications Society |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11005393/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850174546336808960 |
|---|---|
| author | Won Jae Ryu Jae-Min Lee Dong-Seong Kim |
| author_facet | Won Jae Ryu Jae-Min Lee Dong-Seong Kim |
| author_sort | Won Jae Ryu |
| collection | DOAJ |
| description | This paper proposes a Multi-Agent Quantum Deep Reinforcement Learning (MA-QDRL) framework to optimize uplink access in Irregular Repetition Slotted ALOHA with Non-Orthogonal Multiple Access (IRSA-NOMA) systems under practical constraints such as finite frame lengths and fading channels. IRSA enhances reliability by allowing devices to transmit multiple packet replicas across random time slots, while NOMA increases spectral efficiency through power-domain multiplexing with successive interference cancellation (SIC). As a benchmark, Contention Resolution Diversity Slotted ALOHA (CRDSA) improves traditional ALOHA through packet repetition and interference cancellation, maintaining solid performance under moderate network loads; however, its efficiency gradually declines under heavier traffic due to increased collisions and limited adaptability. Conventional multi-agent deep reinforcement learning (MA-CDRL) approaches have been explored to address coordination challenges in such environments. Nevertheless, these models often experience scalability limitations and unstable convergence as the number of agents increases. To overcome these challenges, MA-QDRL integrates variational quantum circuits into agents’ policy networks to improve learning efficiency and convergence. Simulation results demonstrate that MA-QDRL reduces packet loss rate by 63.2% compared to classical DRL and by 39.2% compared to CRDSA-NOMA under high network load conditions <inline-formula> <tex-math notation="LaTeX">$(G = 1.0)$ </tex-math></inline-formula>, confirming its effectiveness in highly congested IoT environments. In addition, it reduces overall computational cost compared to MA-CDRL. These results highlight the potential of MA-QDRL as a scalable and efficient solution for dynamic multi-agent wireless access in next-generation IoT networks. |
| format | Article |
| id | doaj-art-36f22bacea0d4d8aa699d6d0f1c300a8 |
| institution | OA Journals |
| issn | 2644-125X |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Open Journal of the Communications Society |
| spelling | doaj-art-36f22bacea0d4d8aa699d6d0f1c300a82025-08-20T02:19:38ZengIEEEIEEE Open Journal of the Communications Society2644-125X2025-01-0164405442010.1109/OJCOMS.2025.357044411005393Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHAWon Jae Ryu0https://orcid.org/0000-0003-1987-5969Jae-Min Lee1https://orcid.org/0000-0001-6885-5185Dong-Seong Kim2https://orcid.org/0000-0002-2977-5964ICT Convergence Research Center, Kumoh National Institute of Technology, Gumi, Republic of KoreaThe IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, Republic of KoreaThe IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, Republic of KoreaThis paper proposes a Multi-Agent Quantum Deep Reinforcement Learning (MA-QDRL) framework to optimize uplink access in Irregular Repetition Slotted ALOHA with Non-Orthogonal Multiple Access (IRSA-NOMA) systems under practical constraints such as finite frame lengths and fading channels. IRSA enhances reliability by allowing devices to transmit multiple packet replicas across random time slots, while NOMA increases spectral efficiency through power-domain multiplexing with successive interference cancellation (SIC). As a benchmark, Contention Resolution Diversity Slotted ALOHA (CRDSA) improves traditional ALOHA through packet repetition and interference cancellation, maintaining solid performance under moderate network loads; however, its efficiency gradually declines under heavier traffic due to increased collisions and limited adaptability. Conventional multi-agent deep reinforcement learning (MA-CDRL) approaches have been explored to address coordination challenges in such environments. Nevertheless, these models often experience scalability limitations and unstable convergence as the number of agents increases. To overcome these challenges, MA-QDRL integrates variational quantum circuits into agents’ policy networks to improve learning efficiency and convergence. Simulation results demonstrate that MA-QDRL reduces packet loss rate by 63.2% compared to classical DRL and by 39.2% compared to CRDSA-NOMA under high network load conditions <inline-formula> <tex-math notation="LaTeX">$(G = 1.0)$ </tex-math></inline-formula>, confirming its effectiveness in highly congested IoT environments. In addition, it reduces overall computational cost compared to MA-CDRL. These results highlight the potential of MA-QDRL as a scalable and efficient solution for dynamic multi-agent wireless access in next-generation IoT networks.https://ieeexplore.ieee.org/document/11005393/Quantum neural network (QNN)multi-agent reinforcement learningquantum deep reinforcement learning (QDRL)uplink random accessIRSA-NOMA Optimizationfinite-length frame |
| spellingShingle | Won Jae Ryu Jae-Min Lee Dong-Seong Kim Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHA IEEE Open Journal of the Communications Society Quantum neural network (QNN) multi-agent reinforcement learning quantum deep reinforcement learning (QDRL) uplink random access IRSA-NOMA Optimization finite-length frame |
| title | Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHA |
| title_full | Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHA |
| title_fullStr | Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHA |
| title_full_unstemmed | Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHA |
| title_short | Multi-Agent Quantum Reinforcement Learning for Adaptive Transmission in NOMA-Based Irregular Repetition Slotted ALOHA |
| title_sort | multi agent quantum reinforcement learning for adaptive transmission in noma based irregular repetition slotted aloha |
| topic | Quantum neural network (QNN) multi-agent reinforcement learning quantum deep reinforcement learning (QDRL) uplink random access IRSA-NOMA Optimization finite-length frame |
| url | https://ieeexplore.ieee.org/document/11005393/ |
| work_keys_str_mv | AT wonjaeryu multiagentquantumreinforcementlearningforadaptivetransmissioninnomabasedirregularrepetitionslottedaloha AT jaeminlee multiagentquantumreinforcementlearningforadaptivetransmissioninnomabasedirregularrepetitionslottedaloha AT dongseongkim multiagentquantumreinforcementlearningforadaptivetransmissioninnomabasedirregularrepetitionslottedaloha |