ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge Networks
The growing demand for high-capacity content such as 3D and 360° videos highlights the need for efficient data delivery in B5G/6G networks. Multi-access edge computing (MEC) has emerged as a promising solution, but its limited memory capacity makes cache replacement strategies essential....
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11006734/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849310029863190528 |
|---|---|
| author | Minji Choi Somin Park Jin-Hyun Ahn Dong Ho Kim Cheolwoo You |
| author_facet | Minji Choi Somin Park Jin-Hyun Ahn Dong Ho Kim Cheolwoo You |
| author_sort | Minji Choi |
| collection | DOAJ |
| description | The growing demand for high-capacity content such as 3D and 360° videos highlights the need for efficient data delivery in B5G/6G networks. Multi-access edge computing (MEC) has emerged as a promising solution, but its limited memory capacity makes cache replacement strategies essential. To address this, we propose an adaptive recency masking caching (ARMC) algorithm for 360° video streaming in MEC environments. The proposed caching mechanism efficiently replaces cached data by combining two techniques: recency masking and Frequency-Filtered Least Recently Used. The use of the techniques is determined by the importance of the cache data and the available cache capacity. In addition, we introduce the concept of an observation window to improve cache performance by reflecting the recency of data request patterns. We conducted experiments using a field of view (FoV) dataset recorded from real users watching videos via head-mounted displays. Given the characteristics of 360° videos, we assumed that the MEC cache would require high-quality tiles matching the user’s FoV at each moment. Through experiments, we confirmed that the proposed method achieved a higher cache hit rate compared to existing cache replacement techniques. In particular, ARMC improved the hit rate by up to 29% compared to Least Frequency Used algorithm under constrained cache conditions of 6% or less of the total data. Higher cache hit rates contribute to reducing transmission latency and lowering bandwidth consumption. Meanwhile, the size of the observation window, a key variable in the proposed technique, varied in terms of its optimal size depending on the cache size and user viewing patterns. To address this issue, we proposed ARMC-RL, a variant of ARMC with reinforcement learning (RL) assistance, which is designed to dynamically estimate the optimal observation window size according to the given environment. Based on the experiments, ARMC-RL, depending on the learning model, achieves cache hit rates that are similar to or higher than those of ARMC and converges to the optimal observation window size by the second episode. This result confirms that ARMC-RL enables the stable automation of ARMC. Ultimately, ARMC-RL can be effectively applied to MEC-based caching systems, enabling adaptive cache optimization in response to dynamic user demand and network conditions. |
| format | Article |
| id | doaj-art-36cd3a7feb4f47c29a289445cc9d97db |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-36cd3a7feb4f47c29a289445cc9d97db2025-08-20T03:53:52ZengIEEEIEEE Access2169-35362025-01-0113880308804610.1109/ACCESS.2025.357110411006734ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge NetworksMinji Choi0https://orcid.org/0009-0009-9784-2143Somin Park1Jin-Hyun Ahn2https://orcid.org/0000-0002-1863-121XDong Ho Kim3https://orcid.org/0000-0001-6571-5865Cheolwoo You4https://orcid.org/0000-0003-3519-3490Department of Information and Communications Engineering, Myongji University, Yongin, South KoreaDepartment of Information and Communications Engineering, Myongji University, Yongin, South KoreaDepartment of Information and Communications Engineering, Myongji University, Yongin, South KoreaDepartment of Electronic and IT Media Engineering, Seoul National University of Science and Technology, Seoul, South KoreaDepartment of Information and Communications Engineering, Myongji University, Yongin, South KoreaThe growing demand for high-capacity content such as 3D and 360° videos highlights the need for efficient data delivery in B5G/6G networks. Multi-access edge computing (MEC) has emerged as a promising solution, but its limited memory capacity makes cache replacement strategies essential. To address this, we propose an adaptive recency masking caching (ARMC) algorithm for 360° video streaming in MEC environments. The proposed caching mechanism efficiently replaces cached data by combining two techniques: recency masking and Frequency-Filtered Least Recently Used. The use of the techniques is determined by the importance of the cache data and the available cache capacity. In addition, we introduce the concept of an observation window to improve cache performance by reflecting the recency of data request patterns. We conducted experiments using a field of view (FoV) dataset recorded from real users watching videos via head-mounted displays. Given the characteristics of 360° videos, we assumed that the MEC cache would require high-quality tiles matching the user’s FoV at each moment. Through experiments, we confirmed that the proposed method achieved a higher cache hit rate compared to existing cache replacement techniques. In particular, ARMC improved the hit rate by up to 29% compared to Least Frequency Used algorithm under constrained cache conditions of 6% or less of the total data. Higher cache hit rates contribute to reducing transmission latency and lowering bandwidth consumption. Meanwhile, the size of the observation window, a key variable in the proposed technique, varied in terms of its optimal size depending on the cache size and user viewing patterns. To address this issue, we proposed ARMC-RL, a variant of ARMC with reinforcement learning (RL) assistance, which is designed to dynamically estimate the optimal observation window size according to the given environment. Based on the experiments, ARMC-RL, depending on the learning model, achieves cache hit rates that are similar to or higher than those of ARMC and converges to the optimal observation window size by the second episode. This result confirms that ARMC-RL enables the stable automation of ARMC. Ultimately, ARMC-RL can be effectively applied to MEC-based caching systems, enabling adaptive cache optimization in response to dynamic user demand and network conditions.https://ieeexplore.ieee.org/document/11006734/Muli-access edge computingcaching algorithm360° video streamingquality of experiencevideo tilingreinforcement learning |
| spellingShingle | Minji Choi Somin Park Jin-Hyun Ahn Dong Ho Kim Cheolwoo You ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge Networks IEEE Access Muli-access edge computing caching algorithm 360° video streaming quality of experience video tiling reinforcement learning |
| title | ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge Networks |
| title_full | ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge Networks |
| title_fullStr | ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge Networks |
| title_full_unstemmed | ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge Networks |
| title_short | ARMC-RL: Adaptive Caching With Reinforcement Learning for Efficient 360° Video Streaming in Edge Networks |
| title_sort | armc rl adaptive caching with reinforcement learning for efficient 360 x00b0 video streaming in edge networks |
| topic | Muli-access edge computing caching algorithm 360° video streaming quality of experience video tiling reinforcement learning |
| url | https://ieeexplore.ieee.org/document/11006734/ |
| work_keys_str_mv | AT minjichoi armcrladaptivecachingwithreinforcementlearningforefficient360x00b0videostreaminginedgenetworks AT sominpark armcrladaptivecachingwithreinforcementlearningforefficient360x00b0videostreaminginedgenetworks AT jinhyunahn armcrladaptivecachingwithreinforcementlearningforefficient360x00b0videostreaminginedgenetworks AT donghokim armcrladaptivecachingwithreinforcementlearningforefficient360x00b0videostreaminginedgenetworks AT cheolwooyou armcrladaptivecachingwithreinforcementlearningforefficient360x00b0videostreaminginedgenetworks |