Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG Algorithm
The Mobile Edge Computing (MEC) system is crucial in modern networks, particularly for applications requiring low latency and high energy efficiency. Efficient task scheduling in MEC environments to balance these requirements is challenging. This paper presented a method that improves the Deep Deter...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10757385/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850060662701555712 |
|---|---|
| author | Lihong Zhao Xiaomei Ding Shuqin Wang |
| author_facet | Lihong Zhao Xiaomei Ding Shuqin Wang |
| author_sort | Lihong Zhao |
| collection | DOAJ |
| description | The Mobile Edge Computing (MEC) system is crucial in modern networks, particularly for applications requiring low latency and high energy efficiency. Efficient task scheduling in MEC environments to balance these requirements is challenging. This paper presented a method that improves the Deep Deterministic Policy Gradient (DDPG) algorithm for better performance in MEC systems. Stability is enhanced through a soft update mechanism for target network parameters and an experience replay buffer to store past experiences, reducing sample correlation and improving training efficiency. It also proposed a reward function considering both latency and energy consumption, comparing the effects of linear and nonlinear reward functions on system performance. The task scheduling process includes state representation, action selection, environment feedback, network updates, and target network soft updates. The experimental results indicate that by analyzing the performance of different reward functions, a nonlinear reward function has been determined to achieve faster convergence. The improved DDPG algorithm outperforms traditional task scheduling algorithms in terms of latency and energy consumption under different task loads, and also has significant advantages in robustness. The ablation experiment further verified the positive contribution of each improved part to the overall performance. At Task load 10, the latency of DDPG, DDPG+Soft update, DDPG+Experience reply buffer, and this paper model were 267 ms, 263 ms, 260 ms, and 250 ms, respectively, with energy consumption of 988J, 974 J, 969 J, and 965 J. The improved DDPG algorithm in this paper not only effectively solves the task scheduling problem in MEC systems, but also provides important references for future research. |
| format | Article |
| id | doaj-art-630575de608d41199f76ca9cecc7de79 |
| institution | DOAJ |
| issn | 2169-3536 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-630575de608d41199f76ca9cecc7de792025-08-20T02:50:29ZengIEEEIEEE Access2169-35362024-01-011217284117285010.1109/ACCESS.2024.350240010757385Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG AlgorithmLihong Zhao0Xiaomei Ding1https://orcid.org/0009-0009-1179-599XShuqin Wang2School of Computer Engineering, Anhui Wenda University of Information Engineering, Hefei, ChinaSchool of Computer Engineering, Anhui Wenda University of Information Engineering, Hefei, ChinaSchool of Computer Engineering, Anhui Wenda University of Information Engineering, Hefei, ChinaThe Mobile Edge Computing (MEC) system is crucial in modern networks, particularly for applications requiring low latency and high energy efficiency. Efficient task scheduling in MEC environments to balance these requirements is challenging. This paper presented a method that improves the Deep Deterministic Policy Gradient (DDPG) algorithm for better performance in MEC systems. Stability is enhanced through a soft update mechanism for target network parameters and an experience replay buffer to store past experiences, reducing sample correlation and improving training efficiency. It also proposed a reward function considering both latency and energy consumption, comparing the effects of linear and nonlinear reward functions on system performance. The task scheduling process includes state representation, action selection, environment feedback, network updates, and target network soft updates. The experimental results indicate that by analyzing the performance of different reward functions, a nonlinear reward function has been determined to achieve faster convergence. The improved DDPG algorithm outperforms traditional task scheduling algorithms in terms of latency and energy consumption under different task loads, and also has significant advantages in robustness. The ablation experiment further verified the positive contribution of each improved part to the overall performance. At Task load 10, the latency of DDPG, DDPG+Soft update, DDPG+Experience reply buffer, and this paper model were 267 ms, 263 ms, 260 ms, and 250 ms, respectively, with energy consumption of 988J, 974 J, 969 J, and 965 J. The improved DDPG algorithm in this paper not only effectively solves the task scheduling problem in MEC systems, but also provides important references for future research.https://ieeexplore.ieee.org/document/10757385/Mobile edge computingtask schedulinglow latencyenergy consumptiondeep deterministic policy gradient |
| spellingShingle | Lihong Zhao Xiaomei Ding Shuqin Wang Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG Algorithm IEEE Access Mobile edge computing task scheduling low latency energy consumption deep deterministic policy gradient |
| title | Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG Algorithm |
| title_full | Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG Algorithm |
| title_fullStr | Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG Algorithm |
| title_full_unstemmed | Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG Algorithm |
| title_short | Implementing Low Latency and High Energy Efficiency Task Scheduling in MEC Systems Using Improved DDPG Algorithm |
| title_sort | implementing low latency and high energy efficiency task scheduling in mec systems using improved ddpg algorithm |
| topic | Mobile edge computing task scheduling low latency energy consumption deep deterministic policy gradient |
| url | https://ieeexplore.ieee.org/document/10757385/ |
| work_keys_str_mv | AT lihongzhao implementinglowlatencyandhighenergyefficiencytaskschedulinginmecsystemsusingimprovedddpgalgorithm AT xiaomeiding implementinglowlatencyandhighenergyefficiencytaskschedulinginmecsystemsusingimprovedddpgalgorithm AT shuqinwang implementinglowlatencyandhighenergyefficiencytaskschedulinginmecsystemsusingimprovedddpgalgorithm |