An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-Learning

In the fog computing paradigm, if the computing resources of an end device are insufficient, the user’s tasks can be offloaded to nearby devices or the central cloud. In addition, due to the limited energy of mobile devices, optimal offloading is crucial. The method presented in this paper is based...

Full description

Saved in:
Bibliographic Details
Main Authors: Reza Besharati, Mohammad Hossein Rezvani, Mohammad Mehdi Gilanian Sadeghi
Format: Article
Language:English
Published: Wiley 2023-01-01
Series:Complexity
Online Access:http://dx.doi.org/10.1155/2023/5222504
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849387265940258816
author Reza Besharati
Mohammad Hossein Rezvani
Mohammad Mehdi Gilanian Sadeghi
author_facet Reza Besharati
Mohammad Hossein Rezvani
Mohammad Mehdi Gilanian Sadeghi
author_sort Reza Besharati
collection DOAJ
description In the fog computing paradigm, if the computing resources of an end device are insufficient, the user’s tasks can be offloaded to nearby devices or the central cloud. In addition, due to the limited energy of mobile devices, optimal offloading is crucial. The method presented in this paper is based on the auction theory, which has been used in recent studies to optimize computation offloading. We propose a bid prediction mechanism using Q-learning. Nodes participating in the auction announce a bid value to the auctioneer entity, and the node with the highest bid value is the auction winner. Then, only the winning node has the right to offload the tasks on its upstream (parent) node. The main idea behind Q-learning is that it is stateless and only considers the current state to perform an action. The evaluation results show that the bid values predicted by the Q-learning method are near-optimal. On average, the proposed method consumes less energy than traditional and state-of-the-art techniques. Also, it reduces the execution time of tasks and leads to less consumption of network resources.
format Article
id doaj-art-2f30a16276624b2abe38f4ff0dca0b23
institution Kabale University
issn 1099-0526
language English
publishDate 2023-01-01
publisher Wiley
record_format Article
series Complexity
spelling doaj-art-2f30a16276624b2abe38f4ff0dca0b232025-08-20T03:55:16ZengWileyComplexity1099-05262023-01-01202310.1155/2023/5222504An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-LearningReza Besharati0Mohammad Hossein Rezvani1Mohammad Mehdi Gilanian Sadeghi2Department of Computer and Information Technology EngineeringDepartment of Computer and Information Technology EngineeringDepartment of Computer and Information Technology EngineeringIn the fog computing paradigm, if the computing resources of an end device are insufficient, the user’s tasks can be offloaded to nearby devices or the central cloud. In addition, due to the limited energy of mobile devices, optimal offloading is crucial. The method presented in this paper is based on the auction theory, which has been used in recent studies to optimize computation offloading. We propose a bid prediction mechanism using Q-learning. Nodes participating in the auction announce a bid value to the auctioneer entity, and the node with the highest bid value is the auction winner. Then, only the winning node has the right to offload the tasks on its upstream (parent) node. The main idea behind Q-learning is that it is stateless and only considers the current state to perform an action. The evaluation results show that the bid values predicted by the Q-learning method are near-optimal. On average, the proposed method consumes less energy than traditional and state-of-the-art techniques. Also, it reduces the execution time of tasks and leads to less consumption of network resources.http://dx.doi.org/10.1155/2023/5222504
spellingShingle Reza Besharati
Mohammad Hossein Rezvani
Mohammad Mehdi Gilanian Sadeghi
An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-Learning
Complexity
title An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-Learning
title_full An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-Learning
title_fullStr An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-Learning
title_full_unstemmed An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-Learning
title_short An Auction-Based Bid Prediction Mechanism for Fog-Cloud Offloading Using Q-Learning
title_sort auction based bid prediction mechanism for fog cloud offloading using q learning
url http://dx.doi.org/10.1155/2023/5222504
work_keys_str_mv AT rezabesharati anauctionbasedbidpredictionmechanismforfogcloudoffloadingusingqlearning
AT mohammadhosseinrezvani anauctionbasedbidpredictionmechanismforfogcloudoffloadingusingqlearning
AT mohammadmehdigilaniansadeghi anauctionbasedbidpredictionmechanismforfogcloudoffloadingusingqlearning
AT rezabesharati auctionbasedbidpredictionmechanismforfogcloudoffloadingusingqlearning
AT mohammadhosseinrezvani auctionbasedbidpredictionmechanismforfogcloudoffloadingusingqlearning
AT mohammadmehdigilaniansadeghi auctionbasedbidpredictionmechanismforfogcloudoffloadingusingqlearning