Cost-Effective Resource Provisioning for Real-Time Workflow in Cloud

In the era of big data, mining and analysis of the enormous amount of data has been widely used to support decision-making. This complex process including huge-volume data collecting, storage, transmission, and analysis could be modeled as workflow. Meanwhile, cloud environment provides sufficient c...

Full description

Saved in:
Bibliographic Details
Main Authors: Lei Wu, Ran Ding, Zhaohong Jia, Xuejun Li
Format: Article
Language:English
Published: Wiley 2020-01-01
Series:Complexity
Online Access:http://dx.doi.org/10.1155/2020/1467274
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832551866470236160
author Lei Wu
Ran Ding
Zhaohong Jia
Xuejun Li
author_facet Lei Wu
Ran Ding
Zhaohong Jia
Xuejun Li
author_sort Lei Wu
collection DOAJ
description In the era of big data, mining and analysis of the enormous amount of data has been widely used to support decision-making. This complex process including huge-volume data collecting, storage, transmission, and analysis could be modeled as workflow. Meanwhile, cloud environment provides sufficient computing and storage resources for big data management and analytics. Due to the clouds providing the pay-as-you-go pricing scheme, executing a workflow in clouds should pay for the provisioned resources. Thus, cost-effective resource provisioning for workflow in clouds is still a critical challenge. Also, the responses of the complex data management process are usually required to be real-time. Therefore, deadline is the most crucial constraint for workflow execution. In order to address the challenge of cost-effective resource provisioning while meeting the real-time requirements of workflow execution, a resource provisioning strategy based on dynamic programming is proposed to achieve cost-effectiveness of workflow execution in clouds and a critical-path based workflow partition algorithm is presented to guarantee that the workflow can be completed before deadline. Our approach is evaluated by simulation experiments with real-time workflows of different sizes and different structures. The results demonstrate that our algorithm outperforms the existing classical algorithms.
format Article
id doaj-art-2891d9034ce34c28978a6ceebb53b33a
institution Kabale University
issn 1076-2787
1099-0526
language English
publishDate 2020-01-01
publisher Wiley
record_format Article
series Complexity
spelling doaj-art-2891d9034ce34c28978a6ceebb53b33a2025-02-03T06:00:11ZengWileyComplexity1076-27871099-05262020-01-01202010.1155/2020/14672741467274Cost-Effective Resource Provisioning for Real-Time Workflow in CloudLei Wu0Ran Ding1Zhaohong Jia2Xuejun Li3School of Computer Science and Technology, Anhui University, Hefei, ChinaSchool of Computer Science and Technology, Anhui University, Hefei, ChinaSchool of Computer Science and Technology, Anhui University, Hefei, ChinaSchool of Computer Science and Technology, Anhui University, Hefei, ChinaIn the era of big data, mining and analysis of the enormous amount of data has been widely used to support decision-making. This complex process including huge-volume data collecting, storage, transmission, and analysis could be modeled as workflow. Meanwhile, cloud environment provides sufficient computing and storage resources for big data management and analytics. Due to the clouds providing the pay-as-you-go pricing scheme, executing a workflow in clouds should pay for the provisioned resources. Thus, cost-effective resource provisioning for workflow in clouds is still a critical challenge. Also, the responses of the complex data management process are usually required to be real-time. Therefore, deadline is the most crucial constraint for workflow execution. In order to address the challenge of cost-effective resource provisioning while meeting the real-time requirements of workflow execution, a resource provisioning strategy based on dynamic programming is proposed to achieve cost-effectiveness of workflow execution in clouds and a critical-path based workflow partition algorithm is presented to guarantee that the workflow can be completed before deadline. Our approach is evaluated by simulation experiments with real-time workflows of different sizes and different structures. The results demonstrate that our algorithm outperforms the existing classical algorithms.http://dx.doi.org/10.1155/2020/1467274
spellingShingle Lei Wu
Ran Ding
Zhaohong Jia
Xuejun Li
Cost-Effective Resource Provisioning for Real-Time Workflow in Cloud
Complexity
title Cost-Effective Resource Provisioning for Real-Time Workflow in Cloud
title_full Cost-Effective Resource Provisioning for Real-Time Workflow in Cloud
title_fullStr Cost-Effective Resource Provisioning for Real-Time Workflow in Cloud
title_full_unstemmed Cost-Effective Resource Provisioning for Real-Time Workflow in Cloud
title_short Cost-Effective Resource Provisioning for Real-Time Workflow in Cloud
title_sort cost effective resource provisioning for real time workflow in cloud
url http://dx.doi.org/10.1155/2020/1467274
work_keys_str_mv AT leiwu costeffectiveresourceprovisioningforrealtimeworkflowincloud
AT randing costeffectiveresourceprovisioningforrealtimeworkflowincloud
AT zhaohongjia costeffectiveresourceprovisioningforrealtimeworkflowincloud
AT xuejunli costeffectiveresourceprovisioningforrealtimeworkflowincloud