|
基于启发式算法的混合云工作流调度算法
|
Abstract:
伴随着“互联网+”技术的飞速发展,世界各地的网络环境越来越好,通过云计算技术操作异地计算资源的情况也越来越多。其中当本地资源不足时,私有云、公有云混合的混合云方案被各大企业广泛应用,本文针对混合云环境中的工作流任务调度问题,研究在满足任务截止期约束的同时使私有云利润最大化,节约企业成本。在私有云环境中,本文提出了一种优化的蚁群算法(Ant Colony Optimization Workflow Scheduling, ACOWS)用于工作流在用户指定的期限内完成任务的执行。在此基础上提出混合云下的动态多工作流调度算法(Hybrid Cloud Deadline-Constrained Cost Workflows Scheduling, HCDCW),该算法将优先在私有云中调度执行,当任务执行时间超出任务截止期约束时,使用公有云调度部分工作流。在实验阶段,利用WorkflowSim仿真平台对算法进行了验证,实验结果表明在不同截止期,该调度算法相比于传统混合云工作流调度算法能有效的帮助企业在使用混合云过程中降低租用公有云的费用成本,并获得更快的执行时间。
With the rapid development of the “Internet+” technology, the network environment around the world is getting better and better, and there are more and more cases of operating remote computing resources through cloud computing technology. Among them, when the local resources are in-sufficient, the hybrid cloud solution of private cloud and public cloud is widely used by major enterprises. This article focuses on the workflow task scheduling problem in the hybrid cloud environment, and researches to maximize private cloud profits while meeting task deadline constraints, to save business costs. In a private cloud environment, an optimized Ant Colony Optimization Work- flow Scheduling (ACOWS) is proposed in the article for the workflow to complete the execution of tasks within the time limit specified by the user. On this basis, a dynamic multi-workflow scheduling algorithm (Hybrid Cloud Deadline-Constrained Cost Workflows Scheduling, HCDCW) under the hybrid cloud is proposed. The algorithm will be scheduled and executed in the private cloud first. When the task execution time exceeds the task deadline constraint, use the public cloud to schedule part of the workflow. In the experimental phase, the algorithm was verified using the Work-flowSim simulation platform. The experimental results show that compared with traditional hybrid cloud workflow scheduling algorithms, this scheduling algorithm can effectively help enterprises reduce the cost of renting public clouds in the process of using hybrid clouds at different deadlines, and get faster execution time.
[1] | Barbosa, F.P. and Char?o, A.S. (2012) Impact of Pay-as-You-Go Cloud Platforms on Software Pricing and Development: A Review and Case Study. In: Murgante, B., et al., Eds., Computational Science and Its Applications—ICCSA 2012. Lecture Notes in Computer Science, 7336, 404-417.
https://doi.org/10.1007/978-3-642-31128-4_30 |
[2] | 田倬璟, 黄震春, 张益农. 云计算环境任务调度方法研究综述[J]. 计算机工程与应用, 2021, 57(2): 1-11. |
[3] | Topcuoglu, H., Hariri, S. and Wu, M.Y. (2002) Perfor-mance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing. IEEE Transactions on Parallel and Distributed Systems, 13, 260-274.
https://doi.org/10.1109/71.993206 |
[4] | Hwang, J.J., Chow, Y.C., Anger, F.D., et al. (1989) Scheduling Prece-dence Graphs in Systems with Interprocessor Communication Times. SIAM Journal on Computing, 18, 244-257. https://doi.org/10.1137/0218016 |
[5] | Lin, C. and Lu, S.Y. (2011) Scheduling Scientific Workflows Elastically for Cloud Computing. 2011 IEEE 4th International Conference on Cloud Computing, 2011, 746-747.
https://doi.org/10.1109/CLOUD.2011.110 |
[6] | Zhou, J.L., Wang, T. and Cong, P.J. (2019) Cost and Makespan-Aware Workflow Scheduling in Hybrid Clouds. Journal of Systems Architecture, 100, Article No. 101631. https://doi.org/10.1016/j.sysarc.2019.08.004 |
[7] | Ritchie, G. and Levine, J. (2003) A Fast, Effective Local Search for Scheduling Independent Jobs in Heterogeneous Computing Environments. Proceedings of the 22nd Workshop of the UK Planning and Scheduling Special Interest Group, Article ID: 15882331.
https://www.semanticscholar.org/paper/A-fast%2C-effective-local-search-for-scheduling-jobs-Ritchie-Levine/cd4153cd3906897827cc2b537211c004ff95e89c |
[8] | Mo, L., Kritikakou, A. and Sentieys, O. (2019) Approximation-Aware Task Deployment on Asymmetric Multicore Processors. 2019 Design, Automation & Test in Europe Conference & Ex-hibition (DATE), 2019, 1492-1497.
https://doi.org/10.23919/DATE.2019.8715077 |
[9] | Chen, W. and Deelman, E. (2012) WorkflowSim: A Toolkit for Simulating Scientific Workflows in Distributed Environments. 2012 IEEE 8th International Conference on E-Science, 2012, 1-8.
https://doi.org/10.1109/eScience.2012.6404430 |
[10] | Calheiros, R.N., Ranjan, R., Beloglazov, A., et al. (2011) CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Pro-visioning Algorithms. Software: Practice and Experience, 41, 23-50. https://doi.org/10.1002/spe.995 |
[11] | Bharathi, S., Chervenak, A., Deelman, E., Mehta, G., Su, M. and Vahi, K. (2008) Characterization of Scientific Workflows. 2008 Third Workshop on Workflows in Support of Large-Scale Science, 2008, 1-10.
https://doi.org/10.1109/WORKS.2008.4723958 |