云环境下支持弹性伸缩的容器化工作流框架
Containerized Workflow Framework Supporting Elastic Scaling in Cloud Environment
查看参考文献17篇
|
文摘
|
云计算和容器技术为工作流的运行带来便利,但其存在管理困难、资源利用率不足以及智能和自动化程度较低等问题。为此,提出一种支持弹性伸缩的容器化工作流框架,在此基础上给出基于CPU 使用率的工作流自动伸缩模型,在流程过载时自动扩充流程的容器数目,减少任务等待时间,当任务负载减小时,能够在确保任务不丢失的情况下完成流程的缩容,以节约资源和成本。实验结果表明,流程的扩容数量与其处理时间成正相关,较好地消除工作流中的瓶颈,在工作流过载时,能够以较短的时间完成相同的任务量。 |
|
其他语种文摘
|
Cloud computing and container technology bring the convenience of the workflows operation,but there are problems such as management difficulties,insufficient resource utilization,and low intelligence and automation.Therefore,a containerized workflow framework supporting elastic scaling is proposed.On the basis of this,a workflow automatic scaling model based on CPU usage is presented,which can automatically expand the number of containers when the workflow process is overloaded,and reduce the task waiting time.When the task load is reduced,the process can be reduced while ensuring that the task is not lost to save resources and costs.Experimental results show that the number of expansions of the process is positively related to the processing time,which can better eliminate the bottleneck of the workflow.When the workflow is overloaded,the same amount of tasks can be completed in a shorter time. |
|
来源
|
计算机工程
,2019,45(3):7-13 【扩展库】
|
|
DOI
|
10.19678/j.issn.1000-3428.0049811
|
|
关键词
|
云计算
;
Docker 容器
;
工作流框架
;
弹性伸缩
;
调度策略
;
负载均衡
|
|
地址
|
国防科技大学计算机学院, 长沙, 410073
|
|
语种
|
中文 |
|
文献类型
|
研究性论文 |
|
ISSN
|
1000-3428 |
|
学科
|
自动化技术、计算机技术 |
|
基金
|
国家自然科学基金
|
|
文献收藏号
|
CSCD:6504268
|
参考文献 共
17
共1页
|
|
1.
张卫民. 科学工作流技术研究综述.
国防科技大学学报,2011,33(3):56-65
|
CSCD被引
13
次
|
|
|
|
|
2.
班爱琴. 云环境基于多工作流的任务调度节能算法的研究.
电子技术与软件工程,2015,14(1):178-182
|
CSCD被引
1
次
|
|
|
|
|
3.
Deelman E. Pegasus in the cloud: science automation through workflow technologies.
IEEE Internet Computing,2016,20(1):70-76
|
CSCD被引
3
次
|
|
|
|
|
4.
Deelman E. Pegasus: a workflow management system for science automation.
Future Generation Computer Systems,2015,46(1):17-35
|
CSCD被引
6
次
|
|
|
|
|
5.
Deelman E. Pegasus: a framework for mapping complex scientific workflows onto distributed systems.
Scientific Programming,2005,13(3):219-237
|
CSCD被引
25
次
|
|
|
|
|
6.
Majithia S. Triana: a graphical Web service composition and execution toolkit.
Proceedings of IEEE International Conference on Web Services,2004:514-521
|
CSCD被引
1
次
|
|
|
|
|
7.
Guan Z J. Grid 2 flow: a grid 2 enabled scientific workflow system with a Petri net 2 based interface.
Concurrency and Computation: Practice and Experience,2005,18(10):1115-1140
|
CSCD被引
2
次
|
|
|
|
|
8.
Laszewski G V. Features of the Java commodity grid kit.
Concurrency and Computation Practice and Experience,2010,14(13/14/15):1045-1055
|
CSCD被引
1
次
|
|
|
|
|
9.
Watson G. Scalable control and monitoring of supercomputer applications using an integrated tool framework.
Proceedings of IEEE ICPPW'11,2011:457-466
|
CSCD被引
1
次
|
|
|
|
|
10.
Liao J. A flexible I/O arbitration framework for net CDF-based big data processing workflows on high-end supercomputers.
Concurrency and Computation Practice and Experience,2017,29(15)
|
CSCD被引
1
次
|
|
|
|
|
11.
Raho M. KVM, Xen and Docker: a performance analysis for ARM based NFV and cloud computing.
Proceedings of IEEE International Conference on Information,Electronic and Electrical Engineering,2016:1-8
|
CSCD被引
1
次
|
|
|
|
|
12.
Anderson J. Performance considerations of network functions virtualization using containers.
Proceedings of IEEE International Conference on Computing, networking and Communications,2016:1-7
|
CSCD被引
1
次
|
|
|
|
|
13.
Bagheri R. Scheduling workflow applications on the heterogeneous cloud resources.
Indian Journal of Science and Technology,2015,8(12)
|
CSCD被引
1
次
|
|
|
|
|
14.
Zhang W. OpenNetVM: a platform for high performance network service chains.
Proceedings of Workshop on Hot Topics in Middle Boxes and Network Function Virtualization,2016:26-31
|
CSCD被引
1
次
|
|
|
|
|
15.
Yuce M R. Wideband communication for implantable and wearable systems.
IEEE Transactions on Microwave Theory and Techniques,2009,57(10):2597-2604
|
CSCD被引
4
次
|
|
|
|
|
16.
黄秀国. 分布式协作工作流负载平衡调度.
2005年全国软件与应用学术会议论文集,2005:516-519
|
CSCD被引
1
次
|
|
|
|
|
17.
尚世锋. CWFlow:支持资源自适应使用的云工作流框架.
清华大学学报(自然科学版),2013,53(1):415-420
|
CSCD被引
3
次
|
|
|
|
|
了解气象卫星更多信息，请访问