|
|
云计算环境下的改进型Map-Reduce模型
Improved Map-Reduce Model in Cloud Computing Environment
查看参考文献12篇
|
文摘
|
Map-Reduce模型在分配输入文件时没有考虑集群中大量异构节点的计算性能，导致运行map任务时网络数据传送量增加。针对该问题，提出一种云计算环境下的改进型Map-Reduce模型。根据集群中大量节点计算性能不同的特点，采用最小化最大计算时间的目标函数进行建模，利用遗传算法求解该模型得到分配方案。仿真结果证明了该模型的有效性。 |
|
其他语种文摘
|
Map-Reduce model does not consider the computing performance in large number of heterogeneous nodes when allocating the input files in the cluster,and this leads to network data transfer increase to run the map task.Addressing this issue,this paper proposes the improved Map-Reduce model under the cloud computing environment.For a large number of nodes in the cluster calculation with different performance,it raises the maximum computational time minimal objective function model,uses Genetic Algorithm(GA) to solve the model to get the distribution plan.Simulation results prove the validity of the model. |
|
来源
|
计算机工程
,2012,38(11):27-29,37 【核心库】
|
|
关键词
|
云计算
;
Map-Reduce模型
;
异构环境
;
计算性能
;
遗传算法
|
|
地址
|
四川大学计算机学院, 成都, 610065
|
|
语种
|
中文 |
|
文献类型
|
研究性论文 |
|
ISSN
|
1000-3428 |
|
学科
|
自动化技术、计算机技术 |
|
文献收藏号
|
CSCD:4564953
|
参考文献 共
12
共1页
|
|
1.
Foster I. Cloud Computing and Grid Computing 360-degree Compared.
Proc. of GCE'08,2008
|
被引
1
次
|
|
|
|
|
2.
Ghemawat S. The Google File System.
Proc. of SOSP'03,2003
|
被引
2
次
|
|
|
|
|
3.
Chang F. BigTable: A Distributed Storage System for Structured Data.
ACM Trans. on Computer Systems,2008,26(2):1-26
|
被引
78
次
|
|
|
|
|
4.
Dean J. Map-Reduce: Simplified Data Processing on Large Clusters.
Proc. of the 6th Symposium on Operating System Design and Implementation,2004
|
被引
2
次
|
|
|
|
|
5.
Nurmi D. The Eucalyptus Open-source Cloud-computing System.
Proc. of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid,2009
|
被引
1
次
|
|
|
|
|
6.
Armbrust M. Abore the Clouds: Aberkeley View of Cloud Computing.
Berkeley: Technical Report: UCB/EECS-2009-28,2009
|
被引
1
次
|
|
|
|
|
7.
Yan Baoqiang. Toward Automatic Parallelization of Spatial Computation for Computing Clusters.
Proc. of the 17th International Symposium on High Performance Distributed Computing,2008
|
被引
1
次
|
|
|
|
|
8.
Nagarajan A B. Proactive Fault Tolerance for HPC with Xen Virtualization.
Proc. of the 21st Annual International Conference on Supercomputing,2007
|
被引
1
次
|
|
|
|
|
9.
Pinar A. Exploiting Flexibly Assignable Work to Improve Load Balance.
Proc. of the 14th Annual ACM Symposium on Parallel Algorithms,2002
|
被引
1
次
|
|
|
|
|
10.
刘怡. 基于负载平衡和经验值的工作流任务分配策略.
计算机工程,2009,35(21):57-59
|
被引
6
次
|
|
|
|
|
11.
陈国良.
遗传算法及其应用,1996
|
被引
906
次
|
|
|
|
|
12.
Liang Yanchun. Solving Traveling Salesman Problem by Genetic Algorithms.
Progress in Natural Science,2003,13(2):135-142
|
被引
4
次
|
|
|
|
|
|
了解气象卫星更多信息，请访问