全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

MapReduce架构的多控制节点改进

DOI: 10.13190/jbupt.201204.89.jinj, PP. 89-93

Keywords: 云计算,MapReduce架构,多控制节点,性能瓶颈

Full-Text   Cite this paper   Add to My Lib

Abstract:

MapReduce集群系统的单一控制节点结构使其存在着性能瓶颈问题,限制了集群的规模.为较好地解决系统性能瓶颈问题,提出了MapReduce架构的多控制点改进.新系统的实现基于HadoopMapReduce,在对架构进行改进的同时,重新设计了信令系统,并增加了控制节点间的热备份机制.因此,新架构除了能解决瓶颈问题外,还可以通过控制节点间的热备份策略有效地应对控制节点故障,降低故障对集群性能的影响,保证应用的正常执行.

References

[1]  [1]Dean J, Ghemawat S. Map reduce: simplified data processing on large clusters[C]//Proceedings of the 6th Conference on Symposium on Operating Systems Design and Implementation. San Francisco: USENIX Association Berkeley, 2004: 10-10.
[2]  [2]Lmmel R. Googles mapreduce programming model revisited[J]. Science of Computer Programming, 2008, 70(1): 1-30.
[3]  [3]Murthy A C. The next generation of apache hadoop mapreduce[EB/OL]. (2011)\[2011/12/.
[4]  [4]Murthy A C. Proposal for redesign/refactoring of the jobtracker and tasktracker[EB/OL]. (2011)\[2011/12/. https:∥issues. apache. org/jira/browse/MAPREDUCE 278.
[5]  [5]Apache. Mesos: dynamic resource sharing for clusters\[EB/OL\]. (2011) \[2011/12/.
[6]  [6]Hindman B, Konwinski A, Zaharia M, et al. Mesos: a platform for fine grained resource sharing in the data center[C]//. Proceedings of the 8th USENIX conference on Networked systems design and implementation. Boston: USENIX Association Berkeley, 2011: 22-22.
[7]  [7]Apache. Hadoop mapreduce[EB/OL]. (2011)\[2011/12/.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133