Hadoop加速比性能模型研究
發(fā)布時間:2018-07-15 20:07
【摘要】:MapReduce編程模型被看作是Hadoop的核心組件,一直以來都受到廣泛的應(yīng)用和研究,但針對Hadoop云平臺的性能研究主要集中在配置調(diào)優(yōu)和分布式算法等方面,缺乏對Hadoop加速比性能模型的理論研究.針對此問題提出了Hadoop云平臺加速比性能模型,并分別在同構(gòu)機群和異構(gòu)機群架構(gòu)上對該模型進行了分析.針對同構(gòu)機群提出了3種I/O負載模型,并指出了其對加速比的影響;指出了異構(gòu)機群不適合做Hadoop云平臺的原因及異構(gòu)性對Hadoop云平臺造成的影響.這些研究對Hadoop云計算平臺的搭建及如何提高Hadoop云平臺加速比性能有很好的指導(dǎo)作用,提供了理論依據(jù).
[Abstract]:MapReduce programming model is regarded as the core component of Hadoop and has been widely used and studied. However, the performance of Hadoop cloud platform is mainly focused on configuration tuning and distributed algorithms. There is a lack of theoretical research on Hadoop speedup performance model. To solve this problem, a speedup performance model of Hadoop cloud platform is proposed, and the model is analyzed on isomorphic cluster and heterogeneous cluster architecture, respectively. Three kinds of I / O load models for isomorphic clusters are proposed, and their effects on acceleration ratio are pointed out, and the reasons why heterogeneous clusters are not suitable for Hadoop cloud platforms and the effects of heterogeneity on Hadoop cloud platforms are pointed out. These studies have a good guidance on how to build Hadoop cloud computing platform and how to improve the speedup performance of Hadoop cloud platform.
【作者單位】: 河南師范大學(xué)網(wǎng)絡(luò)中心;河南師范大學(xué)計算機與信息工程學(xué)院;
【基金】:河南省基礎(chǔ)與前沿技術(shù)研究項目(132300410389)
【分類號】:TP302.7
[Abstract]:MapReduce programming model is regarded as the core component of Hadoop and has been widely used and studied. However, the performance of Hadoop cloud platform is mainly focused on configuration tuning and distributed algorithms. There is a lack of theoretical research on Hadoop speedup performance model. To solve this problem, a speedup performance model of Hadoop cloud platform is proposed, and the model is analyzed on isomorphic cluster and heterogeneous cluster architecture, respectively. Three kinds of I / O load models for isomorphic clusters are proposed, and their effects on acceleration ratio are pointed out, and the reasons why heterogeneous clusters are not suitable for Hadoop cloud platforms and the effects of heterogeneity on Hadoop cloud platforms are pointed out. These studies have a good guidance on how to build Hadoop cloud computing platform and how to improve the speedup performance of Hadoop cloud platform.
【作者單位】: 河南師范大學(xué)網(wǎng)絡(luò)中心;河南師范大學(xué)計算機與信息工程學(xué)院;
【基金】:河南省基礎(chǔ)與前沿技術(shù)研究項目(132300410389)
【分類號】:TP302.7
【參考文獻】
相關(guān)期刊論文 前6條
1 孫健;賈曉菁;;Google云計算平臺的技術(shù)架構(gòu)及對其成本的影響研究[J];電信科學(xué);2010年01期
2 欒亞建;黃爛,
本文編號:2125235
本文鏈接:http://www.lk138.cn/kejilunwen/jisuanjikexuelunwen/2125235.html
最近更新
教材專著