發(fā)布時間：2018-06-14 12:27

  本文選題：集群 + 節(jié)能優(yōu)化��； 參考：《華中科技大學(xué)》2013年碩士論文

【摘要】：計算機集群的廣泛應(yīng)用給人們帶來方便的同時，也帶來了能耗問題，如何有效地利用能源，降低不必要的能耗已成為一個迫切需要解決的關(guān)鍵問題。作為目前最熱門的海量數(shù)據(jù)處理框架，Hadoop被部署到越來越多的集群上。但是Hadoop卻一直沒有引入節(jié)能的特性，因此對Hadoop集群的節(jié)能優(yōu)化技術(shù)進行研究是非常有必要的。 基于現(xiàn)有的研究成果，結(jié)合Hadoop本身的機架感知特性和副本存放策略，提出了根據(jù)集群的負載情況調(diào)整集群規(guī)模來改善集群能源利用率的節(jié)能方案。節(jié)能方案為集群添加兩個功能模塊：集群負載監(jiān)控模塊和集群規(guī)模調(diào)整模塊。負載監(jiān)控模塊負責(zé)監(jiān)控集群的利用率，當(dāng)監(jiān)控到利用率過高或過低時會通知集群規(guī)模調(diào)整模塊對集群規(guī)模進行調(diào)整。集群規(guī)模調(diào)整模塊包含兩個重要的算法：退役節(jié)點算法和重用節(jié)點算法，集群利用率過低時會啟動退役節(jié)點算法，通過退役節(jié)點來減少集群中活躍節(jié)點數(shù)量，，以提高集群能源利用率，集群利用率過高時會啟動重用節(jié)點算法來增加集群活躍節(jié)點數(shù)量，以提高集群對任務(wù)請求的響應(yīng)速度。 通過使用GridSim工具包來對系統(tǒng)進行仿真實驗，實驗中對比了未使用節(jié)能策略的集群狀態(tài)和應(yīng)用節(jié)能策略的集群狀態(tài)，驗證了退役節(jié)點算法和重用節(jié)點算法確實能夠根據(jù)集群的負載來改變集群的規(guī)模，實驗結(jié)果表明在算法執(zhí)行過程中可以使集群節(jié)能30%以上。
[Abstract]:The extensive application of computer cluster brings people convenience and energy consumption. How to use energy effectively and reduce unnecessary energy consumption has become a key problem that needs to be solved urgently. Hadoop, the most popular mass data processing framework, is deployed to more and more clusters. However, Hadoop has not introduced the characteristics of energy saving, so it is necessary to study the energy-saving optimization technology of Hadoop cluster. Based on the existing research results, combined with Hadoop's own rack perception characteristics and replica storage strategy, an energy saving scheme is proposed to improve cluster energy efficiency by adjusting cluster scale according to the load situation of the cluster. The energy saving scheme adds two functional modules to the cluster: the cluster load monitoring module and the cluster scale adjustment module. The load monitoring module is responsible for monitoring the utilization rate of the cluster. When monitoring the utilization rate is too high or too low, the cluster size adjustment module will be notified to adjust the cluster size. The cluster scale adjustment module includes two important algorithms: the decommissioned node algorithm and the reuse node algorithm. When the cluster utilization is too low, the decommissioned node algorithm is started, and the number of active nodes in the cluster is reduced by decommissioned nodes. In order to improve the cluster energy utilization, if the cluster utilization is too high, the reuse node algorithm will be started to increase the number of active nodes in the cluster, so as to improve the response speed of the cluster to the task request. By using the GridSim toolkit to simulate the system, the cluster state without energy saving strategy and the cluster state with energy saving strategy are compared in the experiment. It is verified that the retired node algorithm and the reuse node algorithm can change the scale of the cluster according to the load of the cluster. The experimental results show that the algorithm can save more than 30% energy in the process of implementing the algorithm.
【學(xué)位授予單位】：華中科技大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2013
【分類號】：TP333

【參考文獻】

相關(guān)期刊論文 前3條

1 劉斌;楊堅;趙宇;;基于在線負載預(yù)測的動態(tài)集群節(jié)能配置策略[J];計算機工程;2010年24期

2 王軍;馮鈴;薛文偉;;服務(wù)器與集群系統(tǒng)節(jié)能技術(shù)研究[J];軟件;2011年02期

3 谷立靜;周伏秋;孟輝;;我國數(shù)據(jù)中心能耗及能效水平研究[J];中國能源;2010年11期

本文編號：2017378