国产伦乱,一曲二曲欧美日韩,AV在线不卡免费在线不卡免费,搞91AV视频

當(dāng)前位置:主頁 > 科技論文 > 計算機(jī)論文 >

基于HDFS的文件傳輸策略的研究與實現(xiàn)

發(fā)布時間:2018-06-13 13:20

  本文選題:HDFS + BT ; 參考:《吉林大學(xué)》2013年碩士論文


【摘要】:隨著計算機(jī)與網(wǎng)絡(luò)的迅猛發(fā)展,數(shù)據(jù)量也與日激增,據(jù)思科在其《全球云數(shù)據(jù)報告中》指出,由于用戶和企業(yè)的不受限制地訪問及應(yīng)用數(shù)據(jù)的需求,在2010至2015年期間,全球云數(shù)據(jù)流量將以每年66%的速度增長。傳統(tǒng)的分布式高性能處理平臺處理數(shù)據(jù)的能力已經(jīng)滿足不了井噴式增長的數(shù)據(jù)處理請求。應(yīng)運(yùn)而生的云計算、云存儲則滿足此類數(shù)據(jù)密集性的服務(wù)請求。 本文研究內(nèi)容是基于Hadoop的云系列服務(wù)系統(tǒng)的文件系統(tǒng)HDFS在其讀寫過程中傳輸策略的研究。旨在通過對HDFS讀寫等基本操作的效率提高及容錯來實現(xiàn)更高效率及高度容錯的文件系統(tǒng)。云存儲中的每個操作都離不開對文件系統(tǒng)的調(diào)用,對文件系統(tǒng)HDFS中最基本、最常用的讀寫操作的傳輸過程進(jìn)行研究并改進(jìn),實現(xiàn)并行讀寫及高度容錯,這會極大程度提高云存儲服務(wù)中數(shù)據(jù)的訪問速度及可用性問題。 本文首先介紹了云存儲的相關(guān)理論和技術(shù),闡釋了云存儲的定義,并對其應(yīng)用場合加以描述。緊跟著又對HDFS進(jìn)行了透徹的剖析,并對其相關(guān)技術(shù)進(jìn)行了解析和比較。隨后對HDFS讀寫容錯需要的技術(shù)進(jìn)行詳盡的描述,為接下來的研究提供的良好的技術(shù)保障。最后在通過研究HDFS讀寫機(jī)制進(jìn)行分析之后,對HDFS的讀寫機(jī)制中文件傳輸進(jìn)行改進(jìn),實現(xiàn)文件數(shù)據(jù)塊級的并行傳輸功能。從而為云存儲的高延遲及副本安全性問題提供一個可靠的解決方案。 本文主要實現(xiàn)了云存儲文件系統(tǒng)的文件系統(tǒng)HDFS中文件讀寫過程中的并行傳輸策略,及改進(jìn)的副本自動復(fù)制策略,提高了讀寫效率,降低延遲時間,為云存儲用戶提供高效并穩(wěn)定的服務(wù)。在本文的改進(jìn)策略下,充分利用了副本的存在,分散了網(wǎng)絡(luò)的負(fù)載,,數(shù)據(jù)讀的效率可提高160%,數(shù)據(jù)副本的復(fù)制效率也大大提高。
[Abstract]:With the rapid development of computers and networks, the amount of data is also increasing, according to Cisco in its Global Cloud data report, due to the unrestricted access and application data needs of users and enterprises, between 2010 and 2015, Global cloud data traffic will grow at an annual rate of 66%. The traditional distributed high performance processing platform can not meet the data processing requirements of blowout growth. Cloud computing comes into being and cloud storage meets such data-intensive service requests. This paper focuses on the research of HDFS file system based on Hadoop in the process of reading and writing. The purpose of this paper is to achieve a more efficient and highly fault-tolerant file system by improving the efficiency and fault tolerance of basic operations such as reading and writing HDFS. Every operation in cloud storage can not be separated from the call of file system. The transmission process of the most basic and commonly used read and write operations in file system HDFS is studied and improved to realize parallel reading and writing and highly fault-tolerant. This greatly improves the speed and availability of data access in cloud storage services. This paper first introduces the theory and technology of cloud storage, explains the definition of cloud storage, and describes its application. Then the HDFS is analyzed thoroughly, and the related technology is analyzed and compared. Then the technology needed for reading and writing fault tolerance in HDFS is described in detail, which provides a good technical guarantee for the following research. Finally, after analyzing the reading and writing mechanism of HDFS, the paper improves the file transmission in HDFS reading and writing mechanism, and realizes the parallel transfer function of file data block level. This provides a reliable solution for high latency and replica security problems in cloud storage. In this paper, the parallel transmission strategy in HDFS file system and the improved replica automatic replication strategy are implemented, which can improve the efficiency of reading and writing and reduce the delay time. Provide efficient and stable services for cloud storage users. Under the improved strategy of this paper, we make full use of the existence of replicas and spread the load of the network. The efficiency of data reading can be improved by 160%, and the efficiency of replication of data replicas can also be greatly improved.
【學(xué)位授予單位】:吉林大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2013
【分類號】:TP333;TP309

【參考文獻(xiàn)】

相關(guān)期刊論文 前3條

1 樊景超;周國民;;基于Lucene的“農(nóng)搜”并行索引技術(shù)研究[J];農(nóng)業(yè)網(wǎng)絡(luò)信息;2009年08期

2 吳晟;蘇慶堂;羅斌;趙莉楠;蔡燦民;;基于Socket和多線程技術(shù)的并發(fā)服務(wù)器的研究[J];昆明理工大學(xué)學(xué)報(理工版);2006年04期

3 張樹剛;張遂南;黃士坦;;CRC校驗碼并行計算的FPGA實現(xiàn)[J];計算機(jī)技術(shù)與發(fā)展;2007年02期

相關(guān)博士學(xué)位論文 前1條

1 宋瑋;分布式存儲系統(tǒng)中的節(jié)點自主性問題研究[D];華南理工大學(xué);2010年

相關(guān)碩士學(xué)位論文 前2條

1 張倩;基于Linux操作系統(tǒng)的嵌入式視頻監(jiān)控系統(tǒng)的研究與開發(fā)[D];天津工業(yè)大學(xué);2007年

2 陳華;Linux下BT客戶端的設(shè)計與實現(xiàn)[D];蘇州大學(xué);2009年



本文編號:2014151

資料下載
論文發(fā)表

本文鏈接:http://lk138.cn/kejilunwen/jisuanjikexuelunwen/2014151.html


Copyright(c)文論論文網(wǎng)All Rights Reserved | 網(wǎng)站地圖 |

版權(quán)申明:資料由用戶cf10a***提供,本站僅收錄摘要或目錄,作者需要刪除請E-mail郵箱bigeng88@qq.com
葵百合香无码一区二区| 伦理片香蕉AV| 亚洲欧美2019| 大香蕉在线视频精品观看| 色婷婷狠狠操影院| 欧美特黄一级户外| 亚洲成人福利综合在线| 欧美又大又粗又黄视频| 97青青草| 日韩精品不卡欧美影院| 免费99久久88| 亚洲 日韩 国产 一区| 99精品人妻| 日屄免费无码视频| 91亚洲黄色| 狂肏白丝美女| 中文字幕精品国产第一页| 日本不卡无码在线观看| 日本久久成人精品一二区| 色偷偷色噜噜免费| 亚洲伦理一区在线| 天天日天天干夜爽| 国内激情自拍首页| 国产色悠悠在线观看| 看黄色录像无码片| 亚洲男大鸡巴黄| 欧美的一级大黄片| 腿打开操操逼| 久久爱影院| 欧美一区无码精品| 欧美中老年黄片| 黄片免费A V| 自拍偷拍 精品一区| 麻豆mv一区| 男人天堂AV手机版免费| 麻豆天美精品视频| 福利片 一区二区| 一本色道久久888| 欧美内射入ⅹx| 国产伦理精品中文字幕| 国品一二三产区日韩|