面向檢索的多視覺特征融合
發(fā)布時(shí)間：2018-11-05 09:32
【摘要】：近幾十年來,伴隨著互聯(lián)網(wǎng)的快速發(fā)展以及智能終端的普及,互聯(lián)網(wǎng)上數(shù)字圖像的數(shù)量呈現(xiàn)爆炸式增長。面對(duì)海量的圖像信息,如何快速高效地檢索這些圖像一直是學(xué)術(shù)界和工業(yè)界研究的熱點(diǎn)課題。圖像的特征表達(dá)是基于內(nèi)容的圖像檢索的最基本問題之一。為了提升檢索的準(zhǔn)確度,研究人員從顏色、紋理等不同的角度提出不同的視覺特征表達(dá)來表征圖像。選擇不同的視覺特征對(duì)于圖像檢索的準(zhǔn)確度有很大的影響。一般來說,采用具有一定互補(bǔ)性的多種特征進(jìn)行融合是提升圖像檢索準(zhǔn)確度的一種方法。為了把基于不同特征得到的圖像檢索結(jié)果融合在一起,我們有兩個(gè)關(guān)鍵的問題需要解決。第一個(gè)關(guān)鍵問題是如何使基于不同特征空間的距離度量是可比擬的。因?yàn)橥ǔＪ褂貌煌奶卣?如SIFT,HSV,CNN特征,算得的距離是不在一個(gè)尺度空間的。直接把不在一個(gè)尺度空間的"距離"進(jìn)行相加是不合適的。第二個(gè)需要關(guān)注的關(guān)鍵的問題是,如何自適應(yīng)的度量不同的特征的有效性。因?yàn)閷?duì)于某些查詢圖像來說,局部特征就能取得較好的檢索結(jié)果。然而對(duì)于另外某些查詢圖像,用全局特征比如CNN特征才能夠得到比較好的檢索結(jié)果。對(duì)于同一個(gè)查詢圖像,我們需要比較并量化不同特征的有效性�；谏厦娴膬蓚�(gè)關(guān)鍵點(diǎn),我們的工作主要?dú)w納如下:(1)基于圖模型的自適應(yīng)加權(quán)特征融合方法。在此方法中,圖模型把本來在不同尺度空間的距離度量,都統(tǒng)一到一個(gè)Graph里面,并用統(tǒng)一的度量方法Jaccard系數(shù)來度量各個(gè)圖片之間的相似度。同時(shí)為了衡量不同特征的有效性,我們使用PageRank算法對(duì)不同特征構(gòu)建的圖進(jìn)行分析,并根據(jù)最后得到的PageRank值的分布來衡量不同特征的有效性。最后根據(jù)特征對(duì)特定檢索圖像的有效性,完成不同特征構(gòu)建的圖的自適應(yīng)加權(quán)融合。根據(jù)最后融合得到的圖,我們解出最后的圖片檢索排序。(2)基于鄰域相似度分布的自適應(yīng)多特征融合方法。該方法是根據(jù)圖像在給定的視覺特征下的近鄰空間的分布情況,來進(jìn)行特征融合。不同特征對(duì)于一個(gè)具體的查詢圖像得到的k近鄰的距離空間分布是不一樣的。我們通過探索k近鄰的空間分布特性,來進(jìn)行衡量不同特征的有效性。我們提出了有效性系數(shù)的概念-REC(Rank Effectiveness Coefficient)。REC 反映 了一個(gè)特征對(duì)一個(gè)具體圖像的有效性。通過有效性系數(shù)對(duì)原來特征的相似度進(jìn)行加權(quán)融合,最后得到融合后的相似度得分。根據(jù)融合后的相似度得分,可以給出最后的圖像檢索排序結(jié)果。
[Abstract]:In recent decades, with the rapid development of the Internet and the popularity of intelligent terminals, the number of digital images on the Internet has increased explosively. In the face of massive image information, how to retrieve these images quickly and efficiently has been a hot topic in academia and industry. Image feature representation is one of the most basic problems in content-based image retrieval. In order to improve the retrieval accuracy, the researchers proposed different visual features to represent the image from different angles such as color and texture. The selection of different visual features has great influence on the accuracy of image retrieval. Generally speaking, it is a method to improve the accuracy of image retrieval by using a variety of complementary features. In order to fuse the image retrieval results based on different features, we have two key problems to be solved. The first key problem is how to make distance metrics based on different feature spaces comparable. Because different features, such as SIFT,HSV,CNN features, are usually used, the distance calculated is not in the same scale space. It is not appropriate to add "distances" that are not in a scale space directly. The second key concern is how to measure the effectiveness of different features adaptively. Because for some query images, local features can obtain better retrieval results. However, for some other queried images, global features such as CNN features are used to obtain better retrieval results. For the same query image, we need to compare and quantify the validity of different features. Based on the above two key points, our work is summarized as follows: (1) Adaptive weighted feature fusion method based on graph model. In this method, the graph model unifies the distance measure in different scale space into one Graph, and uses the unified measure method Jaccard coefficient to measure the similarity of each picture. At the same time, in order to evaluate the validity of different features, we use PageRank algorithm to analyze the graph constructed by different features, and evaluate the validity of different features according to the distribution of PageRank values. Finally, according to the validity of the feature to the specific retrieval image, the adaptive weighted fusion of the graph constructed by different features is completed. According to the final fusion graph, we solve the final image retrieval ranking. (2) Adaptive multi-feature fusion method based on neighborhood similarity distribution. This method is based on the distribution of the image in the nearest neighbor space under the given visual features. The distance distribution of k-nearest neighbor is different for a specific query image with different features. We evaluate the effectiveness of different features by exploring the spatial distribution of k-nearest neighbors. We propose the concept of validity coefficient-REC (Rank Effectiveness Coefficient). REC reflects the validity of a feature to a specific image. The similarity of the original feature is weighted by the validity coefficient, and the score of the similarity after the fusion is obtained. According to the similarity score of fusion, the final result of image retrieval and sorting can be given.
【學(xué)位授予單位】：中國科學(xué)技術(shù)大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP391.41
本文編號(hào)：2311654
[Abstract]:In recent decades, with the rapid development of the Internet and the popularity of intelligent terminals, the number of digital images on the Internet has increased explosively. In the face of massive image information, how to retrieve these images quickly and efficiently has been a hot topic in academia and industry. Image feature representation is one of the most basic problems in content-based image retrieval. In order to improve the retrieval accuracy, the researchers proposed different visual features to represent the image from different angles such as color and texture. The selection of different visual features has great influence on the accuracy of image retrieval. Generally speaking, it is a method to improve the accuracy of image retrieval by using a variety of complementary features. In order to fuse the image retrieval results based on different features, we have two key problems to be solved. The first key problem is how to make distance metrics based on different feature spaces comparable. Because different features, such as SIFT,HSV,CNN features, are usually used, the distance calculated is not in the same scale space. It is not appropriate to add "distances" that are not in a scale space directly. The second key concern is how to measure the effectiveness of different features adaptively. Because for some query images, local features can obtain better retrieval results. However, for some other queried images, global features such as CNN features are used to obtain better retrieval results. For the same query image, we need to compare and quantify the validity of different features. Based on the above two key points, our work is summarized as follows: (1) Adaptive weighted feature fusion method based on graph model. In this method, the graph model unifies the distance measure in different scale space into one Graph, and uses the unified measure method Jaccard coefficient to measure the similarity of each picture. At the same time, in order to evaluate the validity of different features, we use PageRank algorithm to analyze the graph constructed by different features, and evaluate the validity of different features according to the distribution of PageRank values. Finally, according to the validity of the feature to the specific retrieval image, the adaptive weighted fusion of the graph constructed by different features is completed. According to the final fusion graph, we solve the final image retrieval ranking. (2) Adaptive multi-feature fusion method based on neighborhood similarity distribution. This method is based on the distribution of the image in the nearest neighbor space under the given visual features. The distance distribution of k-nearest neighbor is different for a specific query image with different features. We evaluate the effectiveness of different features by exploring the spatial distribution of k-nearest neighbors. We propose the concept of validity coefficient-REC (Rank Effectiveness Coefficient). REC reflects the validity of a feature to a specific image. The similarity of the original feature is weighted by the validity coefficient, and the score of the similarity after the fusion is obtained. According to the similarity score of fusion, the final result of image retrieval and sorting can be given.
【學(xué)位授予單位】：中國科學(xué)技術(shù)大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP391.41
【參考文獻(xiàn)】
相關(guān)期刊論文 前1條
1 周文罡;李厚強(qiáng);盧亦娟;田奇;;Encoding Spatial Context for Large-Scale Partial-Duplicate Web Image Retrieval[J];Journal of Computer Science & Technology;2014年05期
，本文編號(hào)：2311654
本文鏈接：http://www.lk138.cn/shoufeilunwen/xixikjs/2311654.html
最近更新
教材專著
