Probabilistic hypergraph based hash codes for social image search

Yi XIE; Hui-min YU; Roland HU

doi:10.1631/jzus.C1300268

Your Location：

Home >

Browse articles >

Probabilistic hypergraph based hash codes for social image search

Computer & Automation | Updated：2022-05-19

- Probabilistic hypergraph based hash codes for social image search
- 基于概率超图哈希编码的社交图像检索研究
- Frontiers of Information Technology & Electronic Engineering Vol. 15, Issue 7, Pages: 537-550(2014)
- Affiliations：
  
  Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  [ "Yi XIE, E-mail: yixie@zju.edu.cn" ]
  [ "Roland HU, E-mail:yhm2005@zju.edu.cn" ]
- Funds：
- DOI：10.1631/jzus.C1300268
  CLC： TP391
- Received：26 September 2013，
  
  Revised：2014-;6-16，
  
  Published：2014-07
- Accepted：
Scan QR Code
Yi XIE, Hui-min YU, Roland HU. Probabilistic hypergraph based hash codes for social image search[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(7): 537-550.
DOI：

Yi XIE, Hui-min YU, Roland HU. Probabilistic hypergraph based hash codes for social image search[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(7): 537-550. DOI： 10.1631/jzus.C1300268.

摘要

研究目的

在过去十多年中，互联网多媒体数据爆炸性增长，数以亿计的网络图片给传统图像检索技术带来了巨大挑战。在如此庞大数据量上进行特征空间欧式距离最近邻搜索，不切实际。如何更有效地表达和检索网络图片成为当前研究热点。针对此热点和难点，本文提出了基于概率超图哈希编码的大规模图像快速检索技术。

创新要点

利用概率超图建立社交图片之间语义层面和视觉特征层面的关联性。相比简单图模型，超图模型能更有效地描述不同图片之间的高层次联系，寻找社交网络图片之间更深层次的信息。相比一般超图，概率超图能更有效地表述节点对超边的归属程度。利用超图拉普拉斯矩阵将概率超图投影到汉明（Hamming）空间，极大提升了图像存储、检索效率。

方法提亮

本方法结合了社交网络图片的视觉特征和用户标注信息，利用概率超图挖掘这两种信息的高层次关联性，并根据具体情况给予这两种信息不同权重。

重要结论

实验数据表明，与现有哈希检索方法相比，该方法对社交图像进行快速检索的准确率有较大提升。

Abstract

With the rapid development of the Internet

recent years have seen the explosive growth of social media. This brings great challenges in performing efficient and accurate image retrieval on a large scale. Recent work shows that using hashing methods to embed high-dimensional image features and tag information into Hamming space provides a powerful way to index large collections of social images. By learning hash codes through a spectral graph partitioning algorithm

spectral hashing (SH) has shown promising performance among various hashing approaches. However

it is incomplete to model the relations among images only by pairwise simple graphs which ignore the relationship in a higher order. In this paper

we utilize a probabilistic hypergraph model to learn hash codes for social image retrieval. A probabilistic hypergraph model offers a higher order representation among social images by connecting more than two images in one hyperedge. Unlike a normal hypergraph model

a probabilistic hypergraph model considers not only the grouping information

but also the similarities between vertices in hyperedges. Experiments on Flickr image datasets verify the performance of our proposed approach.

关键词

Keywords

references

A. Andoni , , , P. Indyk . . Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions . . 47th Annual IEEE Symp. on Foundations of Computer Science , , 2006 . . p.459 - - 468 . . DOI: 10.1109/FOCS.2006.49 http://doi.org/10.1109/FOCS.2006.49 . .

S. Arya , , , D.M. Mount , , , N.S. Netanyahu , , , 等 . . An optimal algorithm for approximate nearest neighbor searching fixed dimensions . . JACM , , 1998 . . 45 ( ( 6 ): ): 891 - - 923 . . DOI: 10.1145/293347.293348 http://doi.org/10.1145/293347.293348 . .

Y. Bengio , , , O. Delalleau , , , N. le Roux , , , 等 . . Learning eigenfunctions links spectral embedding and kernel PCA . . Neur. Comput. , , 2004 . . 16 ( ( 10 ): ): 2197 - - 2219 . . DOI: 10.1162/0899766041732396 http://doi.org/10.1162/0899766041732396 . .

T.S. Chua , , , J. Tang , , , R. Hong , , , 等 . . NUS-WIDE: a real-world web image database from National University of Singapore . . Proc. ACM Int. Conf. on Image and Video Retrieval , , 2009 . . p.48 DOI: 10.1145/1646396.1646452 http://doi.org/10.1145/1646396.1646452 . .

Y. Gao , , , M. Wang , , , Z.J. Zha , , , 等 . . Visual-textual joint relevance learning for tag-based social image search . . IEEE Trans. Image Process. , , 2013 . . 22 ( ( 1 ): ): 363 - - 376 . . DOI: 10.1109/TIP.2012.2202676 http://doi.org/10.1109/TIP.2012.2202676 . .

J. He , , , M. Li , , , H.J. Zhang , , , 等 . . Manifold-ranking based image retrieval . . Proc. 12th Annual ACM Int. Conf. on Multimedia , , 2004 . . 9 - - 16 . . DOI: 10.1145/1027527.1027531 http://doi.org/10.1145/1027527.1027531 . .

J. He , , , M. Li , , , H.J. Zhang , , , 等 . . Generalized manifold-ranking-based image retrieval . . IEEE Trans. Image Process. , , 2006 . . 15 ( ( 10 ): ): 3170 - - 3177 . . DOI: 10.1109/TIP.2006.877491 http://doi.org/10.1109/TIP.2006.877491 . .

G.E. Hinton , , , R.R. Salakhutdinov . . Reducing the dimensionality of data with neural networks . . Science , , 2006 . . 313 ( ( 5786 ): ): 504 - - 507 . . DOI: 10.1126/science.1127647 http://doi.org/10.1126/science.1127647 . .

Y. Huang , , , Q. Liu , , , S. Zhang , , , 等 . . Image retrieval via probabilistic hypergraph ranking . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2010 . . p.3376 - - 3383 . . DOI: 10.1109/CVPR.2010.5540012 http://doi.org/10.1109/CVPR.2010.5540012 . .

Y.G. Jiang , , , C.W. Ngo . . Bag-of-visual-words expansion using visual relatedness for video indexing . . Proc. 31st Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval , , 2008 . . p.769 - - 770 . . DOI: 10.1145/1390334.1390495 http://doi.org/10.1145/1390334.1390495 . .

P. Li , , , M. Wang , , , J. Cheng , , , 等 . . Spectral hashing with semantically consistent graph for image indexing . . IEEE Trans. Multimedia , , 2013 . . 15 ( ( 1 ): ): 141 - - 152 . . DOI: 10.1109/TMM.2012.2199970 http://doi.org/10.1109/TMM.2012.2199970 . .

H. Liu , , , P. le Pendu , , , R. Jin , , , 等 . . A hypergraph-based method for discovering semantically associated itemsets . . IEEE 11th Int. Conf. on Data Mining , , 2011 . . p.398 - - 406 . . DOI: 10.1109/ICDM.2011.12 http://doi.org/10.1109/ICDM.2011.12 . .

D.G. Lowe . . Distinctive image features from scaleinvariant keypoints . . Int. J. Comput. Vis. , , 2004 . . 60 ( ( 2 ): ): 91 - - 110 . . DOI: 10.1023/B:VISI.0000029664.99615.94 http://doi.org/10.1023/B:VISI.0000029664.99615.94 . .

R. Salakhutdinov , , , G.E. Hinton . . Learning a nonlinear embedding by preserving class neighborhood structure . . Int. Conf. on Artificial Intelligence and Statistics , , 2007 . . p.412 - - 419 . . . .

G. Shakhnarovich , , , P. Viola , , , T. Darrel . . Fast pose estimation with parameter-sensitive hashing . . Proc. 9th IEEE Int. Conf. on Computer Vision , , 2003 . . p.750 - - 757 . . DOI: 10.1109/ICCV.2003.1238424 http://doi.org/10.1109/ICCV.2003.1238424 . .

C. Silpa-Anan , , , R. Hartley . . Optimised KD-trees for fast image descriptor matching . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2008 . . p.1 - - 8 . . DOI: 10.1109/CVPR.2008.4587638 http://doi.org/10.1109/CVPR.2008.4587638 . .

A. Torralba , , , R. Fergus , , , Y. Weiss . . Small codes and large image databases for recognition . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2008 . . 1 - - 8 . . DOI: 10.1109/CVPR.2008.4587633 http://doi.org/10.1109/CVPR.2008.4587633 . .

Y. Weiss , , , A. Torralba , , , R. Fergus . . Spectral hashing . . 21st Advances in NIPS , , 2008 . . p.1753 - - 1760 . . . .

S. Xia , , , E.R. Hancock . . Clustering using class specific hyper graphs . . Structural, Syntactic, and Statistical Pattern Recognition , , 2008 . . p.318 - - 328 . . DOI: 10.1007/978-3-540-89689-0_36 http://doi.org/10.1007/978-3-540-89689-0_36 . .

J. Yang , , , Y.G. Jiang , , , A.G. Hauptmann , , , 等 . . Evaluating bag-of-visual-words representations in scene classification . . Proc. Int. Workshop on Multimedia Information Retrieval , , 2007 . . p.197 - - 206 . . DOI: 10.1145/1290082.1290111 http://doi.org/10.1145/1290082.1290111 . .

J. Yu , , , D. Tao , , , M. Wang . . Adaptive hypergraph learning and its application in image classification . . IEEE Trans. Image Process. , , 2012 . . 21 ( ( 7 ): ): 3262 - - 3272 . . DOI: 10.1109/TIP.2012.2190083 http://doi.org/10.1109/TIP.2012.2190083 . .

R. Zass , , , A. Shashua . . Probabilistic graph and hyper-graph matching . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2008 . . p.1 - - 8 . . DOI: 10.1109/CVPR.2008.4587500 http://doi.org/10.1109/CVPR.2008.4587500 . .

D. Zhang , , , J. Wang , , , D. Cai , , , 等 . . Self-taught hashing for fast similarity search . . Proc. 33rd Int. ACM SIGIR Conf. on Research and Development in Information Retrieval , , 2010 . . p.18 - - 25 . . DOI: 10.1145/1835449.1835455 http://doi.org/10.1145/1835449.1835455 . .

D. Zhou , , , O. Bousquet , , , T.N. Lal , , , 等 . . Learning with local and global consistency . . 17th Advances in NIPS , , 2004 . . p.321 - - 328 . . . .

D. Zhou , , , J. Huang , , , B. Schölkopf . . Learning with hypergraphs: clustering, classification, and embedding . . 19th Advances in NIPS , , 2006 . . p.1601 - - 1608 . . . .

Y. Zhuang , , , Y. Liu , , , F. Wu , , , 等 . . Hypergraph spectral hashing for similarity search of social image . . Proc. 19th ACM Int. Conf. on Multimedia , , 2011 . . p.1457 - - 1460 . . DOI: 10.1145/2072298.2072039 http://doi.org/10.1145/2072298.2072039 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰