A review of object representation based on local features

CAO Jian; MAO Dian-hui; CAI Qiang; LI Hai-sheng; DU Jun-ping

doi:10.1631/jzus.CIDE1303

Your Location：

Home >

Browse articles >

A review of object representation based on local features

数据驱动的数字娱乐最新进展专辑 | Updated：2022-06-06

- A review of object representation based on local features
- A review of object representation based on local features
- 信息与电子工程前沿（英文） 2013年14卷第7期页码：495-504
- Affiliations：
  
  1.College of Computer and Information Engineering, Beijing Technology and Business University, Beijing 100048, China
  2.School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China
- Author bio：
  
  [ "Jian CAO, E-mail: caojian@th.btbu.edu.cn; caojian9527@sina.com" ]
- Funds：
  
  Project supported by the National Basic Research Program (973) of China (No. 2012CB821206), the National Natural Science Foundation of China (No. 71201004), the Scientific Research Common Program of Beijing Municipal Commission of Education (No. KM201310011009), and the Funding Project for Innovation on Science, Technology and Graduate Education in Institutions of Higher Learning under the Jurisdiction of Beijing Municipality (Nos. PXM2012_014213_000037 and PXM2012_014213_000079)
- DOI：10.1631/jzus.CIDE1303
  中图分类号： TP391.41
- 收稿：2012-12-29，
  
  修回：2013-06-06，
  
  纸质出版：2013-07
- Accepted：
Scan QR Code
A review of object representation based on local features[J]. 信息与电子工程前沿（英文）, 2013,14(7):495-504.

CAO Jian, MAO Dian-hui, CAI Qiang, et al. A review of object representation based on local features[J]. Frontiers of Information Technology & Electronic Engineering, 2013, 14(7): 495-504.
A review of object representation based on local features[J]. 信息与电子工程前沿（英文）, 2013,14(7):495-504. DOI： 10.1631/jzus.CIDE1303.

CAO Jian, MAO Dian-hui, CAI Qiang, et al. A review of object representation based on local features[J]. Frontiers of Information Technology & Electronic Engineering, 2013, 14(7): 495-504. DOI： 10.1631/jzus.CIDE1303.

摘要

Abstract

Object representation based on local features is a topical subject in the domain of image understanding and computer vision. We discuss the defects of global features in present methods and the advantages of local features in object recognition

and briefly explore state-of-the-art recognition methods using local features

especially the main approaches of local feature extraction and object representation. To clearly explain these methods

the problem of local feature extraction is divided into feature region detection

feature region description

and feature space optimization. The main components and merits of these steps are presented. Technologies for object presentation are classified into three types: vector space

sliding window

and structure relationship models. Future development trends are discussed briefly.

关键词

Keywords

references

S. Agarwal , A. Awan , D. Roth . Learning to detect objects in images via a sparse, part-based representation . IEEE Trans. Pattern Anal. Mach. Intell. , 2004 . 26 ( 11 ): 1475 - 1490 . DOI: 10.1109/TPAMI.2004.108 http://doi.org/10.1109/TPAMI.2004.108 .

A. Baumberg . Reliable Feature Matching across Widely Separated Views . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2000 . p.774 - 781 . DOI: 10.1109/CVPR.2000.855899 http://doi.org/10.1109/CVPR.2000.855899 .

H. Bay , A. Ess , T. Tuytelaars , L.V. Gool . SURF:speeded up robust features . Comput. Vis. Image Understand. , 2008 . 110 ( 3 ): 346 - 359 . DOI: 10.1016/j.cviu.2007.09.014 http://doi.org/10.1016/j.cviu.2007.09.014 .

S. Belongie , J. Malik , J. Puchiza . Shape matching and object recognition using shape contexts . IEEE Trans. Pattern Anal. Mach. Intell. , 2002 . 24 ( 4 ): 509 - 522 . DOI: 10.1109/34.993558 http://doi.org/10.1109/34.993558 .

A.C. Berg , T.L. Berg , J. Malik . Shape Matching and Object Recognition Using Low Distortion Correspondences . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2005 . p.26 - 33 . DOI: 10.1109/CVPR.2005.320 http://doi.org/10.1109/CVPR.2005.320 .

H. Bilen , V.P. Namboodiri , L.J. van Gool . Classification with global, local and shared features . LNCS , 2012 . 7476 134 - 143 . DOI: 10.1007/978-3-642-32717-9_14 http://doi.org/10.1007/978-3-642-32717-9_14 .

J. Cao , H.Q. Chen , K. Zhang , C.F. Niu . Moving cast shadow detection based on region color and texture . Robot , 2011a . 33 ( 5 ): 628 - 633 . .

J. Cao , Q.X. Liu , C.X. Gao , Y.S. Liu . Object recognition with corner-based feature . Trans. Beijing Inst. Technol. , 2011b . 31 ( 3 ): 308 - 312 . .

J. Cao , H.Q. Chen , M.Y. Mao . Optimization Algorithms for Local Features . Int. Conf. on Automation, Communication, Architectonics and Materials , 2011c . p.921 - 924 . DOI: 10.4028/www.scientific.net/AMR.225-226.921 http://doi.org/10.4028/www.scientific.net/AMR.225-226.921 .

G.Y. Chen , S. Gleason . Ridgelet Moment Invariants for Pattern Recognition . Proc. 25th IEEE Canadian Conf. on Electrical & Computer Engineering , 2012 . p.1 - 4 . DOI: 10.1109/CCECE.2012.6335061 http://doi.org/10.1109/CCECE.2012.6335061 .

Q. Chen , Z. Song , Y. Hua , Z.Y. Huang , S.C. Yan . Hierarchical Matching with Side Information for Image Classification . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2012 . p.3426 - 3433 . DOI: 10.1109/CVPR.2012.6248083 http://doi.org/10.1109/CVPR.2012.6248083 .

A.Y. Chia , D. Rajan , M.K. Leung , S. Rahardja . Object recognition by discriminative combinations of line segments, ellipses, and appearance features . IEEE Trans. Pattern Anal. Mach. Intell. , 2012 . 34 ( 9 ): 1758 - 1772 . DOI: 10.1109/TPAMI.2011.220 http://doi.org/10.1109/TPAMI.2011.220 .

J.Y. Choi , Y.M. Ro , K.N. Plataniotis . Color local texture features for color face recognition . IEEE Trans. Image Process. , 2012 . 21 ( 3 ): 1366 - 1380 . DOI: 10.1109/TIP.2011.2168413 http://doi.org/10.1109/TIP.2011.2168413 .

N. Cristianini , J. Shawe-Taylor , H. Lodhi . Latent semantic kernels . J. Intell. Inf. Syst. , 2002 . 18 ( 2/3 ): 127 - 152 . DOI: 10.1023/A:1013625426931 http://doi.org/10.1023/A:1013625426931 .

D.Q. Dai , P.C. Yuen . Regularized discriminant analysis and its application to face recognition . Pattern Recogn. , 2003 . 36 ( 3 ): 845 - 847 . DOI: 10.1016/S0031-3203(02)00092-4 http://doi.org/10.1016/S0031-3203(02)00092-4 .

N. Dalal , B. Triggs . Histograms of Oriented Gradients for Human Detection . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2005 . p.886 - 893 . DOI: 10.1109/CVPR.2005.177 http://doi.org/10.1109/CVPR.2005.177 .

H. Ding , X.D. Li , H.J. Zhao , W. Xiao . A New Generalized Affine Moment Invariants for Shape Retrieval and Object Recognition . Proc. IEEE Int. Symp. on Instrumentation and Control Technology , 2012 . p.137 - 142 . DOI: 10.1109/ISICT.2012.6291609 http://doi.org/10.1109/ISICT.2012.6291609 .

R. Fergus , P. Perona , A. Zisserman . A Sparse Object Category Model for Efficient Learning and Exhaustive Recognition . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2005 . p.380 - 387 . DOI: 10.1109/CVPR.2005.47 http://doi.org/10.1109/CVPR.2005.47 .

B. Fernando , E. Fromont , D. Muselet , M. Sebban . Discriminative Feature Fusion for Image Classification . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2012 . p.3434 - 3441 . DOI: 10.1109/CVPR.2012.6248084 http://doi.org/10.1109/CVPR.2012.6248084 .

X. Geng , D.C. Zhan , Z.H. Zhou . Supervised nonlinear dimensionality reduction for visualization and classification . IEEE Trans. Syst. Man Cybern. B , 2005 . 35 ( 6 ): 1098 - 1107 . DOI: 10.1109/TSMCB.2005.850151 http://doi.org/10.1109/TSMCB.2005.850151 .

I. Guyon , J. Watson , S. Barnhill , V. Vapnik . Gene selection for cancer classification using support vector machines . Mach. Learn. , 2002 . 46 ( 1-3 ): 389 - 422 . DOI: 10.1023/A:1012487302797 http://doi.org/10.1023/A:1012487302797 .

T. Hancock , H. Mamitsuka . Boosted network classifiers for local feature selection . IEEE Trans. Neur. Networks Learn. Syst. , 2012 . 23 ( 11 ): 1767 - 1778 . DOI: 10.1109/TNNLS.2012.2214057 http://doi.org/10.1109/TNNLS.2012.2214057 .

R. He , T.N. Tan , L. Wang , W.S. Zheng . Regularized Correntropy for Robust Feature Selection . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2012 . p.2504 - 2511 . DOI: 10.1109/CVPR.2012.6247966 http://doi.org/10.1109/CVPR.2012.6247966 .

A. Hyvarinen , E. Oja . Independent component analysis:algorithms and applications . Neur. Networks , 2000 . 13 ( 4-5 ): 411 - 430 . DOI: 10.1016/S0893-6080(00)00026-5 http://doi.org/10.1016/S0893-6080(00)00026-5 .

K. Javed , H.A. Babri , M. Saeed . Feature selection based on class-dependent densities for high-dimensional binary data . IEEE Trans. Knowl. Data Eng. , 2012 . 24 ( 3 ): 465 - 477 . DOI: 10.1109/TKDE.2010.263 http://doi.org/10.1109/TKDE.2010.263 .

F. Jurie , B. Triggs . Creating Efficient Codebooks for Visual Recognition . Proc. 10th IEEE Int. Conf. on Computer Vision , 2005 . p.604 - 610 . DOI: 10.1109/ICCV.2005.66 http://doi.org/10.1109/ICCV.2005.66 .

T. Kadir , A. Zisserman , M. Brady . An affine invariant salient region detector . LNCS , 2004 . 3021 228 - 241 . DOI: 10.1007/978-3-540-24670-1_18 http://doi.org/10.1007/978-3-540-24670-1_18 .

Y. Ke , R. Sukthankar . PCA-SIFT:a More Distinctive Representation for Local Image Descriptors . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2004 . p.511 - 517 . .

S. Lazebnik , C. Schmid , J. Ponce . A Sparse Texture Representation Using Affine-Invariant Regions . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2003 . p.319 - 324 . DOI: 10.1109/CVPR.2003.1211486 http://doi.org/10.1109/CVPR.2003.1211486 .

B. Leibe , A. Leonardis , B. Schiele . Robust object detection with interleaved categorization and segmentation . Int. J. Comput. Vis. , 2008 . 77 ( 1-3 ): 259 - 289 . DOI: 10.1007/s11263-007-0095-3 http://doi.org/10.1007/s11263-007-0095-3 .

C.S. Li , Q.S. Liu , J. Liu , H.Q. Lu . Learning Ordinal Discriminative Features for Age Estimation . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2012 . p.2570 - 2577 . DOI: 10.1109/CVPR.2012.6247975 http://doi.org/10.1109/CVPR.2012.6247975 .

H.W. Liu , J.G. Sun , L. Liu , H.J. Zhang . Feature selection with dynamic mutual information . Pattern Recogn. , 2009 . 42 ( 7 ): 1330 - 1339 . DOI: 10.1016/j.patcog.2008.10.028 http://doi.org/10.1016/j.patcog.2008.10.028 .

D. Lowe . Distinctive image features from scaleinvariant keypoints . Int. J. Comput. Vis. , 2004 . 60 ( 2 ): 91 - 110 . DOI: 10.1023/B:VISI.0000029664.99615.94 http://doi.org/10.1023/B:VISI.0000029664.99615.94 .

J. Matas , O. Chum , M. Urban , T. Pajdla . Robust wide baseline stereo from maximally stable extremal regions . Image Vis. Comput. , 2004 . 22 ( 10 ): 761 - 767 . DOI: 10.1016/j.imavis.2004.02.006 http://doi.org/10.1016/j.imavis.2004.02.006 .

K. Mikolajczyk , C. Schmid . Indexing Based on Scale Invariant Interest Points . Proc. 8th Int. Conf. on Computer Vision , 2001 . p.525 - 531 . DOI: 10.1109/ICCV.2001.937561 http://doi.org/10.1109/ICCV.2001.937561 .

K. Mikolajczyk , C. Schmid . Scale & affine invariant interest point detectors . Int. J. Comput. Vis. , 2004 . 60 ( 1 ): 63 - 86 . DOI: 10.1023/B:VISI.0000027790.02288.f2 http://doi.org/10.1023/B:VISI.0000027790.02288.f2 .

K. Mikolajczyk , C. Schmid . A performance evaluation of local descriptors . IEEE Trans. Pattern Anal. Mach. Intell. , 2005 . 27 ( 10 ): 1615 - 1630 . DOI: 10.1109/TPAMI.2005.188 http://doi.org/10.1109/TPAMI.2005.188 .

K. Mikolajczyk , B. Leibe , B. Schiele . Local Features for Object Class Recognition . Proc. 10th IEEE Int. Conf. on Computer Vision , 2005a . p.1792 - 1799 . DOI: 10.1109/ICCV.2005.146 http://doi.org/10.1109/ICCV.2005.146 .

K. Mikolajczyk , T. Tuytelaars , C. Schmid , A. Zisserman , J. Matas , F. Schaffalitzky , T. Kadir , L. van Gool . A comparison of affine region detectors . Int. J. Comput. Vis. , 2005b . 65 ( 1-2 ): 43 - 72 . DOI: 10.1007/s11263-005-3848-x http://doi.org/10.1007/s11263-005-3848-x .

K. Mikolajczyk , B. Leibe , B. Schiele . Multiple Object Class Detection with a Generative Model . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , 2006 . p.26 - 36 . DOI: 10.1109/CVPR.2006.202 http://doi.org/10.1109/CVPR.2006.202 .

A. Mohan , C. Papageorgiou , T. Poggio . Examplebased object detection in images by components . IEEE Trans. Pattern Anal. Mach. Intell. , 2001 . 23 ( 4 ): 349 - 361 . DOI: 10.1109/34.917571 http://doi.org/10.1109/34.917571 .

F. Moosmann , E. Nowak , F. Jurie . Randomized clustering forests for image classification . IEEE Trans. Pattern Anal. Mach. Intell. , 2008 . 30 ( 9 ): 1632 - 1646 . DOI: 10.1109/TPAMI.2007.70822 http://doi.org/10.1109/TPAMI.2007.70822 .

H. Nakayama , T. Harada , Y. Kuniyoshi . Global Gaussian Approach for Scene Categorization Using Information Geometry . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2010 . p.2336 - 2343 . DOI: 10.1109/CVPR.2010.5539921 http://doi.org/10.1109/CVPR.2010.5539921 .

K. Neshatian , M. Zhang . Genetic programming for feature subset ranking in binary classification problems . LNCS , 2009 . 5481 121 - 132 . DOI: 10.1007/978-3-642-01181-8_11 http://doi.org/10.1007/978-3-642-01181-8_11 .

E. Nowak , F. Jurie , B. Triggs . Sampling strategies for bag-of-features image classification . LNCS , 2006 . 3954 490 - 503 . DOI: 10.1007/11744085_38 http://doi.org/10.1007/11744085_38 .

K. Ohba , K. Ikeuchi . Detectability, uniqueness, and reliability of eigen windows for stable verification of partially occluded objects . IEEE Trans. Pattern Anal. Mach. Intell. , 1997 . 19 ( 9 ): 1043 - 1047 . DOI: 10.1109/34.615453 http://doi.org/10.1109/34.615453 .

H. Pan , X.B. Li , L.Z. Jin , L.Z. Xia . Object description and recognition using multiscale geometric analysis . J. Infrar. Millim. Waves , 2011 . 30 ( 1 ): 85 - 90 . .

C. Papageorgiou , T. Poggio . A trainable system for object detection . Int. J. Comput. Vis. , 2000 . 38 ( 1 ): 15 - 33 . DOI: 10.1023/A:1008162616689 http://doi.org/10.1023/A:1008162616689 .

F. Perronnin , C. Dance . Fisher Kernels on Visual Vocabularies for Image Categorization . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2007 . p.1 - 8 . DOI: 10.1109/CVPR.2007.383266 http://doi.org/10.1109/CVPR.2007.383266 .

C. Redondo-Cabrera , R.J. Lopez-Sastre , J. Acevedo-Rodriguez , S. Maldonado-Bascon . SURFing the Point Clouds:Selective 3D Spatial Pyramids for Category-Level Object Recognition . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2012 . p.3458 - 3465 . DOI: 10.1109/CVPR.2012.6248087 http://doi.org/10.1109/CVPR.2012.6248087 .

G. Salton , A. Wong , C.S. Yang . A vector space model for automatic indexing . Commun. ACM , 1975 . 18 ( 11 ): 613 - 620 . DOI: 10.1145/361219.361220 http://doi.org/10.1145/361219.361220 .

L.K. Saul , S.T. Roweis . Think globally, fit locally:unsupervised learning of low dimensional manifolds . J. Mach. Learn. Res. , 2003 . 4 ( 2 ): 119 - 155 . .

F. Schaffalitzky , A. Zisserman . Multi-view matching for unordered image sets, or "How do I organize my holiday snaps" . LNCS , 2002 . 2350 414 - 431 . DOI: 10.1007/3-540-47969-4_28 http://doi.org/10.1007/3-540-47969-4_28 .

J. Shlens . A Tutorial on Principal Component Analysis . Center for Neural Science, New York University, New York City, NY. Available from , http://www.snl.salk.edu/~shlens/pca.pdf http://www.snl.salk.edu/~shlens/pca.pdf , 2009 .

S. Tong , D. Koller . Support vector machine active learning with applications to text classification . J. Mach. Learn. Res. , 2002 . 2 45 - 66 . .

L. van Gool , T. Moons , D. Ungureanu . Affine/photometric invariants for planar intensity patterns . LNCS , 1996 . 1064 642 - 651 . DOI: 10.1007/BFb0015574 http://doi.org/10.1007/BFb0015574 .

P. Viola , M.J. Jones . Robust real-time face detection . Int. J. Comput. Vis. , 2004 . 57 ( 2 ): 137 - 154 . DOI: 10.1023/B:VISI.0000013087.49260.fb http://doi.org/10.1023/B:VISI.0000013087.49260.fb .

Y.J. Wang , X.B. Liu , Y.D. Jia . Visual word softhistogram for image representation . J. Softw. , 2012 . 23 ( 7 ): 1787 - 1795 . .

M. Weber , M. Welling , P. Perona . Unsupervised Learning of Models for Recognition . European Conf. on Computer Vision , 2000 . p.18 - 32 . .

J. Yang , J.Y. Yang . Why can LDA be performed in PCA transformed space . Pattern Recogn. , 2003 . 36 ( 2 ): 563 - 566 . DOI: 10.1016/S0031-3203(02)00048-1 http://doi.org/10.1016/S0031-3203(02)00048-1 .

J. Yang , D. Zhang , A.F. Frangi , J.Y. Yang . Twodimensional PCA:a new approach to appearance-based face representation and recognition . IEEE Trans. Pattern Anal. Mach. Intell. , 2004 . 26 ( 1 ): 131 - 137 . DOI: 10.1109/TPAMI.2004.1261097 http://doi.org/10.1109/TPAMI.2004.1261097 .

J. Yang , D. Zhang , X. Yong , J.Y. Yang . Twodimensional discriminant transform for face recognition . Pattern Recogn. , 2005 . 38 ( 7 ): 1125 - 1129 . DOI: 10.1016/j.patcog.2004.11.019 http://doi.org/10.1016/j.patcog.2004.11.019 .

L. Yu , H. Liu . Efficient feature selection via analysis of relevance and redundancy . J. Mach. Learn. Res. , 2004 . 5 1205 - 1224 . .

L. Zeng , D.L. Gu . A SIFT feature descriptor based on sector area partitioning . Acta Autom. Sin. , 2012 . 38 ( 9 ): 1513 - 1519 . .

L.B. Zhang , C.H. Wang , B.H. Xiao , Y.X. Shao . Image representation using bag-of-phrases . Acta Autom. Sin. , 2012 . 38 ( 1 ): 46 - 54 . .

L.J. Zhang , C. Chen , J.J. Bu , X.F. He . A unified feature and instance selection framework using optimum experimental design . IEEE Trans. Image Process. , 2012 . 21 ( 5 ): 2379 - 2388 . DOI: 10.1109/TIP.2012.2183879 http://doi.org/10.1109/TIP.2012.2183879 .

Q. Zhu , S. Avidan , M.C. Yeh , K.T. Cheng . Fast Human Detection Using a Cascade of Histograms of Oriented Gradients . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2006 . p.1491 - 1498 . DOI: 10.1109/CVPR.2006.119 http://doi.org/10.1109/CVPR.2006.119 .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据