Laplacian sparse dictionary learning for image classification based on sparse representation

Fang LI; Jia SHENG; San-yuan ZHANG

doi:10.1631/FITEE.1600039

Your Location：

Home >

Browse articles >

Laplacian sparse dictionary learning for image classification based on sparse representation

Regular Papers | Updated：2022-05-19

- Laplacian sparse dictionary learning for image classification based on sparse representation
- 基于稀疏表示的拉普拉斯稀疏字典图像分类
- Frontiers of Information Technology & Electronic Engineering Vol. 18, Issue 11, Pages: 1795-1805(2017)
- Affiliations：
  
  College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
  School of Computer Science and Information Security, Guilin University of Electronic Technology, Guilin 541004, China
  Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, China
- Author bio：
  
  San-yuan ZHANG, E-mail: syzhang@zju.edu.cn
- Funds：
- DOI：10.1631/FITEE.1600039
  CLC： TP39
- Received：25 January 2016，
  
  Revised：2017-11-20，
  
  Published：2017-11
- Accepted：
Scan QR Code
Fang LI, Jia SHENG, San-yuan ZHANG. Laplacian sparse dictionary learning for image classification based on sparse representation[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1795-1805.
DOI：

Fang LI, Jia SHENG, San-yuan ZHANG. Laplacian sparse dictionary learning for image classification based on sparse representation[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1795-1805. DOI： 10.1631/FITEE.1600039.

摘要

稀疏表示作为数据表示的一种数学模型，是解决模式识别、机器学习、计算机视觉等领域问题的有力工具。字典学习是稀疏表示方法的重要组成部分，在对原始信号及其在字典学习空间中的重建误差的最小化上发挥着重要的作用。在稀疏表示模型中，直接利用训练样本作为字典可以取得良好的性能。但由于训练样本含有噪声，这样的字典很大且效率低下。为取得更小且表现更好的字典，本文提出一种基于流形学习及双稀疏理论的拉普拉斯稀疏字典学习方法（Laplacian sparse dictionary

LSD）。本文将拉普拉斯权重图加入稀疏表示的模型，并对字典加以

范数约束。LSD是一个稀疏的过完备字典，可保持数据的内在结构，并为每个类学习一个更小的字典。学习得到的字典可以嵌入基于稀疏表示的分类框架。将本文提出的方法和其它方法在三个基准的约束人脸数据（Extended Yale B、ORL、AR）和一个无约束的行人数据图像数据库i-LIDS-MA上进行对比实验。结果显示本文提出的LSD算法比当前基于分类的稀疏表示的方法更有优势。

Abstract

Sparse representation is a mathematical model for data representation that has proved to be a powerful tool for solving problems in various fields such as pattern recognition

machine learning

and computer vision. As one of the building blocks of the sparse representation method

dictionary learning plays an important role in the minimization of the reconstruction error between the original signal and its sparse representation in the space of the learned dictionary. Although using training samples directly as dictionary bases can achieve good performance

the main drawback of this method is that it may result in a very large and inefficient dictionary due to noisy training instances. To obtain a smaller and more representative dictionary

in this paper

we propose an approach called Laplacian sparse dictionary (LSD) learning. Our method is based on manifold learning and double sparsity. We incorporate the Laplacian weighted graph in the sparse representation model and impose the

-norm sparsity on the dictionary. An LSD is a sparse overcomplete dictionary that can preserve the intrinsic structure of the data and learn a smaller dictionary for each class. The learned LSD can be easily integrated into a classification framework based on sparse representation. We compare the proposed method with other methods using three benchmark-controlled face image databases

Extended Yale B

ORL

and AR

and one uncontrolled person image dataset

i-LIDS-MA. Results show the advantages of the proposed LSD algorithm over state-of-the-art sparse representation based classification methods.

关键词

Keywords

references

M. Aharon , , , M. Elad , , , A. Bruckstein . . K -SVD: an algorithm for designing overcomplete dictionaries for sparse representation . . IEEE Trans. Signal Process. , , 2006 . . 54 ( ( 11 ): ): 4311 - - 4322 . . DOI: 10.1109/TSP.2006.881199 http://doi.org/10.1109/TSP.2006.881199 . .

S. Bąk , , , E. Corvee , , , F. Bremond , , , 等 . . Boosted human re-identification using Riemannian manifolds . . Image Vis. Comput. , , 2012 . . 30 ( ( 6 ): ): 443 - - 452 . . DOI: 10.1016/j.imavis.2011.08.008 http://doi.org/10.1016/j.imavis.2011.08.008 . .

P.N. Belhumeur , , , J.P. Hespanha , , , D.J. Kriegman . . Eigenfaces vs.Fisherfaces: recognition using class specific linear projection . . IEEE Trans. Patt. Anal. Mach. Intell. , , 1997 . . 19 ( ( 7 ): ): 711 - - 720 . . DOI: 10.1109/34.598228 http://doi.org/10.1109/34.598228 . .

M. Belkin , , , P. Niyogi . . Laplacian eigenmaps and spectral techniques for embedding and clustering . . In : Advances in Neural Information Processing Systems. MIT Press, Cambridge, MA , , 2001 . . p.585 - - 591 . . . .

O. Chapelle , , , B. Schölkopf , , , A. Zien . . Semi-supervised Learning , , : : Cambridge, MA MIT Press , , 2006 . . .

E. Elhamifar , , , R. Vidal . . Sparse subspace clustering: algorithm, theory, and applications . . IEEE Trans. Patt. Anal. Mach. Intell. , , 2013 . . 35 ( ( 11 ): ): 2765 - - 2781 . . DOI: 10.1109/TPAMI.2013.57 http://doi.org/10.1109/TPAMI.2013.57 . .

M.J. Gangeh , , , A. Ghodsi , , , M.S. Kamel . . Kernelized supervised dictionary learning . . IEEE Trans. Signal Process. , , 2013 . . 61 ( ( 19 ): ): 4753 - - 4767 . . DOI: 10.1109/TSP.2013.2274276 http://doi.org/10.1109/TSP.2013.2274276 . .

S. Gao , , , I.W.H. Tsang , , , Y. Ma . . Learning categoryspecific dictionary and shared dictionary for fine-grained image categorization . . IEEE Trans. Image Process. , , 2014 . . 23 ( ( 2 ): ): 623 - - 634 . . DOI: 10.1109/TIP.2013.2290593 http://doi.org/10.1109/TIP.2013.2290593 . .

A.S. Georghiades , , , P.N. Belhumeur , , , D.J. Kriegman . . From few to many: illumination cone models for face recognition under variable lighting and pose . . IEEE Trans. Patt. Anal. Mach. Intell. , , 2001 . . 23 ( ( 6 ): ): 643 - - 660 . . DOI: 10.1109/34.927464 http://doi.org/10.1109/34.927464 . .

X. He , , , P. Niyogi . . Locality preserving projections . . 17th Annual Conf. on Neural Information Processing Systems , , 2003 . . p.186 - - 197 . . . .

X. He , , , S. Yan , , , Y. Hu , , , 等 . . Face recognition using Laplacian faces . . IEEE Trans. Patt. Anal. Mach. Intell. , , 2005 . . 27 ( ( 3 ): ): 328 - - 340 . . DOI: 10.1109/TPAMI.2005.55 http://doi.org/10.1109/TPAMI.2005.55 . .

M. Huang , , , W. Yang , , , J. Jiang , , , 等 . . Brain extraction based on locally linear representation-based classification . . NeuroImage , , 2014 . . 92 322 - - 339 . . DOI: 10.1016/j.neuroimage.2014.01.059 http://doi.org/10.1016/j.neuroimage.2014.01.059 . .

H. Lee , , , A. Battle , , , R. Raina , , , 等 . . Efficient sparse coding algorithms . . In : Advances in Neural Information Processing Systems. MIT Press, Cambridge, MA , , 2006 . . p.801 - - 808 . . . .

K.C. Lee , , , J. Ho , , , D.J. Kriegman . . Acquiring linear subspaces for face recognition under variable lighting . . IEEE Trans. Patt. Anal. Mach. Intell. , , 2005 . . 27 ( ( 5 ): ): 684 - - 698 . . DOI: 10.1109/TPAMI.2005.92 http://doi.org/10.1109/TPAMI.2005.92 . .

X. Lu , , , X. Li . . Group sparse reconstruction for image segmentation . . Neurocomputing , , 2014 . . 136 41 - - 48 . . DOI: 10.1016/j.neucom.2014.01.034 http://doi.org/10.1016/j.neucom.2014.01.034 . .

X. Lu , , , H. Wu , , , Y. Yuan , , , 等 . . Manifold regularized sparse NMF for hyperspectral unmixing . . IEEE Trans. Geosci. Remote Sens. , , 2013 . . 51 ( ( 5 ): ): 2815 - - 2826 . . DOI: 10.1109/TGRS.2012.2213825 http://doi.org/10.1109/TGRS.2012.2213825 . .

Y. Lu , , , Z. Lai , , , Z. Fan , , , 等 . . Manifold discriminant regression learning for image classification . . Neurocomputing , , 2015 . . 166 475 - - 486 . . DOI: 10.1016/j.neucom.2015.03.031 http://doi.org/10.1016/j.neucom.2015.03.031 . .

A.M. Martinez , , , R. Benavente . . The AR Face Database. CVC Technical Report, No. 24. . . Centre de Visió per Computador, Universitat Autònoma de Barcelona, Edifici O, Bellaterra, Barcelona , , 1998 . . .

T. Peleg , , , M. Elad . . A statistical prediction model based on sparse representations for single image superresolution . . IEEE Trans. Image Process. , , 2014 . . 23 ( ( 6 ): ): 2569 - - 2582 . . DOI: 10.1109/TIP.2014.2305844 http://doi.org/10.1109/TIP.2014.2305844 . .

L. Qiao , , , S. Chen , , , X. Tan . . Sparsity preserving projections with applications to face recognition . . Patt. Recogn. , , 2010 . . 43 ( ( 1 ): ): 331 - - 341 . . DOI: 10.1016/j.patcog.2009.05.005 http://doi.org/10.1016/j.patcog.2009.05.005 . .

S.T. Roweis , , , L.K. Saul . . Nonlinear dimensionality reduction by locally linear embedding . . Science , , 2000 . . 290 ( ( 5500 ): ): 2323 - - 2326 . . DOI: 10.1126/science.290.5500.2323 http://doi.org/10.1126/science.290.5500.2323 . .

R. Rubinstein , , , A.M. Bruckstein , , , M. Elad . . Dictionaries for sparse representation modeling . . Proc. IEEE , , 2010a . . 98 ( ( 6 ): ): 1045 - - 1057 . . DOI: 10.1109/JPROC.2010.2040551 http://doi.org/10.1109/JPROC.2010.2040551 . .

R. Rubinstein , , , M. Zibulevsky , , , M. Elad . . Double sparsity: learning sparse dictionaries for sparse signal approximation . . IEEE Trans. Signal Process. , , 2010b . . 58 ( ( 3 ): ): 1553 - - 1564 . . DOI: 10.1109/TSP.2009.2036477 http://doi.org/10.1109/TSP.2009.2036477 . .

L. Shao , , , R. Yan , , , X. Li , , , 等 . . From heuristic optimization to dictionary learning: a review and comprehensive comparison of image denoising algorithms . . IEEE Trans. Cybern. , , 2014 . . 44 ( ( 7 ): ): 1001 - - 1013 . . DOI: 10.1109/TCYB.2013.2278548 http://doi.org/10.1109/TCYB.2013.2278548 . .

J.B. Tenenbaum , , , V. de Silva , , , J.C. Langford . . A global geometric framework for nonlinear dimensionality reduction . . Science , , 2000 . . 290 ( ( 5500 ): ): 2319 - - 2323 . . DOI: 10.1126/science.290.5500.2319 http://doi.org/10.1126/science.290.5500.2319 . .

R. Tibshirani . . Regression shrinkage and selection via the lasso . . J. R. Stat. Soc. Ser. B (Methodol.) , , 1996 . . 58 ( ( 2 ): ): 267 - - 288 . . . .

M. Turk , , , A. Pentland . . Eigenfaces for recognition . . J. Cogn. Neurosci. , , 1991 . . 3 ( ( 1 ): ): 71 - - 86 . . . .

W. Wang , , , R. Wang , , , Z. Huang , , , 等 . . Discriminant analysis on Riemannian manifold of Gaussian distributions for face recognition with image sets . . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , , 2015 . . p.048 - - 2057 . . DOI: 10.1109/TCSVT.2014.2367357 http://doi.org/10.1109/TCSVT.2014.2367357 . .

J. Wright , , , A.Y. Yang , , , A. Ganesh , , , 等 . . Robust face recognition via sparse representation . . IEEE Trans. Patt. Anal. Mach. Intell. , , 2009 . . 31 ( ( 2 ): ): 210 - - 227 . . DOI: 10.1109/TPAMI.2008.79 http://doi.org/10.1109/TPAMI.2008.79 . .

A.Y. Yang , , , Z. Zhou , , , A.G. Balasubramanian , , , 等 . . Fast- l 1 minimization algorithms for robust face recognition . . IEEE Trans. Image Process. , , 2013 . . 22 ( ( 8 ): ): 3234 - - 3246 . . DOI: 10.1109/TIP.2013.2262292 http://doi.org/10.1109/TIP.2013.2262292 . .

J. Yang , , , L. Zhang , , , Y. Xu , , , 等 . . Beyond sparsity: the role of l 1 -optimizer in pattern classification . . Patt. Recogn. , , 2012 . . 45 ( ( 3 ): ): 1104 - - 1118 . . DOI: 10.1016/j.patcog.2011.08.022 http://doi.org/10.1016/j.patcog.2011.08.022 . .

J.F. Yang , , , Y. Zhang . . Alternating direction algorithms for $${\ell _1}$$ -problems in compressive sensing . . SIAM J. Sci. Comput. , , 2011 . . 33 ( ( 1 ): ): 250 - - 278 . . DOI: 10.1137/090777761 http://doi.org/10.1137/090777761 . .

M. Yang , , , L. Zhang , , , J. Yang , , , 等 . . Metaface learning for sparse representation-based face recognition . . 17th IEEE Int. Conf. on Image Processing , , 2010 . . p.1601 - - 1604 . . DOI: 10.1109/ICIP.2010.5652363 http://doi.org/10.1109/ICIP.2010.5652363 . .

M. Yang , , , L. van Gool , , , L. Zhang . . Sparse variation dictionary learning for face recognition with a single training sample per person . . IEEE Int. Conf. on Computer Vision , , 2013 . . p.689 - - 696 . . DOI: 10.1109/ICCV.2013.91 http://doi.org/10.1109/ICCV.2013.91 . .

M. Yang , , , D. Dai , , , L. Shen , , , 等 . . Latent dictionary learning for sparse representation-based classification . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2014 . . p.4138 - - 4145 . . DOI: 10.1109/CVPR.2014.527 http://doi.org/10.1109/CVPR.2014.527 . .

Z. Zhang , , , Y. Xu , , , J. Yang , , , 等 . . A survey of sparse representation: algorithms and applications . . IEEE Access , , 2015 . . 3 490 - - 530 . . DOI: 10.1109/ACCESS.2015.2430359 http://doi.org/10.1109/ACCESS.2015.2430359 . .

M. Zheng , , , J. Bu , , , C. Chen , , , 等 . . Graph regularized sparse coding for image representation . . IEEE Trans. Image Process. , , 2011 . . 20 ( ( 5 ): ): 1327 - - 1336 . . DOI: 10.1109/TIP.2010.2090535 http://doi.org/10.1109/TIP.2010.2090535 . .

P. Zhu , , , W. Zuo , , , L. Zhang , , , 等 . . Image set-based collaborative representation for face recognition . . IEEE Trans. Inform. Forens. Secur. , , 2014 . . 9 ( ( 7 ): ): 1120 - - 1132 . . DOI: 10.1109/TIFS.2014.2324277 http://doi.org/10.1109/TIFS.2014.2324277 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Variational Bayesian multi-sparse component extraction for damage reconstruction of space debris hypervelocity impact

Kernel sparse representation for MRI image analysis in automatic brain tumor segmentation

Face recognition based on subset selection via metric learning on manifold

Speech enhancement with a GSC-like structure employing sparse coding

Related Author

Xuegang HUANG

Anhua SHI

Qing LUO

Jinyang LUO

Ji-jun TONG

Peng ZHANG

Yu-xiang WENG

Dan-hua ZHU

Related Institution

Hypervelocity Aerodynamics Institute, China Aerodynamics Research and Development Center

School of Information Science and Technology, Zhejiang Sci-Tech University

Department of Neurosurgery, The First Affiliated Hospital, School of Medicine, Zhejiang University

State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, The First Affiliated Hospital, School of Medicine, Zhejiang University

School of Information Science and Engineering, Shenyang University of Technology

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰