Contact-free and pose-invariant hand-biometric-based personal identification system using RGB and depth data

Can WANG; Hong LIU; Xing LIU

doi:10.1631/jzus.C1300190

Your Location：

Home >

Browse articles >

Contact-free and pose-invariant hand-biometric-based personal identification system using RGB and depth data

Computer & Automation | Updated：2022-05-19

- Contact-free and pose-invariant hand-biometric-based personal identification system using RGB and depth data
- 基于人手生物测量信息并利用颜色和深度数据的身份识别系统
- Frontiers of Information Technology & Electronic Engineering Vol. 15, Issue 7, Pages: 525-536(2014)
- Affiliations：
  
  Engineering Laboratory on Intelligent Perception for Internet of Things (ELIP) and MOE Key Laboratory of Machine Perception, Shenzhen Graduate School, Peking University, Shenzhen 518055, China
- Author bio：
  
  [ "Can WANG, E-mail: herowc@pku.edu.cn" ]
  Hong LIU, E-mail: hongliu@pku.edu.cn
  [ "Xing LIU, E-mail: liuxing@sz.pku.edu.cn" ]
- Funds：
- DOI：10.1631/jzus.C1300190
  CLC： TP391.4
- Received：13 July 2013，
  
  Revised：2014-;5-;6，
  
  Published：2014-07
- Accepted：
Scan QR Code
Can WANG, Hong LIU, Xing LIU. Contact-free and pose-invariant hand-biometric-based personal identification system using RGB and depth data[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(7): 525-536.
DOI：

Can WANG, Hong LIU, Xing LIU. Contact-free and pose-invariant hand-biometric-based personal identification system using RGB and depth data[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(7): 525-536. DOI： 10.1631/jzus.C1300190.

摘要

研究目的

利用人手生物测量信息被认为是身份自动识别的一种有效方法。我们利用深度信息和颜色信息提取多种线索，以增加身份识别的精度。

创新要点

在已有方法基于颜色、纹理特征的基础上，使用深度传感器提供的深度信息，充分运用人手轮廓的曲率特征提取人手几何特征，并利用人手轮廓特征和手掌平面拟合对不同姿态的人手进行姿态统一化。

方法提亮

首先利用深度信息在图像分割上的鲁棒性提取人手区域，然后利用人手轮廓的几何信息矫正人手姿态。对于矫正后的人手区域，分别提取基于深度的几何特征和基于颜色和纹理的特征，并结合之前利用颜色信息提取人手生物信息的经典特征，描述人手的生物特征。充分利用了深度信息在人手姿态矫正上的优势和人手轮廓等集合信息。基于颜色和纹理的信息可用很多经典方法提到的特征，并可用高清相机采集颜色信息。

重要结论

大量实验证实，融合多种线索描述人手的生物特征，提升了基于传统特征提取人手特征和识别身份的精度，在实际应用中有效且鲁棒。

Abstract

Hand-biometric-based personal identification is considered to be an effective method for automatic recognition. However

existing systems require strict constraints during data acquisition

such as costly devices

specified postures

simple background

and stable illumination. In this paper

a contactless personal identification system is proposed based on matching hand geometry features and color features. An inexpensive Kinect sensor is used to acquire depth and color images of the hand. During image acquisition

no pegs or surfaces are used to constrain hand position or posture. We segment the hand from the background through depth images through a process which is insensitive to illumination and background. Then finger orientations and landmark points

like finger tips or finger valleys

are obtained by geodesic hand contour analysis. Geometric features are extracted from depth images and palmprint features from intensity images. In previous systems

hand features like finger length and width are normalized

which results in the loss of the original geometric features. In our system

we transform 2D image points into real world coordinates

so that the geometric features remain invariant to distance and perspective effects. Extensive experiments demonstrate that the proposed hand-biometric-based personal identification system is effective and robust in various practical situations.

关键词

Keywords

references

R.S. Choras , , , M. Choras . . Hand shape geometry and palmprint features for the personal identification . . 6th Int. Conf. on Intelligent Systems Design and Applications , , 2006 . . p.1085 - - 1090 . . DOI: 10.1109/ISDA.2006.253763 http://doi.org/10.1109/ISDA.2006.253763 . .

J. Dai , , , J. Feng , , , J. Zhou . . Robust and efficient ridge-based palmprint matching . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2012 . . 34 ( ( 8 ): ): 1618 - - 1632 . . DOI: 10.1109/TPAMI.2011.237 http://doi.org/10.1109/TPAMI.2011.237 . .

V. Kanhangad , , , A. Kumar , , , D. Zhang . . Human hand identification with 3D hand pose variations . . IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Workshops , , 2010 . . p.17 - - 21 . . DOI: 10.1109/CVPRW.2010.5543236 http://doi.org/10.1109/CVPRW.2010.5543236 . .

V. Kanhangad , , , A. Kumar , , , D. Zhang . . Contactless and pose invariant biometric identification using hand surface . . IEEE Trans. Image Process. , , 2011a . . 20 ( ( 5 ): ): 1415 - - 1424 . . DOI: 10.1109/TIP.2010.2090888 http://doi.org/10.1109/TIP.2010.2090888 . .

V. Kanhangad , , , A. Kumar , , , D. Zhang . . A unified framework for contactless hand verification . . IEEE Trans. Inform. Forens. Secur. , , 2011b . . 6 ( ( 3 ): ): 1014 - - 1027 . . DOI: 10.1109/TIFS.2011.2121062 http://doi.org/10.1109/TIFS.2011.2121062 . .

A. Kong , , , D. Zhang . . Competitive coding scheme for palmprint verification . . Proc. 17th Int. Conf. on Pattern Recognition , , 2004 . . 520 - - 523 . . DOI: 10.1109/ICPR.2004.1334184 http://doi.org/10.1109/ICPR.2004.1334184 . .

A. Kumar , , , D. Zhang . . Hand geometry recognition using entropy-based discretization . . IEEE Trans. Inform. Forens. Secur. , , 2007 . . 2 ( ( 2 ): ): 181 - - 187 . . DOI: 10.1109/TIFS.2007.896915 http://doi.org/10.1109/TIFS.2007.896915 . .

S. Malassiotis , , , N. Aifanti , , , M.G. Strintzis . . Personal authentication using 3-D finger geometry . . IEEE Trans. Inform. Forens. Secur. , , 2006 . . 1 ( ( 1 ): ): 12 - - 21 . . DOI: 10.1109/TIFS.2005.863508 http://doi.org/10.1109/TIFS.2005.863508 . .

C. Methani , , , A.M. Namboodiri . . Pose invariant palmprint recognition . . LNCS , , 2009 . . 5558 577 - - 586 . . DOI: 10.1007/978-3-642-01793-3_59 http://doi.org/10.1007/978-3-642-01793-3_59 . .

G.K.O. Michael , , , T. Connie , , , A.B.J. Teoh . . A contactless biometric system using multiple hand features . . J. Vis. Commun. Image Represent. , , 2012 . . 23 ( ( 7 ): ): 1068 - - 1084 . . DOI: 10.1016/j.jvcir.2012.07.004 http://doi.org/10.1016/j.jvcir.2012.07.004 . .

A. Morales , , , M.A. Ferrer , , , F. Diaz , , , 等 . . Contactfree hand biometric system for real environments . . 16th European Signal Processing Conf. , , 2008 . . p.1 - - 5 . . . .

A. Morales , , , M.A. Ferrer , , , C.M. Travieso , , , 等 . . Multisampling approach applied to contactless hand biometrics . . IEEE Int. Carnahan Conf. on Security Technology , , 2012 . . 224 - - 229 . . DOI: 10.1109/CCST.2012.6393563 http://doi.org/10.1109/CCST.2012.6393563 . .

M. Ramalho , , , P. Correia , , , L. Soares . . Distributed source coding for securing a hand-based biometric recognition system . . 18th IEEE Int. Conf. on Image Processing , , 2011 . . p.1825 - - 1828 . . DOI: 10.1109/ICIP.2011.6115820 http://doi.org/10.1109/ICIP.2011.6115820 . .

S. Ribaric , , , I. Fratric . . A biometric identification system based on eigenpalm and eigenfinger features . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2005 . . 27 ( ( 11 ): ): 1698 - - 1709 . . DOI: 10.1109/TPAMI.2005.209 http://doi.org/10.1109/TPAMI.2005.209 . .

R. Sanchez-Reillo . . Hand geometry pattern recognition through Gaussian mixture modelling . . Proc. 15th Int. Conf. on Pattern Recognition , , 2000 . . p.937 - - 940 . . DOI: 10.1109/ICPR.2000.906228 http://doi.org/10.1109/ICPR.2000.906228 . .

R. Sanchez-Reillo , , , C. Sanchez-Avila , , , A. Gonzalez-Macros . . Biometric identification through hand geometry measurements . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2000 . . 22 ( ( 10 ): ): 1168 - - 1171 . . DOI: 10.1109/34.879796 http://doi.org/10.1109/34.879796 . .

C. Wang , , , H. Liu , , , X. Liu . . Maximally stable curvature regions for 3D hand tracking . . IEEE Int. Conf. on Image Processing , , 2013 . . p.3895 - - 3899 . . DOI: 10.1109/ICIP.2013.6738802 http://doi.org/10.1109/ICIP.2013.6738802 . .

D. Woodard , , , P. Flynn . . Finger surface as a biometric identifier . . Comput. Vis. Image Understand. , , 2005 . . 100 ( ( 3 ): ): 357 - - 384 . . DOI: 10.1016/j.cviu.2005.06.003 http://doi.org/10.1016/j.cviu.2005.06.003 . .

W. Xiong , , , K. Toh , , , W. Yau , , , 等 . . Modelguided deformable hand shape recognition without positioning aids . . Pattern Recogn. , , 2005 . . 38 ( ( 10 ): ): 1651 - - 1664 . . DOI: 10.1016/j.patcog.2004.07.008 http://doi.org/10.1016/j.patcog.2004.07.008 . .

D. Zhang , , , W. Kong , , , J. You , , , 等 . . Online palmprint identification . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2003 . . 25 ( ( 9 ): ): 1041 - - 1050 . . DOI: 10.1109/TPAMI.2003.1227981 http://doi.org/10.1109/TPAMI.2003.1227981 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰