负载均衡的分布式指纹识别系统

Yun-xiang ZHAO; Wan-xin ZHANG; Dong-sheng LI; Zhen HUANG; Min-ne LI; Xi-cheng LU

doi:10.1631/FITEE.1500487

Your Location：

Home >

Browse articles >

负载均衡的分布式指纹识别系统

常规文章 | Updated：2022-05-19

- 负载均衡的分布式指纹识别系统
- RePizer: a framework for prioritization of software requirements#
- 信息与电子工程前沿（英文） 2016年17卷第8期页码：766-780
- Affiliations：
  
  National Laboratory for Parallel and Distributed Processing, College of Computer, National University of Defense Technology, Changsha 410003, China
- Author bio：
  
  E-mail:zhaoyx1993@163.com
  E-mail:camu7s@163.com
  E-mail:dsli@nudt.edu.cn
  E-mail:maths_www@163.com
  E-mail:litoeknee@gmail.com
- Funds：
  
  Project supported by the National Basic Research Program (973) of China (No. 2014CB340303), the National Natural Science Foundation of China (Nos. 61222205 and 61402490), the Program for New Century Excellent Talents in University, China (No. 141066), and the Fok Ying-Tong Education Foundation;#A preliminary version was presented at the 15th International Conference on Algorithms and Architectures for Parallel Processing, Zhangjiajie, China, Nov. 18–20, 2015
- DOI：10.1631/FITEE.1500487
  中图分类号： TP316.4
- 收稿：2015-12-29，
  
  录用：2016-4-12，
  
  纸质出版：2016-08
- Accepted：
Scan QR Code
负载均衡的分布式指纹识别系统[J]. 信息与电子工程前沿（英文）, 2016,17(8):766-780.

Yun-xiang ZHAO, Wan-xin ZHANG, Dong-sheng LI, et al. RePizer: a framework for prioritization of software requirements#[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(8): 766-780.
负载均衡的分布式指纹识别系统[J]. 信息与电子工程前沿（英文）, 2016,17(8):766-780. DOI： 10.1631/FITEE.1500487.

Yun-xiang ZHAO, Wan-xin ZHANG, Dong-sheng LI, et al. RePizer: a framework for prioritization of software requirements#[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(8): 766-780. DOI： 10.1631/FITEE.1500487.

摘要

指纹的唯一性和不变性使得它在各类生物识别系统中得到了广泛的应用。随着指纹识别技术的发展，大规模的指纹存储和系统高并发的需求给指纹识别系统带来了新的挑战。面对这种挑战，我们设计并实现了一个负载均衡的分布式指纹识别系统，它包括分布式指纹特征提取子系统和分布式指纹特征存储子系统两部分。在指纹特征提取的过程中，特征提取与Hadoop图片处理接口（HIPI）的结合使得特征提取的效率得到大幅度提升；特征存储子系统对MongoDB默认的负载均衡策略进行了优化，使得鲁棒性得到了明显提高。相关的试验和模拟表明，相比于Hadoop默认的小文件处理机制，我们的系统可以在指纹特征提取的过程中减少约70%的处理时间；优化后的MongoDB负载均衡策略可以将分布式MongoDB系统的前端mongos负载差距控制在5%以下，基于操作负载（增、删、改、查）的后端数据存储负载均衡策略将由数据迁移带来的时间开销降低了约40%。

Abstract

Fingerprint has been widely used in a variety of biometric identification systems in the past several years due to its uniqueness and immutability. With the rapid development of fingerprint identification techniques

many fingerprint identification systems are in urgent need to deal with large-scale fingerprint storage and high concurrent recognition queries

which bring huge challenges to the system. In this circumstance

we design and implement a distributed and load-balancing fingerprint identification system named Pegasus

which includes a distributed feature extraction subsystem and a distributed feature storage subsystem. The feature extraction procedure combines the Hadoop Image Processing Interface (HIPI) library to enhance its overall processing speed; the feature storage subsystem optimizes MongoDB’s default load balance strategy to improve the efficiency and robustness of Pegasus. Experiments and simulations are carried out

and results show that Pegasus can reduce the time cost by 70% during the feature extraction procedure. Pegasus also balances the difference of access load among front-end mongos nodes to less than 5%. Additionally

Pegasus reduces over 40% of data migration among back-end data shards to obtain a more reasonable data distribution based on the operation load (insertion

deletion

update

and query) of each shard.

关键词

Keywords

references

R Cappelli , , , M Ferrara , , , A Franco , , , 等 . . Fingerprint verification competition 2006 . . Biomet. Technol. Today , , 2007 . . 15 ( ( 7-8 ): ): 7 - - 9 . . DOI: 10.1016/s0969-4765(07)70140-6 http://doi.org/10.1016/s0969-4765(07)70140-6 . .

E Dede , , , M Govindaraju , , , D Gunter , , , 等 . . Performance evaluation of a MongoDB and Hadoop platform for scientific data analysis . . 2013 . . Proc. 4th ACM Workshop on Scientific Cloud Computing . . 13 - - 20 . . DOI: 10.1145/2465848.2465849 http://doi.org/10.1145/2465848.2465849 . .

M Galar , , , J Derrac , , , D Peralta , , , 等 . . A survey of fingerprint classification part I: taxonomies on feature extraction methods and learning models . . Knowl.-Based Syst. , , 2015a . . 81 76 - - 97 . . DOI: 10.1016/j.knosys.2015.02.008 http://doi.org/10.1016/j.knosys.2015.02.008 . .

M Galar , , , J Derrac , , , D Peralta , , , 等 . . A survey of fingerprint classification part II: experimental analysis and ensemble proposal . . Knowl.-Based Syst. , , 2015b . . 81 98 - - 116 . . DOI: 10.1016/j.knosys.2015.02.015 http://doi.org/10.1016/j.knosys.2015.02.015 . .

PD Gutiérrez , , , M Lastra , , , F Herrera , , , 等 . . A high performance fingerprint matching system for large databases based on GPU . . IEEE Trans. Inform. Forens. Secur. , , 2014 . . 9 ( ( 1 ): ): 62 - - 71 . . DOI: 10.1109/tifs.2013.2291220 http://doi.org/10.1109/tifs.2013.2291220 . .

L Hong , , , Y Wan , , , A Jain . . Fingerprint image enhancement: algorithm and performance evaluation . . IEEE Trans. Patt. Anal. Mach. Intell. , , 1998 . . 20 ( ( 8 ): ): 777 - - 789 . . DOI: 10.1109/34.709565 http://doi.org/10.1109/34.709565 . .

G Indrawan , , , B Sitohang , , , S Akbar . . Parallel processing for fingerprint feature extraction . . Proc. Int. Conf. on Electrical Engineering and Informatics , , 2011 . . 1 - - 6 . . DOI: 10.1109/iceei.2011.6021606 http://doi.org/10.1109/iceei.2011.6021606 . .

S Kanoje , , , V Powar , , , D Mukhopadhyay . . Using MongoDB for social networking website deciphering the pros and cons . . 2015 . . Proc. Int. Conf. on Innovations in Information, Embedded and Communication Systems . . 1 - - 3 . . DOI: 10.1109/iciiecs.2015.7192924 http://doi.org/10.1109/iciiecs.2015.7192924 . .

M Lastra , , , J Carabaño , , , P Gutiérrez , , , 等 . . Fast fingerprint identification using GPUs . . Inform. Sci. , , 2015 . . 301 195 - - 214 . . DOI: 10.1016/j.ins.2014.12.052 http://doi.org/10.1016/j.ins.2014.12.052 . .

J Li , , , D Li , , , Y Ye , , , 等 . . Efficient multi-tenant virtual machine allocation in cloud data centers . . Tsinghua Sci. Technol. , , 2015 . . 20 ( ( 1 ): ): 81 - - 89 . . DOI: 10.1109/tst.2015.7040517 http://doi.org/10.1109/tst.2015.7040517 . .

C Liu , , , K Ouyang , , , X Chu , , , 等 . . R-memcached: a reliable in-memory cache for big key-value stores . . Tsinghua Sci. Technol. , , 2015 . . 20 ( ( 6 ): ): 560 - - 573 . . DOI: 10.1109/tst.2015.7349928 http://doi.org/10.1109/tst.2015.7349928 . .

K Mader , , , L Donahue , , , R Müller , , , 等 . . Highthroughput, scalable, quantitative, cellular phenotyping using X-ray tomographic microscopy . . 2014 . . Proc. 2nd Int. Work-Conf. on Bioinformatics and Biomedical Engineering . . 1483 - - 1498 . . . .

R Malakar , , , N Vydyanathan . . A CUDA-enabled Hadoop cluster for fast distributed image processing . . 2013 . . Proc. National Conf. on Parallel Computing Technologies . . 1 - - 5 . . DOI: 10.1109/parcomptech.2013.6621392 http://doi.org/10.1109/parcomptech.2013.6621392 . .

D Peralta , , , I Triguero , , , R Sanchez-Reillo , , , 等 . . Fast fingerprint identification for large databases . . Patt. Recog. , , 2014 . . 47 ( ( 2 ): ): 588 - - 602 . . DOI: 10.1016/j.patcog.2013.08.002 http://doi.org/10.1016/j.patcog.2013.08.002 . .

D Peralta , , , M Galar , , , I Triguero , , , 等 . . A survey on fingerprint minutiae-based local matching for verification and identification: taxonomy and experimental evaluation . . Inform. Sci. , , 2015 . . 315 67 - - 87 . . DOI: 10.1016/j.ins.2015.04.013 http://doi.org/10.1016/j.ins.2015.04.013 . .

E Plugge , , , D Hawkins , , , P Membrey . . The Definitive Guide to MongoDB: the NoSQL Database for Cloud and Desktop Computing . . Apress , , 2010 . . .

Y Shu , , , YJ Gu , , , J Chen . . Dynamic authentication with sensory information for the access control systems . . IEEE Trans. Parall. Distr. Syst. , , 2014 . . 25 ( ( 2 ): ): 427 - - 436 . . DOI: 10.1109/TPDS.2013.153 http://doi.org/10.1109/TPDS.2013.153 . .

C Sweeney , , , L Liu , , , S Arietta , , , 等 . . HIPI: a Hadoop Image Processing Interface for Image-Based MapReduce Tasks . . MS Thesis, University of Virginia, USA , , 2011 . . .

J Xu , , , J Jiang , , , Y Dou , , , 等 . . A low-cost fully pipelined architecture for fingerprint matching . . Proc. 12th Int. Conf. on Signal Processing , , 2014 . . 413 - - 418 . . DOI: 10.1109/icosp.2014.7015039 http://doi.org/10.1109/icosp.2014.7015039 . .

Z Zhang , , , D Li , , , K Wu . . Large-scale virtual machines provisioning in clouds: challenges and approaches . . Front. Comput. Sci. , , 2016 . . 10 ( ( 1 ): ): 2 - - 18 . . DOI: 10.1007/s11704-015-4420-7 http://doi.org/10.1007/s11704-015-4420-7 . .

Y Zhao , , , W Zhang , , , D Li , , , 等 . . DFIS: a scalable distributed fingerprint identification system . . 2015 . . Proc. 15th Int. Conf. on Algorithms and Architectures for Parallel Processing . . 162 - - 175 . . DOI: 10.1007/978-3-319-27137-8_13 http://doi.org/10.1007/978-3-319-27137-8_13 . .

E Zhu , , , J Yin , , , G Zhang . . Computation of fingerprint inter-ridge distance . . J. Microelectron. Comput. , , 2004 . . 21 ( ( 10 ): ): 7 - - 9 . . . .

E Zhu , , , J Yin , , , G Zhang . . Fingerprint matching based on global alignment of multiple reference minutiae . . Patt. Recog. , , 2005 . . 38 ( ( 10 ): ): 1685 - - 1694 . . DOI: 10.1016/j.patcog.2005.02.016 http://doi.org/10.1016/j.patcog.2005.02.016 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

XIRAC: an optimized product-oriented near-real-time operating system with unlimited tasks and an innovative programming paradigm based on the maximum entropy method