

FOLLOWUS
National Laboratory for Parallel and Distributed Processing, College of Computer, National University of Defense Technology, Changsha 410003, China
E-mail:zhaoyx1993@163.com
E-mail:camu7s@163.com
E-mail:dsli@nudt.edu.cn
E-mail:maths_www@163.com
E-mail:litoeknee@gmail.com
Received:29 December 2015,
Accepted:12 April 2016,
Published:2016-08
Scan QR Code
Yun-xiang ZHAO, Wan-xin ZHANG, Dong-sheng LI, et al. RePizer: a framework for prioritization of software requirements#[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(8): 766-780.
Yun-xiang ZHAO, Wan-xin ZHANG, Dong-sheng LI, et al. RePizer: a framework for prioritization of software requirements#[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(8): 766-780. DOI: 10.1631/FITEE.1500487.
指纹的唯一性和不变性使得它在各类生物识别系统中得到了广泛的应用。随着指纹识别技术的发展,大规模的指纹存储和系统高并发的需求给指纹识别系统带来了新的挑战。面对这种挑战,我们设计并实现了一个负载均衡的分布式指纹识别系统,它包括分布式指纹特征提取子系统和分布式指纹特征存储子系统两部分。在指纹特征提取的过程中,特征提取与Hadoop图片处理接口(HIPI)的结合使得特征提取的效率得到大幅度提升;特征存储子系统对MongoDB默认的负载均衡策略进行了优化,使得鲁棒性得到了明显提高。相关的试验和模拟表明,相比于Hadoop默认的小文件处理机制,我们的系统可以在指纹特征提取的过程中减少约70%的处理时间;优化后的MongoDB负载均衡策略可以将分布式MongoDB系统的前端mongos负载差距控制在5%以下,基于操作负载(增、删、改、查)的后端数据存储负载均衡策略将由数据迁移带来的时间开销降低了约40%。
Fingerprint has been widely used in a variety of biometric identification systems in the past several years due to its uniqueness and immutability. With the rapid development of fingerprint identification techniques
many fingerprint identification systems are in urgent need to deal with large-scale fingerprint storage and high concurrent recognition queries
which bring huge challenges to the system. In this circumstance
we design and implement a distributed and load-balancing fingerprint identification system named Pegasus
which includes a distributed feature extraction subsystem and a distributed feature storage subsystem. The feature extraction procedure combines the Hadoop Image Processing Interface (HIPI) library to enhance its overall processing speed; the feature storage subsystem optimizes MongoDB’s default load balance strategy to improve the efficiency and robustness of Pegasus. Experiments and simulations are carried out
and results show that Pegasus can reduce the time cost by 70% during the feature extraction procedure. Pegasus also balances the difference of access load among front-end mongos nodes to less than 5%. Additionally
Pegasus reduces over 40% of data migration among back-end data shards to obtain a more reasonable data distribution based on the operation load (insertion
deletion
update
and query) of each shard.
R Cappelli , , , M Ferrara , , , A Franco , , , 等 . . Fingerprint verification competition 2006 . . Biomet. Technol. Today , , 2007 . . 15 ( ( 7-8 ): ): 7 - - 9 . . DOI: 10.1016/s0969-4765(07)70140-6 http://doi.org/10.1016/s0969-4765(07)70140-6 . .
E Dede , , , M Govindaraju , , , D Gunter , , , 等 . . Performance evaluation of a MongoDB and Hadoop platform for scientific data analysis . . 2013 . . Proc. 4th ACM Workshop on Scientific Cloud Computing . . 13 - - 20 . . DOI: 10.1145/2465848.2465849 http://doi.org/10.1145/2465848.2465849 . .
M Galar , , , J Derrac , , , D Peralta , , , 等 . . A survey of fingerprint classification part I: taxonomies on feature extraction methods and learning models . . Knowl.-Based Syst. , , 2015a . . 81 76 - - 97 . . DOI: 10.1016/j.knosys.2015.02.008 http://doi.org/10.1016/j.knosys.2015.02.008 . .
M Galar , , , J Derrac , , , D Peralta , , , 等 . . A survey of fingerprint classification part II: experimental analysis and ensemble proposal . . Knowl.-Based Syst. , , 2015b . . 81 98 - - 116 . . DOI: 10.1016/j.knosys.2015.02.015 http://doi.org/10.1016/j.knosys.2015.02.015 . .
PD Gutiérrez , , , M Lastra , , , F Herrera , , , 等 . . A high performance fingerprint matching system for large databases based on GPU . . IEEE Trans. Inform. Forens. Secur. , , 2014 . . 9 ( ( 1 ): ): 62 - - 71 . . DOI: 10.1109/tifs.2013.2291220 http://doi.org/10.1109/tifs.2013.2291220 . .
L Hong , , , Y Wan , , , A Jain . . Fingerprint image enhancement: algorithm and performance evaluation . . IEEE Trans. Patt. Anal. Mach. Intell. , , 1998 . . 20 ( ( 8 ): ): 777 - - 789 . . DOI: 10.1109/34.709565 http://doi.org/10.1109/34.709565 . .
G Indrawan , , , B Sitohang , , , S Akbar . . Parallel processing for fingerprint feature extraction . . Proc. Int. Conf. on Electrical Engineering and Informatics , , 2011 . . 1 - - 6 . . DOI: 10.1109/iceei.2011.6021606 http://doi.org/10.1109/iceei.2011.6021606 . .
S Kanoje , , , V Powar , , , D Mukhopadhyay . . Using MongoDB for social networking website deciphering the pros and cons . . 2015 . . Proc. Int. Conf. on Innovations in Information, Embedded and Communication Systems . . 1 - - 3 . . DOI: 10.1109/iciiecs.2015.7192924 http://doi.org/10.1109/iciiecs.2015.7192924 . .
M Lastra , , , J Carabaño , , , P Gutiérrez , , , 等 . . Fast fingerprint identification using GPUs . . Inform. Sci. , , 2015 . . 301 195 - - 214 . . DOI: 10.1016/j.ins.2014.12.052 http://doi.org/10.1016/j.ins.2014.12.052 . .
J Li , , , D Li , , , Y Ye , , , 等 . . Efficient multi-tenant virtual machine allocation in cloud data centers . . Tsinghua Sci. Technol. , , 2015 . . 20 ( ( 1 ): ): 81 - - 89 . . DOI: 10.1109/tst.2015.7040517 http://doi.org/10.1109/tst.2015.7040517 . .
C Liu , , , K Ouyang , , , X Chu , , , 等 . . R-memcached: a reliable in-memory cache for big key-value stores . . Tsinghua Sci. Technol. , , 2015 . . 20 ( ( 6 ): ): 560 - - 573 . . DOI: 10.1109/tst.2015.7349928 http://doi.org/10.1109/tst.2015.7349928 . .
K Mader , , , L Donahue , , , R Müller , , , 等 . . Highthroughput, scalable, quantitative, cellular phenotyping using X-ray tomographic microscopy . . 2014 . . Proc. 2nd Int. Work-Conf. on Bioinformatics and Biomedical Engineering . . 1483 - - 1498 . . . .
R Malakar , , , N Vydyanathan . . A CUDA-enabled Hadoop cluster for fast distributed image processing . . 2013 . . Proc. National Conf. on Parallel Computing Technologies . . 1 - - 5 . . DOI: 10.1109/parcomptech.2013.6621392 http://doi.org/10.1109/parcomptech.2013.6621392 . .
D Peralta , , , I Triguero , , , R Sanchez-Reillo , , , 等 . . Fast fingerprint identification for large databases . . Patt. Recog. , , 2014 . . 47 ( ( 2 ): ): 588 - - 602 . . DOI: 10.1016/j.patcog.2013.08.002 http://doi.org/10.1016/j.patcog.2013.08.002 . .
D Peralta , , , M Galar , , , I Triguero , , , 等 . . A survey on fingerprint minutiae-based local matching for verification and identification: taxonomy and experimental evaluation . . Inform. Sci. , , 2015 . . 315 67 - - 87 . . DOI: 10.1016/j.ins.2015.04.013 http://doi.org/10.1016/j.ins.2015.04.013 . .
E Plugge , , , D Hawkins , , , P Membrey . . The Definitive Guide to MongoDB: the NoSQL Database for Cloud and Desktop Computing . . Apress , , 2010 . . .
Y Shu , , , YJ Gu , , , J Chen . . Dynamic authentication with sensory information for the access control systems . . IEEE Trans. Parall. Distr. Syst. , , 2014 . . 25 ( ( 2 ): ): 427 - - 436 . . DOI: 10.1109/TPDS.2013.153 http://doi.org/10.1109/TPDS.2013.153 . .
C Sweeney , , , L Liu , , , S Arietta , , , 等 . . HIPI: a Hadoop Image Processing Interface for Image-Based MapReduce Tasks . . MS Thesis, University of Virginia, USA , , 2011 . . .
J Xu , , , J Jiang , , , Y Dou , , , 等 . . A low-cost fully pipelined architecture for fingerprint matching . . Proc. 12th Int. Conf. on Signal Processing , , 2014 . . 413 - - 418 . . DOI: 10.1109/icosp.2014.7015039 http://doi.org/10.1109/icosp.2014.7015039 . .
Z Zhang , , , D Li , , , K Wu . . Large-scale virtual machines provisioning in clouds: challenges and approaches . . Front. Comput. Sci. , , 2016 . . 10 ( ( 1 ): ): 2 - - 18 . . DOI: 10.1007/s11704-015-4420-7 http://doi.org/10.1007/s11704-015-4420-7 . .
Y Zhao , , , W Zhang , , , D Li , , , 等 . . DFIS: a scalable distributed fingerprint identification system . . 2015 . . Proc. 15th Int. Conf. on Algorithms and Architectures for Parallel Processing . . 162 - - 175 . . DOI: 10.1007/978-3-319-27137-8_13 http://doi.org/10.1007/978-3-319-27137-8_13 . .
E Zhu , , , J Yin , , , G Zhang . . Computation of fingerprint inter-ridge distance . . J. Microelectron. Comput. , , 2004 . . 21 ( ( 10 ): ): 7 - - 9 . . . .
E Zhu , , , J Yin , , , G Zhang . . Fingerprint matching based on global alignment of multiple reference minutiae . . Patt. Recog. , , 2005 . . 38 ( ( 10 ): ): 1685 - - 1694 . . DOI: 10.1016/j.patcog.2005.02.016 http://doi.org/10.1016/j.patcog.2005.02.016 . .
Publicity Resources
Related Articles
Related Author
Related Institution
京公网安备11010802024621