A robust object tracking framework based on a reliable point assignment algorithm#

Rong-feng ZHANG; Ting DENG; Gui-hong WANG; Jing-lun SHI; Quan-sheng GUAN

doi:10.1631/FITEE.1601464

Your Location：

Home >

Browse articles >

A robust object tracking framework based on a reliable point assignment algorithm#

Regular Papers | Updated：2022-05-19

- A robust object tracking framework based on a reliable point assignment algorithm#
- 基于可靠特征点分配算法的鲁棒性跟踪框架
- Frontiers of Information Technology & Electronic Engineering Vol. 18, Issue 4, Pages: 545-558(2017)
- Affiliations：
  
  1School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510641, China
  2School of Electronic and Information Engineering, Guangzhou College of South China University of Technology, Guangzhou 510800, China
  3Information Network Engineering and Research Center, South China University of Technology, Guangzhou 510641, China
- Author bio：
  
  E-mail:dengting@scut.edu.cn
- Funds：
- DOI：10.1631/FITEE.1601464
  CLC： TP391.41
- Received：14 August 2016，
  
  Accepted：21 December 2016，
  
  Published：2017-04
- Accepted：
Scan QR Code
Rong-feng ZHANG, Ting DENG, Gui-hong WANG, et al. A robust object tracking framework based on a reliable point assignment algorithm#[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(4): 545-558.
DOI：

Rong-feng ZHANG, Ting DENG, Gui-hong WANG, et al. A robust object tracking framework based on a reliable point assignment algorithm#[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(4): 545-558. DOI： 10.1631/FITEE.1601464.

摘要

视觉跟踪是近年来计算视觉最活跃的研究课题之一，已被广泛应用于许多视觉领域。然而，视觉跟踪技术仍然存在挑战，如目标发生光照变化、遮挡、外观形变等。为克服这些技术困难，本文提出基于小波变换的可靠特征点分配（Reliable point assignment

RPA）算法。通过搜索局部最大小波系数（Local maximal wavelet coefficients

LMWC）的位置，获得可靠特征点。在图像中，具有局部最大小波系数之处，表明该处图像信号发生了较大变化，因此，可靠特征点对图像噪声、光照变化和外观形变等情况都具有鲁棒性。此外，在检测中应用卡尔曼滤波器，以提高处理速度并减少误检率。最后，将所提出的RPA与卡尔曼滤波器集成到跟踪-学习-检测（Tracking-learning-detection

TLD）算法框架中，提高了跟踪精度，且降低了误检率。实验结果表明，新框架在精度、f值（f-measure）和平均重叠率（%）等方面均优于TLD和核化相关滤波器（KCF）这两个跟踪算法。

Abstract

Visual tracking

which has been widely used in many vision fields

has been one of the most active research topics in computer vision in recent years. However

there are still challenges in visual tracking

such as illumination change

object occlusion

and appearance deformation. To overcome these difficulties

a reliable point assignment (RPA) algorithm based on wavelet transform is proposed. The reliable points are obtained by searching the location that holds local maximal wavelet coefficients. Since the local maximal wavelet coefficients indicate high variation in the image

the reliable points are robust against image noise

illumination change

and appearance deformation. Moreover

a Kalman filter is applied to the detection step to speed up the detection processing and reduce false detection. Finally

the proposed RPA is integrated into the tracking-learning-detection (TLD) framework with the Kalman filter

which not only improves the tracking precision

but also reduces the false detections. Experimental results showed that the new framework outperforms TLD and kernelized correlation filters with respect to precision

f-measure

and average overlap in percent.

关键词

Keywords

references

H Bay , , , A Ess , , , T Tuytelaars , , , 等 . . Speeded-up robust features (SURF) . . Comput. Vis. Image Understand. , , 2008 . . 110 ( ( 3 ): ): 346 - - 359 . . DOI: 10.1016/j.cviu.2007.09.014 http://doi.org/10.1016/j.cviu.2007.09.014 . .

T Brox , , , A Bruhn , , , N Papenberg , , , 等 . . High accuracy optical flow estimation based on a theory for warping . . 2004 . . European Conf. on Computer Vision . . 25 - - 36 . . DOI: 10.1007/978-3-540-24673-2_3 http://doi.org/10.1007/978-3-540-24673-2_3 . .

CW Cheng , , , WL Ou , , , CP Fan . . Fast ellipse fitting based pupil tracking design for human-computer interaction applications . . 2016 . . IEEE Int. Conf. on Consumer Electronics . . 445 - - 446 . . DOI: 10.1109/ICCE.2016.7430685 http://doi.org/10.1109/ICCE.2016.7430685 . .

N Dalal , , , B Triggs . . Histograms of oriented gradients for human detection . . 2005 . . IEEE Computer Society Conf. on Com-puter Vision and Pattern Recognition . . 886 - - 893 . . DOI: 10.1109/CVPR.2005.177 http://doi.org/10.1109/CVPR.2005.177 . .

M Elhamod , , , MD Levine . . Automated real-time de-tection of potentially suspicious behavior in public transport areas . . IEEE Trans. Intell. Transp. Syst. , , 2013 . . 14 ( ( 2 ): ): 688 - - 699 . . DOI: 10.1109/TITS.2012.2228640 http://doi.org/10.1109/TITS.2012.2228640 . .

W Elmenreich , , , MA Koplin . . Time-triggered object tracking subsystem for advanced driver assistance systems . . Elektrotechn. Inform. , , 2011 . . 128 ( ( 6 ): ): 203 - - 208 . . DOI: 10.1007/s00502-011-0004-x http://doi.org/10.1007/s00502-011-0004-x . .

RC Gonzalez , , , RE Woods . . Digital Image Processing (2nd Ed.) , , 2002 . . : Inc., New Jersey : Prentice Hall , , . .

C Harris , , , M Stephens . . A combined corner and edge detector . . 1988 . . Proc. Alvey Vision Conf. . . 147 - - 151 . . DOI: 10.5244/C.2.23 http://doi.org/10.5244/C.2.23 . .

JF Henriques , , , R Caseiro , , , P Martins , , , 等 . . High-speed tracking with kernelized correlation filters . . IEEE Trans. Patt. Anal. Mach. Intell. , , 2015 . . 37 ( ( 3 ): ): 583 - - 596 . . DOI: 10.1109/TPAMI.2014.2345390 http://doi.org/10.1109/TPAMI.2014.2345390 . .

JM Jeong , , , TS Yoon , , , JB Park . . Kalman filter based multiple objects detection-tracking algorithm robust to occlusion . . 2014 . . Proc. SICE Annual Conf. . . 941 - - 946 . . DOI: 10.1109/SICE.2014.6935235 http://doi.org/10.1109/SICE.2014.6935235 . .

CX Jia , , , ZL Wang , , , X Wu , , , 等 . . A tracking-learning-detection (TLD) method with local binary pattern improved . . 2015 . . IEEE Int. Conf. on Robotics and Biomimetics . . 1625 - - 1630 . . DOI: 10.1109/ROBIO.2015.7419004 http://doi.org/10.1109/ROBIO.2015.7419004 . .

Y Jung , , , Y Yoon . . Behavior tracking model in dynamic situation using the risk ratio EM . . 2015 . . Int. Conf. on Information Networking . . 444 - - 448 . . DOI: 10.1109/ICOIN.2015.7057942 http://doi.org/10.1109/ICOIN.2015.7057942 . .

Z Kalal , , , K Mikolajczyk , , , J Matas . . Forward-backward error: automatic detection of tracking failures . . 2010a . . 20th Int. Conf. on Pattern Recognition . . 23 - - 26 . . DOI: 10.1109/ICPR.2010.675 http://doi.org/10.1109/ICPR.2010.675 . .

Z Kalal , , , J Matas , , , K Mikolajczyk . . P-N learning: bootstrapping binary classifiers by structural constraints . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2010b . . 49 - - 56 . . DOI: 10.1109/CVPR.2010.5540231 http://doi.org/10.1109/CVPR.2010.5540231 . .

Z Kalal , , , K Mikolajczyk , , , J Matas . . Tracking-learning-detection . . IEEE Trans. Patt. Anal. Mach. Intell. , , 2012 . . 34 ( ( 7 ): ): 1409 - - 1422 . . DOI: 10.1109/TPAMI.2011.239 http://doi.org/10.1109/TPAMI.2011.239 . .

RE Kalman . . A new approach to linear filtering and prediction problems . . J. Basic Eng. , , 1960 . . 82 ( ( 1 ): ): 35 - - 45 . . DOI: 10.1115/1.3662552 http://doi.org/10.1115/1.3662552 . .

H Kaur , , , JS Sahambi . . Vehicle tracking using fractional order Kalman filter for non-linear system . . 2015 . . Int. Conf. on Computing, Communication and Automation . . 474 - - 479 . . DOI: 10.1109/CCAA.2015.7148423 http://doi.org/10.1109/CCAA.2015.7148423 . .

H Kong , , , HC Akakin , , , SE Sarma . . A generalized Laplacian of Gaussian filter for blob detection and its applications . . IEEE Trans. Cybern. , , 2013 . . 43 ( ( 6 ): ): 1719 - - 1733 . . DOI: 10.1109/TSMCB.2012.2228639 http://doi.org/10.1109/TSMCB.2012.2228639 . .

Y Li , , , JK Zhu , , , oi H , , , S.C.H. . . Reliable patch trackers: robust visual tracking by exploiting reliable patches . . 2015 . . IEEE Conf. on Computer Vision and Pattern Recognition . . 353 - - 361 . . DOI: 10.1109/CVPR.2015.7298632 http://doi.org/10.1109/CVPR.2015.7298632 . .

S Liu , , , TZ Zhang , , , XC Cao , , , 等 . . Structural corre-lation filter for robust visual tracking . . 2016 . . IEEE Conf. on Computer Vision and Pattern Recognition . . 4312 - - 4320 . . DOI: 10.1109/CVPR.2016.467 http://doi.org/10.1109/CVPR.2016.467 . .

T Liu , , , G Wang , , , QX Yang . . Real-time part-based visual tracking via adaptive correlation filters . . 2015 . . IEEE Conf. on Computer Vision and Pattern Recognition . . 4902 - - 4912 . . DOI: 10.1109/CVPR.2015.7299124 http://doi.org/10.1109/CVPR.2015.7299124 . .

DG Lowe . . Distinctive image features from scale-invariant keypoints . . Int. J. Comput. Vis. , , 2004 . . 60 ( ( 2 ): ): 91 - - 110 . . DOI: 10.1023/B:VISI.0000029664.99615.94 http://doi.org/10.1023/B:VISI.0000029664.99615.94 . .

GH Ning , , , Z Zhang , , , C Huang , , , 等 . . Spatially su-pervised recurrent convolutional neural networks for visual object tracking . . arXiv:1607.05781v1 , , 2016 . . .

UM Prakash , , , VG Thamaraiselvi . . Detecting and tracking of multiple moving objects for intelligent video surveillance systems . . 2014 . . 2nd Int. Conf. on Current Trends in Engineering and Technology . . 253 - - 257 . . DOI: 10.1109/ICCTET.2014.6966297 http://doi.org/10.1109/ICCTET.2014.6966297 . .

J Redmon , , , S Divvala , , , R Girshick , , , 等 . . You only look once: unified, real-time object detection . . 2016 . . IEEE Conf. on Computer Vision and Pattern Recognition . . 779 - - 788 . . DOI: 10.1109/CVPR.2016.91 http://doi.org/10.1109/CVPR.2016.91 . .

X Sun , , , HX Yao , , , SP Zhang . . A refined particle filter method for contour tracking . . SPIE , , 2010 . . 774 77441M DOI: 10.1117/12.863450 http://doi.org/10.1117/12.863450 . .

MS Tarkov , , , SV Dubynin . . Real-time object tracking by CUDA-accelerated neural network . . J. Comput. Sci. Appl. , , 2013 . . 1 ( ( 1 ): ): 1 - - 4 . . DOI: 10.12691/jcsa-1-1-1 http://doi.org/10.12691/jcsa-1-1-1 . .

P Viola , , , M Jones . . Rapid object detection using a boosted cascade of simple features . . 2001 . . IEEE Computer Society Conf. on Computer Vision and Pattern Recognition . . 511 - - 518 . . DOI: 10.1109/CVPR.2001.990517 http://doi.org/10.1109/CVPR.2001.990517 . .

F Xu , , , M Gao . . Human detection and tracking based on HOG and particle filter . . 2010 . . 3rd Int. Congress on Image and Signal Processing . . 1503 - - 1507 . . DOI: 10.1109/CISP.2010.5646273 http://doi.org/10.1109/CISP.2010.5646273 . .

HM Yu , , , X Zeng . . Visual tracking combined with ranking vector SVM . . J. Zhejiang Univ. (Eng. Sci.) , , 2015 . . 9 ( ( 6 ): ): 1015 - - 1021 . . DOI: 10.3785/j.issn.1008-973X.2015.06.003 http://doi.org/10.3785/j.issn.1008-973X.2015.06.003 . .

WS Yu , , , XH Tian , , , ZQ Hou , , , 等 . . Multi-scale mean shift tracking . . IET Comput. Vis. , , 2015 . . 9 ( ( 6 ): ): 1015 - - 1021 . . DOI: 10.1049/iet-cvi.2014.0077 http://doi.org/10.1049/iet-cvi.2014.0077 . .

RF Zhang , , , HH Xiao , , , T Deng , , , 等 . . A robust point detection algorithm based on wavelet transform for visual tracking . . 2016 . . Int. Congress on Image and Signal Processing, Biomedical Engineering and Informatics . . 1 - - 5 . . DOI: 10.1109/CISP-BMEI.2016.7852672 http://doi.org/10.1109/CISP-BMEI.2016.7852672 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Robust object tracking with RGBD-based sparse learning

Filtering and tracking with trinion-valued adaptive algorithms#

A modified direct adaptive robust motion trajectory tracking controller of a pneumatic system

Related Author

Zi-ang MA

Zhi-yu XIANG

Xiao-ming GOU

Zhi-wen LIU

Wei LIU

You-gen XU

Peng-fei QIAN

Guo-liang TAO

Related Institution

College of Information Science and Electronic Engineering, Zhejiang University

Zhejiang Provincial Key Laboratory of Information Network Technology

School of Information and Electronics, Beijing Institute of Technology

Communications Research Group, Department of Electronic and Electrical Engineering, University of Sheffield

The State Key Laboratory of Fluid Power Transmission and Control, Zhejiang University

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰