Detection of engineering vehicles in high-resolution monitoring images

LIU Xun; ZHANG Yin; ZHANG San-yuan; WANG Ying; LIANG Zhong-yan; YE Xiu-zi

doi:10.1631/FITEE.1500026

Your Location：

Home >

Browse articles >

Detection of engineering vehicles in high-resolution monitoring images

Computer & Automation | Updated：2022-06-06

- Detection of engineering vehicles in high-resolution monitoring images
- 基于高清监控图像的工程车辆检测算法
- Frontiers of Information Technology & Electronic Engineering Vol. 16, Issue 5, Pages: 346-357(2015)
- Affiliations：
  
  1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
  2.College of Mathematics and Information Science, Wenzhou University, Wenzhou 325035, China
- Author bio：
  
  [ "Xun LIU, E-mail: star.liuxun@gmail.com" ]
  Yin ZHANG, E-mail: yinzh@zju.edu.cn
  [ "San-yuan ZHANG, E-mail: syzhang@zju.edu.cn" ]
  [ "Ying WANG, E-mail: maggiewang0427@gmail.com" ]
- Funds：
- DOI：10.1631/FITEE.1500026
  CLC： TP391.41
- Received：20 January 2015，
  
  Revised：2015-04-09，
  
  Published：2015-05
- Accepted：
Scan QR Code
LIU Xun, ZHANG Yin, ZHANG San-yuan, et al. Detection of engineering vehicles in high-resolution monitoring images[J]. Frontiers of Information Technology & Electronic Engineering, 2015, 16(5): 346-357.
DOI：

LIU Xun, ZHANG Yin, ZHANG San-yuan, et al. Detection of engineering vehicles in high-resolution monitoring images[J]. Frontiers of Information Technology & Electronic Engineering, 2015, 16(5): 346-357. DOI： 10.1631/FITEE.1500026.

摘要

目的

基于监控图像，设计一种工程车辆检测算法，使其能快速高效地对工程车辆等组件可变铰链式刚体进行识别与检测。

创新点

模拟人类视觉检测过程，把检测算法分为粗提取与精确分类两个阶段。第一阶段提出“颜色频率”特征并用其优化HOG描述子。第二阶段改进一种显著性提取算法并用改进的算法来改善dense SIFT算子。两阶段结合，得到整体高效的检测算法。

方法

监控图像的特点是高空广角监控，工程车辆像素面积小，模拟人类视觉从复杂多样的物体中检测目标物体的过程，把检测过程分为粗提取阶段与精确分类阶段。人类在寻找目标物体时，一般会快速浏览这些复杂多样的物体群，遇到拟似目标物体，会多停留几秒来确认是否为真正的目标物体。粗提取阶段，加入“颜色频率”的HOG描述子(图3)和线性SVM分类器，快速扫描整张监控图像，从中提取出拟似工程车辆区域。这一阶段的目的是低漏检率快速提取拟似目标区域。精确分类阶段是采用显著性蒙版化的dense SIFT算子(图8)，去除第一阶段提取出的非工程车辆区域，得到最终的低漏检率低错检率的快速检测算法(图1)。

结论

针对监控图像的工程车辆等组件可变的铰链式刚体，提出一种先大范围粗提取后小范围精确分类的检测算法。算法不仅高效快速，且具有一定泛化性能。

Abstract

This paper presents a novel formulation for detecting objects with articulated rigid bodies from high-resolution monitoring images

particularly engineering vehicles. There are many pixels in high-resolution monitoring images

and most of them represent the background. Our method first detects object patches from monitoring images using a coarse detection process. In this phase

we build a descriptor based on histograms of oriented gradient

which contain color frequency information. Then we use a linear support vector machine to rapidly detect many image patches that may contain object parts

with a low false negative rate and a high false positive rate. In the second phase

we apply a refinement classification to determine the patches that actually contain objects. In this stage

we increase the size of the image patches so that they include the complete object using models of the object parts. Then an accelerated and improved salient mask is used to improve the performance of the dense scale-invariant feature transform descriptor. The detection process returns the absolute position of positive objects in the original images. We have applied our methods to three datasets to demonstrate their effectiveness.

关键词

Keywords

references

S. Avidan . SpatialBoost: adding spatial reasoning to AdaBoost . Proc. 9th European Conf. on Computer Vision , 2006 . p.386 - 396 . DOI: 10.1007/11744085_30 http://doi.org/10.1007/11744085_30 .

H. Bay , A. Ess , T. Tuytelaars , 等 . Speeded-up robust features (SURF) . Comput. Vis. Image Understand , 2008 . 110 ( 3 ): 346 - 359 . DOI: 10.1016/j.cviu.2007.09.014 http://doi.org/10.1016/j.cviu.2007.09.014 .

L. Breiman , P. Spector . Submodel selection and evaluation in regression . The X-random case. Int. Statist. Rev , 1992 . 60 ( 3 ): 291 - 319 . .

M. Calonder , V. Lepetit , C. Strecha , 等 . BRIEF: binary robust independent elementary features . Proc. 11th European Conf. on Computer Vision , 2010 . p.778 - 792 . DOI: 10.1007/978-3-642-15561-1_56 http://doi.org/10.1007/978-3-642-15561-1_56 .

N. Dalal , B. Triggs . Histograms of oriented gradients for human detection . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , 2005 . p.886 - 893 . DOI: 10.1109/CVPR.2005.177 http://doi.org/10.1109/CVPR.2005.177 .

O. Déniz , G. Bueno , J. Salido , 等 . Face recognition using histograms of oriented gradients . Patt. Recogn. Lett , 2011 . 32 ( 12 ): 1598 - 1603 . DOI: 10.1016/j.patrec.2011.01.004 http://doi.org/10.1016/j.patrec.2011.01.004 .

C. Dubout , F. Fleuret . Exact acceleration of linear object detectors . Proc. 12th European Conf. on Computer Vision , 2012 . p.301 - 311 . DOI: 10.1007/978-3-642-33712-3_22 http://doi.org/10.1007/978-3-642-33712-3_22 .

P.F. Felzenszwalb , D.P. Huttenlocher . Pictorial structures for object recognition . Int. J. Comput. Vis , 2005 . 61 ( 1 ): 55 - 79 . DOI: 10.1023/B:VISI.0000042934.15159.49 http://doi.org/10.1023/B:VISI.0000042934.15159.49 .

P.F. Felzenszwalb , R.B. Girshick , D. McAllester . Cascade object detection with deformable part models . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2010a . p.2241 - 2248 . DOI: 10.1109/CVPR.2010.5539906 http://doi.org/10.1109/CVPR.2010.5539906 .

P.F. Felzenszwalb , R.B. Girshick , D. McAllester , 等 . Object detection with discriminatively trained part-based models . IEEE Trans. Patt. Anal. Mach. Intell. , 2010b . 32 ( 9 ): 1627 - 1645 . DOI: 10.1109/TPAMI.2009.167 http://doi.org/10.1109/TPAMI.2009.167 .

M.A. Fischler , R.A. Elschlager . The representation and matching of pictorial structures . IEEE Trans. Comput , 1973 . 22 ( 1 ): 67 - 92 . .

S. Goferman , A. Tal , L. Zelnik-Manor . Puzzle-like collage . Comput. Graph. For , 2010 . 29 ( 2 ): 459 - 468 . DOI: 10.1111/j.1467-8659.2009.01615.x http://doi.org/10.1111/j.1467-8659.2009.01615.x .

S. Goferman , L. Zelnik-Manor , A. Tal . Contextaware saliency detection . IEEE Trans. Patt. Anal. Mach. Intell , 2012 . 34 ( 10 ): 1915 - 1926 . DOI: 10.1109/TPAMI.2011.272 http://doi.org/10.1109/TPAMI.2011.272 .

K. Grauman , T. Darrell . The pyramid match kernel: discriminative classification with sets of image features . Proc. 10th IEEE Int. Conf. on Computer Vision , 2005 . p.1458 - 1465 . DOI: 10.1109/ICCV.2005.239 http://doi.org/10.1109/ICCV.2005.239 .

L. Itti , C. Koch . Computational modelling of visual attention . Nat. Rev. Neurosci , 2001 . 2 ( 3 ): 194 - 203 . DOI: 10.1038/35058500 http://doi.org/10.1038/35058500 .

L. Juan , O. Gwun . A comparison of SIFT, PCA-SIFT and SURF . Int. J. Image Process , 2009 . 3 ( 4 ): 143 - 152 . .

C. Kanan , G. Cottrell . Robust classification of objects, faces, and flowers using natural image statistics . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2010 . p.2472 - 2479 . DOI: 10.1109/CVPR.2010.5539947 http://doi.org/10.1109/CVPR.2010.5539947 .

C. Kanan , M.H. Tong , L. Zhang , 等 . SUN: topdown saliency using natural statistics . Vis. Cogn. , 2009 . 17 ( 6-7 ): 979 - 1003 . DOI: 10.1080/13506280902771138 http://doi.org/10.1080/13506280902771138 .

Y. Ke , R. Sukthankar . PCA-SIFT: a more distinctive representation for local image descriptors . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , 2004 . p.506 - 513 . DOI: 10.1109/CVPR.2004.1315206 http://doi.org/10.1109/CVPR.2004.1315206 .

T. Kobayashi . HOG: feature extraction based on histograms of oriented p.d.f gradients for image classification . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2013 . p.747 - 754 . DOI: 10.1109/CVPR.2013.102 http://doi.org/10.1109/CVPR.2013.102 .

I. Kokkinos . Rapid deformable object detection using dual-tree branch-and-bound . Advances in Neural Information Processing Systems , 2011 . p.2681 - 2689 . .

S. Lazebnik , C. Schmid , J. Ponce . Beyond bags of features: spatial pyramid matching for recognizing natural scene categories . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , 2006 . p.2169 - 2178 . DOI: 10.1109/CVPR.2006.68 http://doi.org/10.1109/CVPR.2006.68 .

S. Leutenegger , M. Chli , R.Y. Siegwart . BRISK: binary robust invariant scalable keypoints . Proc. IEEE Int. Conf. on Computer Vision , 2011 . p.2548 - 2555 . DOI: 10.1109/ICCV.2011.6126542 http://doi.org/10.1109/ICCV.2011.6126542 .

F.F. Li , P. Perona . A Bayesian hierarchical model for learning natural scene categories . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , 2005 . p.524 - 531 . DOI: 10.1109/CVPR.2005.16 http://doi.org/10.1109/CVPR.2005.16 .

F.F. Li , R. Fergus , P. Perona . Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories . Comput. Vis. Image Understand , 2007 . 106 ( 1 ): 59 - 70 . DOI: 10.1016/j.cviu.2005.09.012 http://doi.org/10.1016/j.cviu.2005.09.012 .

W.H. Li , Y.F. Lin , B. Fu , 等 . Cascade classifier using combination of histograms of oriented gradients for rapid pedestrian detection . J. Softw , 2013 . 8 ( 1 ): 71 - 77 . DOI: 10.4304/jsw.8.1.71-77 http://doi.org/10.4304/jsw.8.1.71-77 .

C. Liu , J. Yuen , A. Torralba , 等 . SIFT flow: dense correspondence across different scenes . Proc. 10th European Conf. on Computer Vision , 2008 . p.28 - 42 . DOI: 10.1007/978-3-540-88690-7_3 http://doi.org/10.1007/978-3-540-88690-7_3 .

D.G. Lowe . Distinctive image features from scaleinvariant keypoints . Int. J. Comput. Vis , 2004 . 60 ( 2 ): 91 - 110 . DOI: 10.1023/B:VISI.0000029664.99615.94 http://doi.org/10.1023/B:VISI.0000029664.99615.94 .

T. Ojala , M. Pietikainen , T. Maenpaa . Multiresolution gray-scale and rotation invariant texture classification with local binary patterns . IEEE Trans. Patt. Anal. Mach. Intell , 2002 . 24 ( 7 ): 971 - 987 . DOI: 10.1109/TPAMI.2002.1017623 http://doi.org/10.1109/TPAMI.2002.1017623 .

N. Otsu . A threshold selection method from gray-level histograms . Automatica , 1975 . 11 23 - 27 . .

P. Ott , M. Everingham . Implicit color segmentation features for pedestrian and object detection . Proc. IEEE 12th Int. Conf. on Computer vision , 2009 . p.723 - 730 . DOI: 10.1109/ICCV.2009.5459238 http://doi.org/10.1109/ICCV.2009.5459238 .

M. Pedersoli , A. Vedaldi , J. Gonzàlez , 等 . A coarse-to-fine approach for fast deformable object detection . Patt. Recogn , 2015 . 48 ( 5 ): 1844 - 1853 . DOI: 10.1016/j.patcog.2014.11.006 http://doi.org/10.1016/j.patcog.2014.11.006 .

E. Rahtu , J. Kannala , M. Salo , 等 . Segmenting salient objects from images and videos . Proc. 11th European Conf. on Computer Vision , 2010 . p.366 - 379 . DOI: 10.1007/978-3-642-15555-0_27 http://doi.org/10.1007/978-3-642-15555-0_27 .

U. Rutishauser , D. Walther , C. Koch , 等 . Is bottom-up attention useful for object recognition . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , 2004 . p.37 - 44 . DOI: 10.1109/CVPR.2004.1315142 http://doi.org/10.1109/CVPR.2004.1315142 .

A. Santella , M. Agrawala , D. DeCarlo , 等 . Gazebased interaction for semi-automatic photo cropping . Proc. SIGCHI Conf. on Human Factors in Computing Systems , 2006 . p.771 - 780 . DOI: 10.1145/1124772.1124886 http://doi.org/10.1145/1124772.1124886 .

E. Tola , V. Lepetit , P. Fua . DAISY: an efficient dense descriptor applied to wide-baseline stereo . IEEE Trans. Patt. Anal. Mach. Intell , 2010 . 32 ( 5 ): 815 - 830 . DOI: 10.1109/TPAMI.2009.77 http://doi.org/10.1109/TPAMI.2009.77 .

K.E.A. van de Sande , T. Gevers , C.G.M. Snoek . Evaluating color descriptors for object and scene recognition . IEEE Trans. Patt. Anal. Mach. Intell , 2010 . 32 ( 9 ): 1582 - 1596 . DOI: 10.1109/TPAMI.2009.154 http://doi.org/10.1109/TPAMI.2009.154 .

A. Vedaldi , B. Fulkerson . VLFeat: an open and portable library of computer vision algorithms . Proc. Int. Conf. on Multimedia , 2010 . p.1469 - 1472 . DOI: 10.1145/1873951.1874249 http://doi.org/10.1145/1873951.1874249 .

F. Wilcoxon . Individual comparisons by ranking methods . Biometr. Bull , 1945 . 1 ( 6 ): 80 - 83 . .

J.X. Wu , J.M. Rehg . Beyond the Euclidean distance: creating effective visual codebooks using the histogram intersection kernel . Proc. IEEE 12th Int. Conf. on Computer Vision , 2009 . p.630 - 637 . DOI: 10.1109/ICCV.2009.5459178 http://doi.org/10.1109/ICCV.2009.5459178 .

J.J. Yan , Z. Lei , L.Y. Wen , 等 . The fastest deformable part model for object detection . Proc. IEEE Conf. on Computer Vision and Pattern Recognition , 2014 . p.2497 - 2504 . DOI: 10.1109/CVPR.2014.320 http://doi.org/10.1109/CVPR.2014.320 .

F. Zaklouta , B. Stanciulescu . Real-time traffic sign recognition in three stages . Robot. Auton. Syst , 2014 . 62 ( 1 ): 16 - 24 . DOI: 10.1016/j.robot.2012.07.019 http://doi.org/10.1016/j.robot.2012.07.019 .

J. Zhang , M. Marszalek , S. Lazebnik , 等 . Local features and kernels for classification of texture and object categories: a comprehensive study . Int. J. Comput. Vis , 2007 . 73 ( 2 ): 213 - 238 . DOI: 10.1007/s11263-006-9794-4 http://doi.org/10.1007/s11263-006-9794-4 .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

S3Det: a fast object detector for remote sensing images based on artificial to spiking neural network conversion

UI layers merger: merging UI layers via visual learning and boundary prior

A modified YOLOv4 detection method for a vision-based underwater garbage cleaning robot^&

Automatic analysis of deep-water remotely operated vehicle footage for estimation of Norway lobster abundance

Related Author

Mingqian SUN

Xiaofeng QI

Yanzhao GAO

Guangwei XIE

Fan ZHANG

Li CHEN

Jiazhi LI

Yanfang CHANG

Related Institution

National Digital Switching System Engineering & Technological R&D Center

Computation and Artificial Intelligence Innovative College, Fudan University

School of Cyber Science and Engineering, Southeast University

School of Software Technology, Zhejiang University

College of Computer Science and Technology, Zhejiang University

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰