Non-interactive automatic video segmentation of moving targets

Yu ZHOU; An-wen SHEN; Jin-bang XU

doi:10.1631/jzus.C1200071

Your Location：

Home >

Browse articles >

Non-interactive automatic video segmentation of moving targets

Computer & Automation | Updated：2022-12-09

- Non-interactive automatic video segmentation of moving targets
- Non-interactive automatic video segmentation of moving targets
- Frontiers of Information Technology & Electronic Engineering Vol. 13, Issue 10, Pages: 736-749(2012)
- Affiliations：
  
  Department of Control Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
- Author bio：
  
  [ "Yu ZHOU, E-mail: sherry.haku@gmail.com" ]
  Jin-bang XU, E-mail: xujinbang@mail.hust.edu.cn
- Funds：
- DOI：10.1631/jzus.C1200071
  CLC： TP751.1
- Received：15 March 2012，
  
  Revised：2012-;9-11，
  
  Published：2012-10
- Accepted：
Scan QR Code
Yu ZHOU, An-wen SHEN, Jin-bang XU. Non-interactive automatic video segmentation of moving targets[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(10): 736-749.
DOI：

Yu ZHOU, An-wen SHEN, Jin-bang XU. Non-interactive automatic video segmentation of moving targets[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(10): 736-749. DOI： 10.1631/jzus.C1200071.

摘要

Abstract

Extracting moving targets from video accurately is of great significance in the field of intelligent transport. To some extent

it is related to video segmentation or matting. In this paper

we propose a non-interactive automatic segmentation method for extracting moving targets. First

the motion knowledge in video is detected with orthogonal Gaussian-Hermite moments and the Otsu algorithm

and the knowledge is treated as foreground seeds. Second

the background seeds are generated with distance transformation based on foreground seeds. Third

the foreground and background seeds are treated as extra constraints

and then a mask is generated using graph cuts methods or closed-form solutions. Comparison showed that the closed-form solution based on soft segmentation has a better performance and that the extra constraint has a larger impact on the result than other parameters. Experiments demonstrated that the proposed method can effectively extract moving targets from video in real time.

关键词

Keywords

references

N. Apostoloff , , , A. Fitzgibbon . . Bayesian Video Matting Using Learnt Image Priors . . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , , 2004 . . p.407 - - 414 . . DOI: 10.1109/CVPR.2004.1315061 http://doi.org/10.1109/CVPR.2004.1315061 . .

Y. Boykov , , , V. Kolmogorov . . An experimental comparison of min-cut-max-flow algorithms for energy mini-mization in vision . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2004 . . 26 ( ( 9 ): ): 1124 - - 1137 . . DOI: 10.1109/TPAMI.2004.60 http://doi.org/10.1109/TPAMI.2004.60 . .

Y. Boykov , , , O. Veksler , , , R. Zabih . . Fast approximate energy minimization via graph cuts . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2001 . . 23 ( ( 11 ): ): 1222 - - 1239 . . DOI: 10.1109/34.969114 http://doi.org/10.1109/34.969114 . .

Y.Y. Boykov , , , M.P. Jolly . . Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Object in ND Images . . Proc. 8th IEEE Int. Conf. on Computer Vision , , 2001 . . p.105 - - 112 . . DOI: 10.1109/ICCV.2001.937505 http://doi.org/10.1109/ICCV.2001.937505 . .

Y. Chuang . . New Models and Methods for Matting and Compositing . . PhD Thesis, University of Washington, Washington D.C., USA , , 2004 . . .

Y. Chuang , , , B. Curless , , , D.H. Salesin , , , R. Szeliski . . A Bayesian Approach to Digital Matting . . Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition , , 2001 . . p.264 - - 271 . . DOI: 10.1109/CVPR.2001.990970 http://doi.org/10.1109/CVPR.2001.990970 . .

Y. Chuang , , , A. Agarwala , , , B. Curless , , , D.H. Salesin , , , R. Szeliski . . Video matting of complex scenes . . ACM Trans. Graph. , , 2002 . . 21 ( ( 3 ): ): 243 - - 248 . . DOI: 10.1145/566654.566572 http://doi.org/10.1145/566654.566572 . .

M.L. Gong , , , L. Wang , , , R.G. Yang , , , Y.H. Yang . . Real-Time Video Matting Using Multichannel Poisson Equations . . Proc. Graphics Interface , , 2010 . . p.89 - - 96 . . . .

M. Jiang , , , D. Crookes , , , M. Chen . . Multi-layer Stereo Video Matting:Video Matting . . Proc. Int. Conf. on Multi-media , , 2010 . . p.1163 - - 1166 . . DOI: 10.1145/1873951.1874177 http://doi.org/10.1145/1873951.1874177 . .

S.Y. Lee , , , J.C. Yoon , , , I.K. Lee . . Temporally coherent video matting . . Graph. Models , , 2010 . . 72 ( ( 3 ): ): 25 - - 33 . . DOI: 10.1016/j.gmod.2010.03.001 http://doi.org/10.1016/j.gmod.2010.03.001 . .

A. Levin , , , D. Lischinski , , , Y. Weiss . . Colorization using optimization . . ACM Trans. Graph. , , 2004 . . 23 ( ( 3 ): ): 689 - - 694 . . DOI: 10.1145/1015706.1015780 http://doi.org/10.1145/1015706.1015780 . .

A. Levin , , , D. Lischinski , , , Y. Weiss . . A closed-form solution to natural image matting . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2008 . . 30 ( ( 2 ): ): 228 - - 242 . . DOI: 10.1109/TPAMI.2007.1177 http://doi.org/10.1109/TPAMI.2007.1177 . .

S.Z. Li . . Markov Random Field Models in Computer Vision . . Springer Verlag, New York, USA , , 1995 . . p.1 - - 10 . . . .

W. Li , , , G.Q. Han , , , Y.C. Gu , , , X.Y. Zhang , , , S.K. Zhang . . Robust video matting algorithm . . J. Appl. Res. Comput. , , 2010 . . 27 ( ( 1 ): ): 358 - - 360, 376 . . DOI: 10.3969/j.issn.1001-3695.2010.01.107 http://doi.org/10.3969/j.issn.1001-3695.2010.01.107 . .

Y. Li , , , J. Sun , , , C.K. Tang , , , H.Y. Shum . . Lazy snapping . . ACM Trans. Graph. , , 2004 . . 23 ( ( 3 ): ): 303 - - 308 . . DOI: 10.1145/1015706.1015719 http://doi.org/10.1145/1015706.1015719 . .

M. McGuire , , , W. Matusik , , , H. Pfister , , , J.F. Hughes , , , F. Durand . . Defocus video matting . . ACM Trans. Graph. , , 2005 . . 24 ( ( 3 ): ): 567 - - 576 . . DOI: 10.1145/1073204.1073231 http://doi.org/10.1145/1073204.1073231 . .

Y. Rother , , , V. Kolmogorov , , , A. Blake . . "GrabCut"——interactive foreground extraction using iterated graph cuts . . ACM Trans. Graph. , , 2004 . . 23 ( ( 3 ): ): 309 - - 314 . . DOI: 10.1145/1015706.1015720 http://doi.org/10.1145/1015706.1015720 . .

A.R. Smith , , , J.F. Blinn . . Blue Screen Matting . . Proc. 23rd Annual Conf. on Computer Graphics and Interactive Techniques , , 1996 . . p.259 - - 268 . . DOI: 10.1145/237170.237263 http://doi.org/10.1145/237170.237263 . .

J. Sun , , , J. Jia , , , C.K. Tang , , , H.Y. Shum . . Poisson matting . . ACM Trans. Graph. , , 2004 . . 23 ( ( 3 ): ): 315 - - 321 . . DOI: 10.1145/1015706.1015721 http://doi.org/10.1145/1015706.1015721 . .

L. Vincent , , , P. Soille . . Watersheds in digital spaces:an efficient algorithm based on immersion simulations . . IEEE Trans. Pattern Anal. Mach. Intell. , , 1991 . . 13 ( ( 6 ): ): 583 - - 598 . . DOI: 10.1109/34.87344 http://doi.org/10.1109/34.87344 . .

J. Wang , , , M.F. Cohen . . An Iterative Optimization Approach for Unified Image Segmentation and Matting . . 10th IEEE Int. Conf. on Computer Vision , , 2005 . . p.936 - - 943 . . DOI: 10.1109/ICCV.2005.37 http://doi.org/10.1109/ICCV.2005.37 . .

J. Wang , , , M.F. Cohen . . Image and video matting:a survey . . Found. Trends Comput. Graph. Vis. , , 2007a . . 3 ( ( 2 ): ): 97 - - 175 . . DOI: 10.1561/0600000019 http://doi.org/10.1561/0600000019 . .

J. Wang , , , M.F. Cohen . . Optimized Color Sampling for Robust Matting . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2007b . . p.1 - - 8 . . DOI: 10.1109/CVPR.2007.383006 http://doi.org/10.1109/CVPR.2007.383006 . .

L. Wang , , , M.L. Gong , , , C.X. Zhang , , , R.G. Yang , , , C. Zhang , , , Y.H. Yang . . Automatic real-time video matting using time-of-flight camera and multichannel Poisson equations . . Int. J. Comput. Vis. , , 2012 . . 97 ( ( 1 ): ): 104 - - 121 . . DOI: 10.1007/s11263-011-0471-x http://doi.org/10.1007/s11263-011-0471-x . .

Y. Wu , , , J. Shen . . Moving object detection using orthogonal Gaussian Hermite moments . . SPIE , , 2004 . . 5308 841 - - 849 . . DOI: 10.1117/12.525427 http://doi.org/10.1117/12.525427 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

Xiaojun Bai

Yang Zhang

Haixing Wu

Yuting Wang

Shunfu Jin

Related Institution

School of Information Science and Engineering, Yanshan University

Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, Yanshan University

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰