Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method

Shi-yan WANG; Hui-min YU

doi:10.1631/jzus.C1100331

Your Location：

Home >

Browse articles >

Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method

计算机与自动化 | Updated：2022-12-09

- Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method
- Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method
- 信息与电子工程前沿（英文） 2012年13卷第6期页码：428-439
- Affiliations：
  
  Department of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  [ "Shi-yan WANG, E-mail: wangshiyan@zju.edu.cn" ]
  Hui-min YU, E-mail: yhm2005@zju.edu.cn
- Funds：
  
  Project supported by the National Natural Science Foundation of China (No. 60872069) and the National Basic Research Program (973) of China (No. 2012CB316400)
- DOI：10.1631/jzus.C1100331
  中图分类号： TP391.7;TP317.4
- 收稿：2015-11-15，
  
  修回：2012-;5-;9，
  
  纸质出版：2012-06
- Accepted：
Scan QR Code
Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method[J]. 信息与电子工程前沿（英文）, 2012,13(6):428-439.

Shi-yan WANG, Hui-min YU. Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(6): 428-439.
Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method[J]. 信息与电子工程前沿（英文）, 2012,13(6):428-439. DOI： 10.1631/jzus.C1100331.

Shi-yan WANG, Hui-min YU. Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(6): 428-439. DOI： 10.1631/jzus.C1100331.

摘要

Abstract

A method based on 3D videos is proposed for multi-target segmentation and tracking with a moving viewing system. A spatiotemporal energy functional is built up to perform motion segmentation and estimation simultaneously. To overcome the limitation of the local minimum problem with the level set method

a convex relaxation method is applied to the 3D spatiotemporal segmentation model. The relaxed convex model is independent of the initial condition. A primal-dual algorithm is used to improve computational efficiency. Several indoor experiments show the validity of the proposed method.

关键词

Keywords

references

L. Alvarez , , , C.A. Castano , , , M. Garcia , , , K. Krissian , , , L. Mazorra , , , A. Salgado , , , J. Sanchez . . A new energy-based method for 3D motion estimation of incompressible PIV flows . . Comput. Vis. Image Understand. , , 2009 . . 113 ( ( 7 ): ): 802 - - 810 . . DOI: 10.1016/j.cviu.2009.01.005 http://doi.org/10.1016/j.cviu.2009.01.005 . .

Y. Boykov , , , G. Funka-Lea . . Graph cuts and efficient N-D image segmentation . . Int. J. Comput. Vis. , , 2006 . . 70 ( ( 2 ): ): 109 - - 131 . . DOI: 10.1007/s11263-006-7934-5 http://doi.org/10.1007/s11263-006-7934-5 . .

Y. Boykov , , , V. Kolmogorov . . An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2004 . . 26 ( ( 9 ): ): 1124 - - 1137 . . DOI: 10.1109/TPAMI.2004.60 http://doi.org/10.1109/TPAMI.2004.60 . .

X. Bresson , , , S. Esedoglu , , , P. Vandergheynst , , , J. Thiran , , , S. Osher . . Fast global minimization of the active contour/snake model . . J. Math. Imag. Vis. , , 2007 . . 28 ( ( 2 ): ): 151 - - 167 . . DOI: 10.1007/s10851-007-0002-0]MathSciNet http://doi.org/10.1007/s10851-007-0002-0]MathSciNet . .

V. Caselles , , , R. Kimmell , , , G. Sapiro . . Geodesic active contours . . Int. J. Comput. Vis. , , 1997 . . 22 ( ( 1 ): ): 61 - - 79 . . DOI: 10.1023/A:1007979827043]zbMATH http://doi.org/10.1023/A:1007979827043]zbMATH . .

A. Chambolle . . An algorithm for total variation minimization and applications . . J. Math. Imag. Vis. , , 2004 . . 20 ( ( 1-2 ): ): 89 - - 97 . . DOI: 10.1023/B:JMIV.0000011325.36760.1e]MathSciNet http://doi.org/10.1023/B:JMIV.0000011325.36760.1e]MathSciNet . .

T.F. Chan , , , L.A. Vese . . Active contours without edges . . IEEE Trans. Image Process. , , 2001 . . 10 ( ( 2 ): ): 266 - - 277 . . DOI: 10.1109/83.902291]zbMATH http://doi.org/10.1109/83.902291]zbMATH . .

T.F. Chan , , , G.H. Golub , , , P. Mulet . . A nonlinear primal-dual method for total variation-based image restoration . . SIAM J. Sci. Comput. , , 1999 . . 20 ( ( 6 ): ): 1964 - - 1977 . . DOI: 10.1137/S1064827596299767]MathSciNetzbMATH http://doi.org/10.1137/S1064827596299767]MathSciNetzbMATH . .

T.F. Chan , , , S. Esedoglu , , , M. Nikolova . . Algorithms for finding global minimizers of image segmentation and denoising models . . SIAM J. Appl. Math. , , 2004 . . 66 1632 - - 1648 . . DOI: 10.1137/040615286]MathSciNet http://doi.org/10.1137/040615286]MathSciNet . .

F. Dufaux , , , I. Moccagatta , , , F. Moscheni , , , H. Nicolas . . Vector quantization-based motion field segmentation under the entropy criterion . . J. Vis. Commun. Image Represent. , , 1994 . . 5 356 - - 369 . . DOI: 10.1006/jvci.1994.1034 http://doi.org/10.1006/jvci.1994.1034 . .

R. Feghali , , , A. Mitiche . . Spatiotemporal motion boundary detection and motion boundary velocity estimation for tracking moving objects with a moving camera: a level sets PDEs approach with concurrent camera motion compensation . . IEEE Trans. Image Process. , , 2004 . . 13 ( ( 11 ): ): 1473 - - 1490 . . DOI: 10.1109/TIP.2004.836158 http://doi.org/10.1109/TIP.2004.836158 . .

T. Goldstein , , , X. Bresson , , , S. Osher . . Geometric applications of the split Bregman method: segmentation and surface reconstruction . . J. Sci. Comput. , , 2009 . . 45 ( ( 1-3 ): ): 272 - - 293 . . DOI: 10.1007/s10915-009-9331-z]MathSciNet http://doi.org/10.1007/s10915-009-9331-z]MathSciNet . .

D.J. Heeger , , , A.D. Jepson . . Subspace methods for recovering rigid motion I: algorithm and implementation . . Int. J. Comput. Vis. , , 1992 . . 7 ( ( 2 ): ): 95 - - 117 . . DOI: 10.1007/BF00128130 http://doi.org/10.1007/BF00128130 . .

B.K.P. Horn , , , B.G. Schunck . . Determining optical flow . . Artif. Intell. , , 1981 . . 17 ( ( 1-3 ): ): 185 - - 203 . . DOI: 10.1016/0004-3702(81)90024-2 http://doi.org/10.1016/0004-3702(81)90024-2 . .

L. Jonasson , , , X. Bresson , , , P. Hagmann , , , O. Cuisenaire , , , R. Meuli , , , J.P. Thiran . . White matter fiber tract segmentation in DT-MRI using geometric flows . . Med. Image Anal. , , 2005 . . 9 ( ( 3 ): ): 223 - - 236 . . DOI: 10.1016/j.media.2004.07.004 http://doi.org/10.1016/j.media.2004.07.004 . .

M. Kass , , , A. Witkin , , , D. Terzopoulos . . Snakes: active contour models . . Int. J. Comput. Vis. , , 1988 . . 1 ( ( 4 ): ): 321 - - 331 . . DOI: 10.1007/BF00133570 http://doi.org/10.1007/BF00133570 . .

M.E. Leventon , , , W.E.L. Grimson , , , O. Faugeras . . Statistical Shape Influence in Geodesic Active Contours . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2000 . . 1 316 - - 323 . . DOI: 10.1109/CVPR.2000.855835 http://doi.org/10.1109/CVPR.2000.855835 . .

H.C. Longuet-Higgins , , , K. Prazdny . . The interpretation of a moving retinal image . . Proc. R. Soc. Lond. B , , 1980 . . 208 ( ( 1173 ): ): 385 - - 397 . . DOI: 10.1098/rspb.1980.0057 http://doi.org/10.1098/rspb.1980.0057 . .

R. Malladi , , , R. Kimmel , , , D. Adalsteinsson , , , G. Sapiro , , , V. Caselles , , , J.A. Sethian . . A Geometric Approach to Segmentation and Analysis of 3D Medical Images . . Proc. Workshop on Mathematical Methods in Biomedical Image Analysis , , 1996 . . 244 - - 252 . . DOI: 10.1109/MMBIA.1996.534076 http://doi.org/10.1109/MMBIA.1996.534076 . .

B. Merriman , , , J.K. Bence , , , S.J. Osher . . Motion of multiple junctions: a level set approach . . J. Comput. Phys. , , 1994 . . 112 ( ( 2 ): ): 334 - - 363 . . DOI: 10.1006/jcph.1994.1105]MathSciNet http://doi.org/10.1006/jcph.1994.1105]MathSciNet . .

E. Mémin , , , P. Pérez . . Hierarchical estimation and segmentation of dense motion fields . . Int. J. Comput. Vis. , , 2002 . . 46 ( ( 2 ): ): 129 - - 155 . . DOI: 10.1023/A:1013539930159]zbMATH http://doi.org/10.1023/A:1013539930159]zbMATH . .

D. Mumford , , , J. Shah . . Optimal approximations of piecewise smooth functions and associated variational problems . . Commun. Pure Appl. Math. , , 1989 . . 42 ( ( 5 ): ): 577 - - 685 . . DOI: 10.1002/cpa.3160420503]MathSciNetzbMATH http://doi.org/10.1002/cpa.3160420503]MathSciNetzbMATH . .

K. Ohno , , , T. Nomura , , , S. Tadokoro . . Real-Time Robot Trajectory Estimation and 3D Map Construction Using 3D Camera . . IEEE/RSJ Int. Conf. on Intelligent Robots and Systems , , 2006 . . p.5279 - - 5285 . . DOI: 10.1109/IROS.2006.282027 http://doi.org/10.1109/IROS.2006.282027 . .

S. Osher , , , J. Sethian . . Fronts propagating with curvature dependent speed: algorithms based on the Hamilton-Jacobi formulation . . J. Comput. Phys. , , 1988 . . 79 ( ( 1 ): ): 12 - - 49 . . DOI: 10.1016/0021-9991(88)90002-2]MathSciNetzbMATH http://doi.org/10.1016/0021-9991(88)90002-2]MathSciNetzbMATH . .

N. Paragios , , , R. Deriche . . Geodesic active regions and level set methods for motion estimation and tracking . . Comput. Vis. Image Understand. , , 2005 . . 97 ( ( 3 ): ): 259 - - 282 . . DOI: 10.1016/j.cviu.2003.04.001 http://doi.org/10.1016/j.cviu.2003.04.001 . .

L.I. Rudin , , , S. Osher , , , E. Fatemi . . Nonlinear total variation based noise removal algorithms . . Phys. D , , 1992 . . 60 ( ( 1-4 ): ): 259 - - 268 . . DOI: 10.1016/0167-2789(92)90242-F]zbMATH http://doi.org/10.1016/0167-2789(92)90242-F]zbMATH . .

C. Schnorr . . Determining optical flow for irregular domains by minimizing quadratic functionals of a certain class . . Int. J. Comput. Vis. , , 1991 . . 6 ( ( 1 ): ): 25 - - 38 . . DOI: 10.1007/BF00127124]MathSciNet http://doi.org/10.1007/BF00127124]MathSciNet . .

S. Wang , , , H. Yu . . A Variational Approach for Ego-motion Estimation and Segmentation Based on 3D TOF Camera. 4th Int . . Congress on Image and Signal Processing , , 2011 . . 1160 - - 1164 . . DOI: 10.1109/CISP.2011.6100402 http://doi.org/10.1109/CISP.2011.6100402 . .

C. Ye , , , G.P.M. Hegde . . Robust Edge Extraction for SwissRange SR-3000 Range Image. Proc. IEEE Int. Conf . . on Robotics and Automation , , 2009 . . p.2437 - - 2442 . . DOI: 10.1109/ROBOT.2009.5152559 http://doi.org/10.1109/ROBOT.2009.5152559 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据