Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method

Shi-yan WANG; Hui-min YU

doi:10.1631/jzus.C1100331

Your Location：

Home >

Browse articles >

Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method

Computer & Automation | Updated：2022-12-09

- Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method
- Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method
- Frontiers of Information Technology & Electronic Engineering Vol. 13, Issue 6, Pages: 428-439(2012)
- Affiliations：
  
  Department of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  [ "Shi-yan WANG, E-mail: wangshiyan@zju.edu.cn" ]
  Hui-min YU, E-mail: yhm2005@zju.edu.cn
- Funds：
- DOI：10.1631/jzus.C1100331
  CLC： TP391.7;TP317.4
- Received：15 November 2015，
  
  Revised：2012-;5-;9，
  
  Published：2012-06
- Accepted：
Scan QR Code
Shi-yan WANG, Hui-min YU. Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(6): 428-439.
DOI：

Shi-yan WANG, Hui-min YU. Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(6): 428-439. DOI： 10.1631/jzus.C1100331.

摘要

Abstract

A method based on 3D videos is proposed for multi-target segmentation and tracking with a moving viewing system. A spatiotemporal energy functional is built up to perform motion segmentation and estimation simultaneously. To overcome the limitation of the local minimum problem with the level set method

a convex relaxation method is applied to the 3D spatiotemporal segmentation model. The relaxed convex model is independent of the initial condition. A primal-dual algorithm is used to improve computational efficiency. Several indoor experiments show the validity of the proposed method.

关键词

Keywords

references

L. Alvarez , , , C.A. Castano , , , M. Garcia , , , K. Krissian , , , L. Mazorra , , , A. Salgado , , , J. Sanchez . . A new energy-based method for 3D motion estimation of incompressible PIV flows . . Comput. Vis. Image Understand. , , 2009 . . 113 ( ( 7 ): ): 802 - - 810 . . DOI: 10.1016/j.cviu.2009.01.005 http://doi.org/10.1016/j.cviu.2009.01.005 . .

Y. Boykov , , , G. Funka-Lea . . Graph cuts and efficient N-D image segmentation . . Int. J. Comput. Vis. , , 2006 . . 70 ( ( 2 ): ): 109 - - 131 . . DOI: 10.1007/s11263-006-7934-5 http://doi.org/10.1007/s11263-006-7934-5 . .

Y. Boykov , , , V. Kolmogorov . . An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2004 . . 26 ( ( 9 ): ): 1124 - - 1137 . . DOI: 10.1109/TPAMI.2004.60 http://doi.org/10.1109/TPAMI.2004.60 . .

X. Bresson , , , S. Esedoglu , , , P. Vandergheynst , , , J. Thiran , , , S. Osher . . Fast global minimization of the active contour/snake model . . J. Math. Imag. Vis. , , 2007 . . 28 ( ( 2 ): ): 151 - - 167 . . DOI: 10.1007/s10851-007-0002-0]MathSciNet http://doi.org/10.1007/s10851-007-0002-0]MathSciNet . .

V. Caselles , , , R. Kimmell , , , G. Sapiro . . Geodesic active contours . . Int. J. Comput. Vis. , , 1997 . . 22 ( ( 1 ): ): 61 - - 79 . . DOI: 10.1023/A:1007979827043]zbMATH http://doi.org/10.1023/A:1007979827043]zbMATH . .

A. Chambolle . . An algorithm for total variation minimization and applications . . J. Math. Imag. Vis. , , 2004 . . 20 ( ( 1-2 ): ): 89 - - 97 . . DOI: 10.1023/B:JMIV.0000011325.36760.1e]MathSciNet http://doi.org/10.1023/B:JMIV.0000011325.36760.1e]MathSciNet . .

T.F. Chan , , , L.A. Vese . . Active contours without edges . . IEEE Trans. Image Process. , , 2001 . . 10 ( ( 2 ): ): 266 - - 277 . . DOI: 10.1109/83.902291]zbMATH http://doi.org/10.1109/83.902291]zbMATH . .

T.F. Chan , , , G.H. Golub , , , P. Mulet . . A nonlinear primal-dual method for total variation-based image restoration . . SIAM J. Sci. Comput. , , 1999 . . 20 ( ( 6 ): ): 1964 - - 1977 . . DOI: 10.1137/S1064827596299767]MathSciNetzbMATH http://doi.org/10.1137/S1064827596299767]MathSciNetzbMATH . .

T.F. Chan , , , S. Esedoglu , , , M. Nikolova . . Algorithms for finding global minimizers of image segmentation and denoising models . . SIAM J. Appl. Math. , , 2004 . . 66 1632 - - 1648 . . DOI: 10.1137/040615286]MathSciNet http://doi.org/10.1137/040615286]MathSciNet . .

F. Dufaux , , , I. Moccagatta , , , F. Moscheni , , , H. Nicolas . . Vector quantization-based motion field segmentation under the entropy criterion . . J. Vis. Commun. Image Represent. , , 1994 . . 5 356 - - 369 . . DOI: 10.1006/jvci.1994.1034 http://doi.org/10.1006/jvci.1994.1034 . .

R. Feghali , , , A. Mitiche . . Spatiotemporal motion boundary detection and motion boundary velocity estimation for tracking moving objects with a moving camera: a level sets PDEs approach with concurrent camera motion compensation . . IEEE Trans. Image Process. , , 2004 . . 13 ( ( 11 ): ): 1473 - - 1490 . . DOI: 10.1109/TIP.2004.836158 http://doi.org/10.1109/TIP.2004.836158 . .

T. Goldstein , , , X. Bresson , , , S. Osher . . Geometric applications of the split Bregman method: segmentation and surface reconstruction . . J. Sci. Comput. , , 2009 . . 45 ( ( 1-3 ): ): 272 - - 293 . . DOI: 10.1007/s10915-009-9331-z]MathSciNet http://doi.org/10.1007/s10915-009-9331-z]MathSciNet . .

D.J. Heeger , , , A.D. Jepson . . Subspace methods for recovering rigid motion I: algorithm and implementation . . Int. J. Comput. Vis. , , 1992 . . 7 ( ( 2 ): ): 95 - - 117 . . DOI: 10.1007/BF00128130 http://doi.org/10.1007/BF00128130 . .

B.K.P. Horn , , , B.G. Schunck . . Determining optical flow . . Artif. Intell. , , 1981 . . 17 ( ( 1-3 ): ): 185 - - 203 . . DOI: 10.1016/0004-3702(81)90024-2 http://doi.org/10.1016/0004-3702(81)90024-2 . .

L. Jonasson , , , X. Bresson , , , P. Hagmann , , , O. Cuisenaire , , , R. Meuli , , , J.P. Thiran . . White matter fiber tract segmentation in DT-MRI using geometric flows . . Med. Image Anal. , , 2005 . . 9 ( ( 3 ): ): 223 - - 236 . . DOI: 10.1016/j.media.2004.07.004 http://doi.org/10.1016/j.media.2004.07.004 . .

M. Kass , , , A. Witkin , , , D. Terzopoulos . . Snakes: active contour models . . Int. J. Comput. Vis. , , 1988 . . 1 ( ( 4 ): ): 321 - - 331 . . DOI: 10.1007/BF00133570 http://doi.org/10.1007/BF00133570 . .

M.E. Leventon , , , W.E.L. Grimson , , , O. Faugeras . . Statistical Shape Influence in Geodesic Active Contours . . IEEE Conf. on Computer Vision and Pattern Recognition , , 2000 . . 1 316 - - 323 . . DOI: 10.1109/CVPR.2000.855835 http://doi.org/10.1109/CVPR.2000.855835 . .

H.C. Longuet-Higgins , , , K. Prazdny . . The interpretation of a moving retinal image . . Proc. R. Soc. Lond. B , , 1980 . . 208 ( ( 1173 ): ): 385 - - 397 . . DOI: 10.1098/rspb.1980.0057 http://doi.org/10.1098/rspb.1980.0057 . .

R. Malladi , , , R. Kimmel , , , D. Adalsteinsson , , , G. Sapiro , , , V. Caselles , , , J.A. Sethian . . A Geometric Approach to Segmentation and Analysis of 3D Medical Images . . Proc. Workshop on Mathematical Methods in Biomedical Image Analysis , , 1996 . . 244 - - 252 . . DOI: 10.1109/MMBIA.1996.534076 http://doi.org/10.1109/MMBIA.1996.534076 . .

B. Merriman , , , J.K. Bence , , , S.J. Osher . . Motion of multiple junctions: a level set approach . . J. Comput. Phys. , , 1994 . . 112 ( ( 2 ): ): 334 - - 363 . . DOI: 10.1006/jcph.1994.1105]MathSciNet http://doi.org/10.1006/jcph.1994.1105]MathSciNet . .

E. Mémin , , , P. Pérez . . Hierarchical estimation and segmentation of dense motion fields . . Int. J. Comput. Vis. , , 2002 . . 46 ( ( 2 ): ): 129 - - 155 . . DOI: 10.1023/A:1013539930159]zbMATH http://doi.org/10.1023/A:1013539930159]zbMATH . .

D. Mumford , , , J. Shah . . Optimal approximations of piecewise smooth functions and associated variational problems . . Commun. Pure Appl. Math. , , 1989 . . 42 ( ( 5 ): ): 577 - - 685 . . DOI: 10.1002/cpa.3160420503]MathSciNetzbMATH http://doi.org/10.1002/cpa.3160420503]MathSciNetzbMATH . .

K. Ohno , , , T. Nomura , , , S. Tadokoro . . Real-Time Robot Trajectory Estimation and 3D Map Construction Using 3D Camera . . IEEE/RSJ Int. Conf. on Intelligent Robots and Systems , , 2006 . . p.5279 - - 5285 . . DOI: 10.1109/IROS.2006.282027 http://doi.org/10.1109/IROS.2006.282027 . .

S. Osher , , , J. Sethian . . Fronts propagating with curvature dependent speed: algorithms based on the Hamilton-Jacobi formulation . . J. Comput. Phys. , , 1988 . . 79 ( ( 1 ): ): 12 - - 49 . . DOI: 10.1016/0021-9991(88)90002-2]MathSciNetzbMATH http://doi.org/10.1016/0021-9991(88)90002-2]MathSciNetzbMATH . .

N. Paragios , , , R. Deriche . . Geodesic active regions and level set methods for motion estimation and tracking . . Comput. Vis. Image Understand. , , 2005 . . 97 ( ( 3 ): ): 259 - - 282 . . DOI: 10.1016/j.cviu.2003.04.001 http://doi.org/10.1016/j.cviu.2003.04.001 . .

L.I. Rudin , , , S. Osher , , , E. Fatemi . . Nonlinear total variation based noise removal algorithms . . Phys. D , , 1992 . . 60 ( ( 1-4 ): ): 259 - - 268 . . DOI: 10.1016/0167-2789(92)90242-F]zbMATH http://doi.org/10.1016/0167-2789(92)90242-F]zbMATH . .

C. Schnorr . . Determining optical flow for irregular domains by minimizing quadratic functionals of a certain class . . Int. J. Comput. Vis. , , 1991 . . 6 ( ( 1 ): ): 25 - - 38 . . DOI: 10.1007/BF00127124]MathSciNet http://doi.org/10.1007/BF00127124]MathSciNet . .

S. Wang , , , H. Yu . . A Variational Approach for Ego-motion Estimation and Segmentation Based on 3D TOF Camera. 4th Int . . Congress on Image and Signal Processing , , 2011 . . 1160 - - 1164 . . DOI: 10.1109/CISP.2011.6100402 http://doi.org/10.1109/CISP.2011.6100402 . .

C. Ye , , , G.P.M. Hegde . . Robust Edge Extraction for SwissRange SR-3000 Range Image. Proc. IEEE Int. Conf . . on Robotics and Automation , , 2009 . . p.2437 - - 2442 . . DOI: 10.1109/ROBOT.2009.5152559 http://doi.org/10.1109/ROBOT.2009.5152559 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰