Preserving global features of fluid animation from a single image using video examples

Yan GUI; Li-zhuang MA; Chao YIN; Zhi-hua CHEN

doi:10.1631/jzus.C1100342

Your Location：

Home >

Browse articles >

Preserving global features of fluid animation from a single image using video examples

Computer & Automation | Updated：2022-12-09

- Preserving global features of fluid animation from a single image using video examples
- Preserving global features of fluid animation from a single image using video examples
- Frontiers of Information Technology & Electronic Engineering Vol. 13, Issue 7, Pages: 510-519(2012)
- Affiliations：
  
  1.School of Electronic, Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
  2.Department of Computer Science and Engineering, East China University of Science and Technology, Shanghai 200237, China
- Author bio：
  
  [ "Yan GUI, E-mail: guiyan122@sjtu.edu.cn" ]
- Funds：
- DOI：10.1631/jzus.C1100342
  CLC： TP391.4
- Received：18 November 2011，
  
  Revised：2012-;5-31，
  
  Published：2012-07
- Accepted：
Scan QR Code
Yan GUI, Li-zhuang MA, Chao YIN, et al. Preserving global features of fluid animation from a single image using video examples[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(7): 510-519.
DOI：

Yan GUI, Li-zhuang MA, Chao YIN, et al. Preserving global features of fluid animation from a single image using video examples[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(7): 510-519. DOI： 10.1631/jzus.C1100342.

摘要

Abstract

We synthesize animations from a single image by transferring fluid motion of a video example globally. Given a target image of a fluid scene

an alpha matte is required to extract the fluid region. Our method needs to adjust a user-specified video example for producing the fluid motion suitable for the extracted fluid region. Employing the fluid video database

the flow field of the target image is obtained by warping the optical flow of a video frame that has a visually similar scene to the target image according to their scene correspondences

which assigns fluid orientation and speed automatically. Results show that our method is successful in preserving large fluid features in the synthesized animations. In comparison to existing approaches

it is both possible and useful to utilize our method to create flow animations with higher quality.

关键词

Keywords

references

W.A. Barrett , , , A.S. Cheney . . Object-Based Image Editing . . SIGGRAPH , , 2002 . . p.777 - - 784 . . DOI: 10.1145/566570.566651 http://doi.org/10.1145/566570.566651 . .

K.S. Bhat , , , S.M. Seitz , , , J.K. Hodgins , , , P.K. Khosla . . Flow-based video synthesis and editing . . ACM Trans. Graph. , , 2004 . . 23 ( ( 3 ): ): 360 - - 363 . . DOI: 10.1145/1015706.1015729 http://doi.org/10.1145/1015706.1015729 . .

G.J. Brostow , , , I. Essa . . Image-Based Motion Blur for Stop Motion Animation . . SIGGRAPH , , 2001 . . p.561 - - 566 . . DOI: 10.1145/383259.383325 http://doi.org/10.1145/383259.383325 . .

T. Brox , , , J. Malik . . Large displacement optical flow: descriptor matching in variational motion estimation . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2011 . . 33 ( ( 3 ): ): 500 - - 513 . . DOI: 10.1109/TPAMI.2010.143 http://doi.org/10.1109/TPAMI.2010.143 . .

T. Brox , , , A. Bruhn , , , N. Papenberg , , , J. Weickert . . High Accuracy Optical Flow Estimation Based on a Theory for Warping . . 8th European Conf. on Computer Vision , , 2004 . . p.25 - - 36 . . . .

Y.Y. Chuang , , , D.B. Goldman , , , K.C. Zheng , , , B. Curless , , , D.H. Salesin , , , R. Szeliski . . Animating pictures with stochastic motion textures . . ACM Trans. Graph. , , 2005 . . 24 ( ( 3 ): ): 853 - - 860 . . DOI: 10.1145/1073204.1073273 http://doi.org/10.1145/1073204.1073273 . .

T. Corpetti , , , E. Memin , , , P. Perez . . Dense estimation of fluid flows . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2002 . . 24 ( ( 3 ): ): 365 - - 380 . . DOI: 10.1109/34.990137 http://doi.org/10.1109/34.990137 . .

N. Courty , , , T. Corpetti . . Crowd motion capture . . Comput. Anim. Virt. Worlds , , 2007 . . 18 ( ( 4-5 ): ): 361 - - 370 . . DOI: 10.1002/cav.199 http://doi.org/10.1002/cav.199 . .

G. Doretto , , , A. Chiuso , , , Y.N. Wu , , , S. Soatto . . Dynamic textures . . Int. J. Comput. Vis. , , 2003 . . 51 ( ( 2 ): ): 91 - - 109 . . DOI: 10.1023/A:1021669406132 http://doi.org/10.1023/A:1021669406132 . .

W.T. Freeman , , , E.H. Adelson , , , D.J. Heeger . . Motion without Movement . . SIGGRAPH , , 1991 . . p.27 - - 30 . . DOI: 10.1145/122718.122721 http://doi.org/10.1145/122718.122721 . .

D.J. Heeger , , , J.R. Bergen . . Pyramid-Based Texture Analysis/Synthesis . . SIGGRAPH , , 1995 . . p.229 - - 238 . . DOI: 10.1145/218380.218446 http://doi.org/10.1145/218380.218446 . .

T. Igarashi , , , T. Moscovich , , , J.F. Hughes . . As-Rigidas-Possible Shape Manipulation . . SIGGRAPH , , 2005 . . p.1134 - - 1141 . . DOI: 10.1145/1186822.1073323 http://doi.org/10.1145/1186822.1073323 . .

V. Kwatra , , , A. Schodl , , , I. Essa , , , G. Turk , , , A. Bobick . . Graphcut textures: image and video synthesis using graph cuts . . ACM Trans. Graph. , , 2003 . . 22 ( ( 3 ): ): 277 - - 286 . . DOI: 10.1145/882262.882264 http://doi.org/10.1145/882262.882264 . .

A. Levin , , , D. Lischinski , , , Y. Weiss . . A closed-form solution to natural image matting . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2008 . . 30 ( ( 2 ): ): 228 - - 242 . . DOI: 10.1109/TPAMI.2007.1177 http://doi.org/10.1109/TPAMI.2007.1177 . .

Z. Lin , , , L. Wang , , , Y. Wang , , , S.B. Kang , , , T. Fang . . High resolution animated scenes from stills . . IEEE Trans. Visual. Comput. Graph. , , 2007 . . 13 ( ( 3 ): ): 562 - - 568 . . DOI: 10.1109/TVCG.2007.1005 http://doi.org/10.1109/TVCG.2007.1005 . .

P. Litwinowicz , , , L. Williams . . Animating Images with Drawings . . SIGGRAPH , , 1994 . . p.409 - - 412 . . DOI: 10.1145/192161.192270 http://doi.org/10.1145/192161.192270 . .

C. Liu , , , J. Yuen , , , A. Torralba , , , J. Sivic , , , W.T. Freeman . . SIFT flow: dense correspondence across different scenes . . LNCS , , 2008 . . 5304 28 - - 42 . . DOI: 10.1007/978-3-540-88690-7_3 http://doi.org/10.1007/978-3-540-88690-7_3 . .

D.G. Lowe . . Distinctive image features from scaleinvariant keypoints . . Int. J. Comput. Vis. , , 2004 . . 60 ( ( 2 ): ): 91 - - 110 . . DOI: 10.1023/B:VISI.0000029664.99615.94 http://doi.org/10.1023/B:VISI.0000029664.99615.94 . .

B.D. Lucas , , , T. Kanade . . An Iterative Image Registration Technique with an Application to Stereo Vision . . Int. Joint Conf. on Artificial Intelligence , , 1981 . . p.674 - - 679 . . . .

M. Okabe , , , K. Anjyo , , , T. Igarashi , , , H.P. Seidel . . Animating pictures of fluid using video examples . . Comput. Graph. Forum , , 2009 . . 28 ( ( 2 ): ): 677 - - 686 . . DOI: 10.1111/j.1467-8659.2009.01408.x http://doi.org/10.1111/j.1467-8659.2009.01408.x . .

M. Okabe , , , K. Anjyo , , , R. Onai . . Creating fluid animation from a single image using video database . . Comput. Graph. Forum , , 2011 . . 30 ( ( 7 ): ): 1973 - - 1982 . . DOI: 10.1111/j.1467-8659.2011.02062.x http://doi.org/10.1111/j.1467-8659.2011.02062.x . .

M. Rubinstein , , , A. Shamir , , , S. Avidan . . Improved seam carving for video retargeting . . ACM Trans. Graph. , , 2008 . . 27 ( ( 3, Article No. 16 ): ): p.1 - - 9 . . DOI: 10.1145/1360612.1360615 http://doi.org/10.1145/1360612.1360615 . .

A. Schodl , , , R. Szeliski , , , D.H. Salesin , , , I. Essa . . Video Textures . . SIGGRAPH , , 2000 . . p.489 - - 498 . . DOI: 10.1145/344779.345012 http://doi.org/10.1145/344779.345012 . .

M. Shinya , , , M. Aoki , , , K. Tsutsuguchi , , , N. Kotani . . Dynamic Texture: Physically Based 2D Animation . . SIGGRAPH , , 1999 . . p.239 DOI: 10.1145/311625.312130 http://doi.org/10.1145/311625.312130 . .

M. Sun , , , A.D. Jepson , , , E. Fiume . . Video Input Driven Animation (VIDA) . . Proc. 9th IEEE Int. Conf. on Computer Vision , , 2003 . . p.96 - - 103 . . DOI: 10.1109/ICCV.2003.1238319 http://doi.org/10.1109/ICCV.2003.1238319 . .

A. Treuille , , , A. McNamara , , , C. Popovc , , , J. Stam . . Keyframe control of smoke simulations . . ACM Trans. Graph. , , 2003 . . 22 ( ( 3 ): ): 716 - - 723 . . DOI: 10.1145/882262.882337 http://doi.org/10.1145/882262.882337 . .

Y. Wang , , , S.C. Zhu . . Modeling Textured Motion: Particle, Wave and Sketch . . Proc. 9th IEEE Int. Conf. on Computer Vision , , 2003 . . p.213 - - 220 . . DOI: 10.1109/ICCV.2003.1238343 http://doi.org/10.1109/ICCV.2003.1238343 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰