Preserving global features of fluid animation from a single image using video examples

Yan GUI; Li-zhuang MA; Chao YIN; Zhi-hua CHEN

doi:10.1631/jzus.C1100342

Your Location：

Home >

Browse articles >

Preserving global features of fluid animation from a single image using video examples

计算机与自动化 | Updated：2022-12-09

- Preserving global features of fluid animation from a single image using video examples
- Preserving global features of fluid animation from a single image using video examples
- 信息与电子工程前沿（英文） 2012年13卷第7期页码：510-519
- Affiliations：
  
  1.School of Electronic, Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
  2.Department of Computer Science and Engineering, East China University of Science and Technology, Shanghai 200237, China
- Author bio：
  
  [ "Yan GUI, E-mail: guiyan122@sjtu.edu.cn" ]
- Funds：
  
  Project supported by the National Basic Research Program (973) of China (No. 2011CB302203) and the Innovation Program of the Science and Technology Commission of Shanghai Municipality, China (No. 10511501200)
- DOI：10.1631/jzus.C1100342
  中图分类号： TP391.4
- 收稿：2011-11-18，
  
  修回：2012-;5-31，
  
  纸质出版：2012-07
- Accepted：
Scan QR Code
Preserving global features of fluid animation from a single image using video examples[J]. 信息与电子工程前沿（英文）, 2012,13(7):510-519.

Yan GUI, Li-zhuang MA, Chao YIN, et al. Preserving global features of fluid animation from a single image using video examples[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(7): 510-519.
Preserving global features of fluid animation from a single image using video examples[J]. 信息与电子工程前沿（英文）, 2012,13(7):510-519. DOI： 10.1631/jzus.C1100342.

Yan GUI, Li-zhuang MA, Chao YIN, et al. Preserving global features of fluid animation from a single image using video examples[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(7): 510-519. DOI： 10.1631/jzus.C1100342.

摘要

Abstract

We synthesize animations from a single image by transferring fluid motion of a video example globally. Given a target image of a fluid scene

an alpha matte is required to extract the fluid region. Our method needs to adjust a user-specified video example for producing the fluid motion suitable for the extracted fluid region. Employing the fluid video database

the flow field of the target image is obtained by warping the optical flow of a video frame that has a visually similar scene to the target image according to their scene correspondences

which assigns fluid orientation and speed automatically. Results show that our method is successful in preserving large fluid features in the synthesized animations. In comparison to existing approaches

it is both possible and useful to utilize our method to create flow animations with higher quality.

关键词

Keywords

references

W.A. Barrett , , , A.S. Cheney . . Object-Based Image Editing . . SIGGRAPH , , 2002 . . p.777 - - 784 . . DOI: 10.1145/566570.566651 http://doi.org/10.1145/566570.566651 . .

K.S. Bhat , , , S.M. Seitz , , , J.K. Hodgins , , , P.K. Khosla . . Flow-based video synthesis and editing . . ACM Trans. Graph. , , 2004 . . 23 ( ( 3 ): ): 360 - - 363 . . DOI: 10.1145/1015706.1015729 http://doi.org/10.1145/1015706.1015729 . .

G.J. Brostow , , , I. Essa . . Image-Based Motion Blur for Stop Motion Animation . . SIGGRAPH , , 2001 . . p.561 - - 566 . . DOI: 10.1145/383259.383325 http://doi.org/10.1145/383259.383325 . .

T. Brox , , , J. Malik . . Large displacement optical flow: descriptor matching in variational motion estimation . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2011 . . 33 ( ( 3 ): ): 500 - - 513 . . DOI: 10.1109/TPAMI.2010.143 http://doi.org/10.1109/TPAMI.2010.143 . .

T. Brox , , , A. Bruhn , , , N. Papenberg , , , J. Weickert . . High Accuracy Optical Flow Estimation Based on a Theory for Warping . . 8th European Conf. on Computer Vision , , 2004 . . p.25 - - 36 . . . .

Y.Y. Chuang , , , D.B. Goldman , , , K.C. Zheng , , , B. Curless , , , D.H. Salesin , , , R. Szeliski . . Animating pictures with stochastic motion textures . . ACM Trans. Graph. , , 2005 . . 24 ( ( 3 ): ): 853 - - 860 . . DOI: 10.1145/1073204.1073273 http://doi.org/10.1145/1073204.1073273 . .

T. Corpetti , , , E. Memin , , , P. Perez . . Dense estimation of fluid flows . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2002 . . 24 ( ( 3 ): ): 365 - - 380 . . DOI: 10.1109/34.990137 http://doi.org/10.1109/34.990137 . .

N. Courty , , , T. Corpetti . . Crowd motion capture . . Comput. Anim. Virt. Worlds , , 2007 . . 18 ( ( 4-5 ): ): 361 - - 370 . . DOI: 10.1002/cav.199 http://doi.org/10.1002/cav.199 . .

G. Doretto , , , A. Chiuso , , , Y.N. Wu , , , S. Soatto . . Dynamic textures . . Int. J. Comput. Vis. , , 2003 . . 51 ( ( 2 ): ): 91 - - 109 . . DOI: 10.1023/A:1021669406132 http://doi.org/10.1023/A:1021669406132 . .

W.T. Freeman , , , E.H. Adelson , , , D.J. Heeger . . Motion without Movement . . SIGGRAPH , , 1991 . . p.27 - - 30 . . DOI: 10.1145/122718.122721 http://doi.org/10.1145/122718.122721 . .

D.J. Heeger , , , J.R. Bergen . . Pyramid-Based Texture Analysis/Synthesis . . SIGGRAPH , , 1995 . . p.229 - - 238 . . DOI: 10.1145/218380.218446 http://doi.org/10.1145/218380.218446 . .

T. Igarashi , , , T. Moscovich , , , J.F. Hughes . . As-Rigidas-Possible Shape Manipulation . . SIGGRAPH , , 2005 . . p.1134 - - 1141 . . DOI: 10.1145/1186822.1073323 http://doi.org/10.1145/1186822.1073323 . .

V. Kwatra , , , A. Schodl , , , I. Essa , , , G. Turk , , , A. Bobick . . Graphcut textures: image and video synthesis using graph cuts . . ACM Trans. Graph. , , 2003 . . 22 ( ( 3 ): ): 277 - - 286 . . DOI: 10.1145/882262.882264 http://doi.org/10.1145/882262.882264 . .

A. Levin , , , D. Lischinski , , , Y. Weiss . . A closed-form solution to natural image matting . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2008 . . 30 ( ( 2 ): ): 228 - - 242 . . DOI: 10.1109/TPAMI.2007.1177 http://doi.org/10.1109/TPAMI.2007.1177 . .

Z. Lin , , , L. Wang , , , Y. Wang , , , S.B. Kang , , , T. Fang . . High resolution animated scenes from stills . . IEEE Trans. Visual. Comput. Graph. , , 2007 . . 13 ( ( 3 ): ): 562 - - 568 . . DOI: 10.1109/TVCG.2007.1005 http://doi.org/10.1109/TVCG.2007.1005 . .

P. Litwinowicz , , , L. Williams . . Animating Images with Drawings . . SIGGRAPH , , 1994 . . p.409 - - 412 . . DOI: 10.1145/192161.192270 http://doi.org/10.1145/192161.192270 . .

C. Liu , , , J. Yuen , , , A. Torralba , , , J. Sivic , , , W.T. Freeman . . SIFT flow: dense correspondence across different scenes . . LNCS , , 2008 . . 5304 28 - - 42 . . DOI: 10.1007/978-3-540-88690-7_3 http://doi.org/10.1007/978-3-540-88690-7_3 . .

D.G. Lowe . . Distinctive image features from scaleinvariant keypoints . . Int. J. Comput. Vis. , , 2004 . . 60 ( ( 2 ): ): 91 - - 110 . . DOI: 10.1023/B:VISI.0000029664.99615.94 http://doi.org/10.1023/B:VISI.0000029664.99615.94 . .

B.D. Lucas , , , T. Kanade . . An Iterative Image Registration Technique with an Application to Stereo Vision . . Int. Joint Conf. on Artificial Intelligence , , 1981 . . p.674 - - 679 . . . .

M. Okabe , , , K. Anjyo , , , T. Igarashi , , , H.P. Seidel . . Animating pictures of fluid using video examples . . Comput. Graph. Forum , , 2009 . . 28 ( ( 2 ): ): 677 - - 686 . . DOI: 10.1111/j.1467-8659.2009.01408.x http://doi.org/10.1111/j.1467-8659.2009.01408.x . .

M. Okabe , , , K. Anjyo , , , R. Onai . . Creating fluid animation from a single image using video database . . Comput. Graph. Forum , , 2011 . . 30 ( ( 7 ): ): 1973 - - 1982 . . DOI: 10.1111/j.1467-8659.2011.02062.x http://doi.org/10.1111/j.1467-8659.2011.02062.x . .

M. Rubinstein , , , A. Shamir , , , S. Avidan . . Improved seam carving for video retargeting . . ACM Trans. Graph. , , 2008 . . 27 ( ( 3, Article No. 16 ): ): p.1 - - 9 . . DOI: 10.1145/1360612.1360615 http://doi.org/10.1145/1360612.1360615 . .

A. Schodl , , , R. Szeliski , , , D.H. Salesin , , , I. Essa . . Video Textures . . SIGGRAPH , , 2000 . . p.489 - - 498 . . DOI: 10.1145/344779.345012 http://doi.org/10.1145/344779.345012 . .

M. Shinya , , , M. Aoki , , , K. Tsutsuguchi , , , N. Kotani . . Dynamic Texture: Physically Based 2D Animation . . SIGGRAPH , , 1999 . . p.239 DOI: 10.1145/311625.312130 http://doi.org/10.1145/311625.312130 . .

M. Sun , , , A.D. Jepson , , , E. Fiume . . Video Input Driven Animation (VIDA) . . Proc. 9th IEEE Int. Conf. on Computer Vision , , 2003 . . p.96 - - 103 . . DOI: 10.1109/ICCV.2003.1238319 http://doi.org/10.1109/ICCV.2003.1238319 . .

A. Treuille , , , A. McNamara , , , C. Popovc , , , J. Stam . . Keyframe control of smoke simulations . . ACM Trans. Graph. , , 2003 . . 22 ( ( 3 ): ): 716 - - 723 . . DOI: 10.1145/882262.882337 http://doi.org/10.1145/882262.882337 . .

Y. Wang , , , S.C. Zhu . . Modeling Textured Motion: Particle, Wave and Sketch . . Proc. 9th IEEE Int. Conf. on Computer Vision , , 2003 . . p.213 - - 220 . . DOI: 10.1109/ICCV.2003.1238343 http://doi.org/10.1109/ICCV.2003.1238343 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据