A method of shadow puppet figure modeling and animation

HUANG Xiao-fang; SUN Shou-qian; ZHANG Ke-jun; XU Tian-ning; WU Jian-feng; ZHU Bin

doi:10.1631/FITEE.1400351

Your Location：

Home >

Browse articles >

A method of shadow puppet figure modeling and animation

Computer & Automation | Updated：2022-06-06

- A method of shadow puppet figure modeling and animation
- 一种皮影人物建模及动画生成方法
- Frontiers of Information Technology & Electronic Engineering Vol. 16, Issue 5, Pages: 367-379(2015)
- Affiliations：
  
  1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
  2.School of Art, Zhejiang University of Technology, Hangzhou 310023, China
  3.College of Information Science and Technology, Zhejiang Shuren University, Hangzhou 310015, China
- Author bio：
  
  [ "Xiao-fang HUANG, E-mail: xfhuangava@gmail.com" ]
  [ "Shou-qian SUN, E-mail:ssq@zju.edu.cn" ]
  Ke-jun ZHANG, E-mail:channy@zju.edu.cn
  [ "Tian-ning XU, E-mail:alicexutt@163.com" ]
  [ "Jian-feng WU, E-mail:jianfw@126.com" ]
  [ "Bin ZHU, E-mail:zhubinxx@sohu.com" ]
- Funds：
- DOI：10.1631/FITEE.1400351
  CLC： TP391.4
- Received：15 October 2014，
  
  Revised：2015-04-13，
  
  Published：2015-05
- Accepted：
Scan QR Code
HUANG Xiao-fang, SUN Shou-qian, ZHANG Ke-jun, et al. A method of shadow puppet figure modeling and animation[J]. Frontiers of Information Technology & Electronic Engineering, 2015, 16(5): 367-379.
DOI：

HUANG Xiao-fang, SUN Shou-qian, ZHANG Ke-jun, et al. A method of shadow puppet figure modeling and animation[J]. Frontiers of Information Technology & Electronic Engineering, 2015, 16(5): 367-379. DOI： 10.1631/FITEE.1400351.

摘要

目的

建立基于真实人体数据的皮影人物模型并生成动画来促进皮影艺术发展。

创新点

本文使用三维人体扫描数据来建立皮影人物模型，并生成动画。

方法

通过研究分析皮影艺术现状，提出一种通过获取三维人体扫描数据来建立皮影人物并生成动画的方法。二维皮影人物的建模过程（图1）如下：第一步，自动定位三维人体模型特征点，并且根据定位的特征点将人体模型自动分段（图8）；第二步，提取皮影人物的初始轮廓（图11），并进行二维数据处理；第三步，对数据处理后的初始皮影人物（图13）进行自动服饰匹配（图14、15），生成二维皮影人物及动画（图17-19）。最后通过比较实验前后被试者对皮影的兴趣度，来验证该方法的有效性。

结论

针对人们对皮影艺术逐渐失去兴趣的现状，提出一种基于三维人体扫描数据的皮影人物建模方法。实验证明，该方法可以生成更多具有真实感、引人入胜的皮影人物和实时动画。该研究促进了皮影艺术的发展，尤其是在现代皮影动画和个性化定制方面。

Abstract

To promote the development of the intangible cultural heritage of the world

shadow play

many studies have focused on shadow puppet modeling and interaction. Most of the shadow puppet figures are still imaginary

spread by ancients

or carved and painted by shadow puppet artists

without consideration of real dimensions or the appearance of human bodies. This study proposes an algorithm to transform 3D human models to 2D puppet figures for shadow puppets

including automatic location of feature points

automatic segmentation of 3D models

automatic extraction of 2D contours

automatic clothes matching

and animation. Experiment proves that more realistic and attractive figures and animations of the shadow puppet can be generated in real time with this algorithm.

关键词

Keywords

references

B. Allen , B. Curless , B. Popović . The space of human body shapes: reconstruction and parameterization from range scans . ACM Trans. Graph. , 2003 . 22 ( 3 ): 587 - 594 . DOI: 10.1145/882262.882311 http://doi.org/10.1145/882262.882311 .

T.K. Chen . A case study of a digital archives programme: the development of digital shadow plays in Taiwan . Int. J. Human. Arts Comput. , 2014 . 8 ( suppl ): 38 - 48 . DOI: 10.3366/ijhac.2014.0098 http://doi.org/10.3366/ijhac.2014.0098 .

D. Currell . Shadow Puppets & Shadow Play , : UK Crowood Press , 2008 .

L. Dekker , S. Khan , E. West , 等 . Models for understanding the 3D human body form . Proc. Int. Conf. on Computer Vision , 1998 . p.65 - 74 . .

L. Dekker , I. Douros , B.F. Buston , 等 . Building symbolic information for 3D human body modeling from range data . Proc. 2nd Int. Conf. on 3-D Digital Imaging and Modeling , 1999 . p.388 - 397 . DOI: 10.1109/IM.1999.805369 http://doi.org/10.1109/IM.1999.805369 .

G.R. Geisen , C.P. Mason , V.L. Houston , 等 . Automatic detection, identification, and registration of anatomical landmarks . Proc. Human Factors and Ergonomics Society Annual Meeting , 1995 . p.750 - 753 . DOI: 10.1177/154193129503901107 http://doi.org/10.1177/154193129503901107 .

D.A. Ghani . A study of visualization elements of shadow play technique movement and computer graphic imagery (CGI) in Wayang Kulit Kelantan . Int. J. Comput. Graph. Animat. , 2011a . 1 ( 1 ): 1 - 11 . .

D.A. Ghani . Wayang Kulit: digital puppetry character rigging using Maya MEL language . Proc. 4th Int. Conf. on Modeling, Simulation and Applied Optimization , 2011b . p.1 - 5 . DOI: 10.1109/ICMSAO.2011.5775499 http://doi.org/10.1109/ICMSAO.2011.5775499 .

A. Golovinskiy , T. Funkhouser . Randomized cuts for 3D mesh analysis . ACM Trans. Graph. , 2008 . 27 ( 5 ): Article 145 DOI: 10.1145/1409060.1409098 http://doi.org/10.1145/1409060.1409098 .

M. Gutiérrez , A. García-Rojas , D. Thalmann , 等 . An ontology of virtual humans . Vis. Comput. , 2007 . 23 ( 3 ): 207 - 218 . DOI: 10.1007/s00371-006-0093-4 http://doi.org/10.1007/s00371-006-0093-4 .

R.T. Held , A. Gupta , B. Curless , 等 . 3D puppetry: a Kinect-based interface for 3D animation . UIST , 2012 . p.423 - 434 . .

D.K. Jernigan , A. Chansavang , H. Martin-Rall , 等 . Aesthetic affordances: computer animation and Wayang Kulit puppet theatre . Animat. Pract. Process Product. , 2013 . 3 ( 1-2 ): 195 - 217 . DOI: 10.1386/ap3.3.1-2.195_1 http://doi.org/10.1386/ap3.3.1-2.195_1 .

E. Kalogerakis , A. Hertzmann , K. Singh . Learning 3D mesh segmentation and labeling . ACM Trans. Graph. , 2010 . 29 ( 4 ): Article 102 DOI: 10.1145/1778765.1778839 http://doi.org/10.1145/1778765.1778839 .

S. Katz , A. Tal . Hierarchical mesh decomposition using fuzzy clustering and cuts . ACM Trans. Graph. , 2003 . 22 ( 3 ): 954 - 961 . DOI: 10.1145/882262.882369 http://doi.org/10.1145/882262.882369 .

S. Katz , G. Leifman , A. Tal . Mesh segmentation using feature point and core extraction . Vis. Comput. , 2005 . 21 ( 8-10 ): 649 - 658 . DOI: 10.1007/s00371-005-0344-9 http://doi.org/10.1007/s00371-005-0344-9 .

L. Kavan , S. Dobbyn , S. Collins , 等 . Polypostors: 2D polygonal impostors for 3D crowds . Proc. Symp. on Interactive 3D Graphics and Games , 2008 . p.149 - 155 . DOI: 10.1145/1342250.1342273 http://doi.org/10.1145/1342250.1342273 .

T.K. Lam , A.Z. Talib , M.A. Osman . Real-time visual simulation and interactive animation of shadow play puppets using OpenGL . World Acad. Sci. Eng. Technol. , 2008 . 21 212 - 218 . .

E.A. Lewark , J.H. Nurre . Automated fudicial labeling on human body data . Proc. SPIE , 1998 . p.82 - 89 . DOI: 10.1117/12.302440 http://doi.org/10.1117/12.302440 .

Q. Li , Q.Y. Hua , J. Feng , 等 . Design and implementation of interactive digital shadow simulation system . Proc. Int. Conf. on Electric and Electronics , 2011 . p.187 - 194 . DOI: 10.1007/978-3-642-21762-3_24 http://doi.org/10.1007/978-3-642-21762-3_24 .

T.Y. Li , S.W. Hsu . An authoring tool for generating shadow play animations with motion planning techniques . Int. J. Innov. Comput. Inform. Contr. , 2007 . 3 ( 6B ): 1601 - 1612 . .

J.L. Liu . Chinese Shadow Puppet Plays . Morning Glory Publishers, China , 1988 .

P. Matusky . Malaysian Shadow Play and Music: Continuity of an Oral Tradition . South-East Asian Social Science Monographs. Oxford University Press, Kuala Lumpur , 1994 .

K. McHenry , P. Bajcsy . An Overview of 3D Data Content, File Formats and Viewers . Technical Report, National Center for Supercomputing Applications, Urbana, USA. , 2008 .

L. Morse . The shadow puppet theatre of Malaysia: a study of Wayang Kulit with performance scripts and puppet designs . Theat. J. , 2013 . 65 ( 1 ): 137 - 138 . .

M. Mortara , G. Patané , M. Spagnuolo . From geometric to semantic human body models . Comput. Graph. , 2006 . 30 ( 2 ): 185 - 196 . DOI: 10.1016/j.cag.2006.01.024 http://doi.org/10.1016/j.cag.2006.01.024 .

J.H. Nurre . Locating landmarks on human body scan data . Proc. Int. Conf. on Recent Advances in 3-D Digital Imaging and Modeling , 1997 . p.289 - 295 . DOI: 10.1109/IM.1997.603878 http://doi.org/10.1109/IM.1997.603878 .

J.H. Nurre , J. Connor , E.A. Lewark , 等 . On segmenting the three-dimensional scan data of a human body . IEEE Trans. Med. Imag. , 2000 . 19 ( 8 ): 787 - 797 . DOI: 10.1109/42.876304 http://doi.org/10.1109/42.876304 .

H.J. Salij . Shadow Play and Other Stories . Heinemann Asia, Singapore , 1982 .

L. Shapira , A. Shamir , D. Cohen-Or . Consistent mesh partitioning and skeletonisation using the shape diameter function . Vis. Comput. , 2008 . 24 ( 4 ): 249 - 259 . DOI: 10.1007/s00371-007-0197-5 http://doi.org/10.1007/s00371-007-0197-5 .

P. Simari , D. Nowrouzezahrai , E. Kalogerakis , 等 . Multi-objective shape segmentation and labeling . Comput. Graph. Forum , 2009 . 28 ( 5 ): 1415 - 1425 . DOI: 10.1111/j.1467-8659.2009.01518.x http://doi.org/10.1111/j.1467-8659.2009.01518.x .

T. Skipitares . A new aesthetic in Indian puppetry . PAJ , 2013 . 35 ( 3 ): 61 - 68 . DOI: 10.1162/PAJJ_a_00162 http://doi.org/10.1162/PAJJ_a_00162 .

A.Z. Talib , M.A. Osman , K.L. Tan , 等 . Design and development of an interactive virtual shadow puppet play . Proc. 2nd Int. Conf. on Arts and Technology , 2012 . p.118 - 126 . DOI: 10.1007/978-3-642-33329-3_14 http://doi.org/10.1007/978-3-642-33329-3_14 .

A.R. Tilley . The Measure of Man and Woman: Human Factors in Design . New York , 1993 .

E. van Ness , S. Prawirohardjo . Javanese Wayang Kulit: an Introduction , : USA Oxford University Press , 1981 .

C.C.L. Wang , T.K.K. Chang , M.M.F. Yuen . From laser-scanned data to feature human model: a system based on fuzzy logic concept . Comput.-Aid. Des. , 2003 . 35 ( 3 ): 241 - 253 . DOI: 10.1016/S0010-4485(01)00209-3 http://doi.org/10.1016/S0010-4485(01)00209-3 .

I.C. Wang . Globalization and theater spectacles in Asia . CLCWeb: Compar. Liter. Cult. , 2013 . 15 ( 2 ): Article 22 DOI: 10.7771/1481-4374.2234 http://doi.org/10.7771/1481-4374.2234 .

N. Werghi , Y.J. Xiao , J.P. Siebert . A functional-based segmentation of human body scans in arbitrary postures . IEEE Trans. Syst. Man Cybern. B , 2006 . 36 ( 1 ): 153 - 165 . DOI: 10.1109/TSMCB.2005.854503 http://doi.org/10.1109/TSMCB.2005.854503 .

S. Wuhrer , Z. Ben Azouz , C. Shu . Semi-automatic prediction of landmarks on human models in varying poses . Proc. Canadian Conf. on Computer and Robot Vision , 2010 . p.136 - 142 . DOI: 10.1109/CRV.2010.25 http://doi.org/10.1109/CRV.2010.25 .

H. Zhang , Y.H. Song , Z. Chen , 等 . Chinese shadow puppetry with an interactive interface using the Kinect sensor . Proc. Computer Vision , 2012 . p.352 - 361 . DOI: 10.1007/978-3-642-33863-2_35 http://doi.org/10.1007/978-3-642-33863-2_35 .

Y.B. Zhu , C.J. Li , I.F. Shen , 等 . A new form of traditional art: visual simulation of Chinese shadow play . Proc. ACM SIGGRAPH Sketches & Applications , 2003 . p.1 DOI: 10.1145/965400.965458 http://doi.org/10.1145/965400.965458 .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰