A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology

Chao GUO; Zeng-xuan HOU; You-zhi SHI; Jun XU; Dan-dan YU

doi:10.1631/FITEE.1601283

Your Location：

Home >

Browse articles >

A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology

Regular Papers | Updated：2022-05-19

- A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology
- 基于实时力反馈技术的中国书画虚拟三维交互绘制方法
- Frontiers of Information Technology & Electronic Engineering Vol. 18, Issue 11, Pages: 1843-1853(2017)
- Affiliations：
  
  School of Mechanical Engineering, Dalian University of Technology, Dalian 116024, China
- Author bio：
  
  Chao GUO, E-mail: 358826947@qq.com
  [ "Zeng-xuan HOU, E-mail: hou@dlut.edu.cn" ]
  [ "You-zhi SHI, E-mail: 43972049@qq.com" ]
  [ "Jun XU, E-mail: 1017184024@qq.com" ]
  [ "Dan-dan YU, E-mail: 642484580@qq.com" ]
- Funds：
- DOI：10.1631/FITEE.1601283
  CLC： TP391.9
- Received：24 May 2016，
  
  Revised：2017-11-20，
  
  Published：2017-11
- Accepted：
Scan QR Code
Chao GUO, Zeng-xuan HOU, You-zhi SHI, et al. A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1843-1853.
DOI：

Chao GUO, Zeng-xuan HOU, You-zhi SHI, et al. A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1843-1853. DOI： 10.1631/FITEE.1601283.

摘要

本文提出了一种新的基于实时力反馈技术的中国书画三维交互绘制方法。本文通过分析毛笔受力与变形的关系，基于一种弹簧振子模型构建了三维毛笔模型。根据毛笔受力产生的变形计算得到毛笔在绘制平面上形成的2D笔触，并将其实时映射到3D物体表面形成3D笔触，沿着绘制方向叠加3D笔触形成3D笔道。本方法已成功应用于基于实时力反馈技术的虚拟三维交互绘制系统，用户可以通过Phantom Desktop力反馈设备实时绘制三维笔道，从而实现对三维交互绘制过程的有效仿真。

Abstract

A novel 3D interactive painting method for Chinese calligraphy and painting based on force feedback technology is proposed. The relationship between the force exerted on the brush and the resulting brush deformation is analyzed and a spring-mass model is used to build a model of the 3D Chinese brush. The 2D brush footprint between the brush and the plane of the paper or object is calculated according to the deformation of the 3D brush when force is exerted on the 3D brush. Then the 3D brush footprint is obtained by projecting the 2D brush footprint onto the surface of the 3D object in real time

and a complete 3D brushstroke is obtained by superimposing 3D brush footprints along the painting direction. The proposed method has been successfully applied in a virtual 3D interactive drawing system based on force feedback technology. In this system

users can paint 3D brushstrokes in real time with a Phantom Desktop haptic device

which can effectively serve as a virtual reality interface to the simulated painting environment for users.

关键词

Keywords

references

B. Adams , , , M. Wicke , , , P. Dutr , , , 等 . . Interactive 3D painting on point-sampled objects . . Proc. 1st Eurographics Conf. on Point-Based Graphics , , 2004 . . p.57 - - 66 . . DOI: 10.2312/SPBG/SPBG04/057-066 http://doi.org/10.2312/SPBG/SPBG04/057-066 . .

M. Agrawala , , , A.C. Beers , , , M. Levoy . . 3D painting on scanned surfaces . . Proc. Symp. on Interactive 3D Graphics , , 1995 . . p.145 - - 150 . . DOI: 10.1145/199404.199429 http://doi.org/10.1145/199404.199429 . .

W. Baxter , , , J. Wendt , , , M.C. Lin . . IMPaSTo: a realistic, interactive model for paint . . Proc. 3rd Int. Symp. on Non-photorealistic Animation and Rendering , , 2004 . . p.45 - - 56, 148 . . DOI: 10.1145/987657.987665 http://doi.org/10.1145/987657.987665 . .

W.V. Baxter , , , M.C. Lin . . A versatile interactive 3D brush model . . Proc. 12th Pacific Conf. on Computer Graphics and Applications , , 2004 . . p.319 - - 328 . . DOI: 10.1109/PCCGA.2004.1348363 http://doi.org/10.1109/PCCGA.2004.1348363 . .

Z.L. Chen , , , B. Kim , , , D. Ito , , , 等 . . Wetbrush: GPU-based 3D painting simulation at the bristle level . . ACM Trans. Graph. , , 2015 . . 34 ( ( 6 ): ): Article 200 DOI: 10.1145/2816795.2818066 http://doi.org/10.1145/2816795.2818066 . .

N.S.H. Chu , , , C.L. Tai . . An efficient brush model for physically-based 3D painting . . Proc. 10th Pacific Conf. on Computer Graphics and Applications , , 2002 . . p.413 - - 421 . . DOI: 10.1109/PCCGA.2002.1167885 http://doi.org/10.1109/PCCGA.2002.1167885 . .

N.S.H. Chu , , , C.L. Tai . . Real-time painting with an expressive virtual Chinese brush . . IEEE Comput. Graph. Appl. , , 2004 . . 24 ( ( 5 ): ): 76 - - 85 . . DOI: 10.1109/MCG.2004.37 http://doi.org/10.1109/MCG.2004.37 . .

N.S.H. Chu , , , C.L. Tai . . MoXi: real-time ink dispersion in absorbent paper . . ACM Trans. Graph. , , 2005 . . 24 ( ( 3 ): ): 504 - - 511 . . DOI: 10.1145/1073204.1073221 http://doi.org/10.1145/1073204.1073221 . .

M. Foskey , , , M.A. Otaduy , , , M.C. Lin . . ArtNova: touch-enabled 3D model design . . Proc. IEEE Virtual Reality , , 2002 . . p.119 - - 126 . . DOI: 10.1109/VR.2002.996514 http://doi.org/10.1109/VR.2002.996514 . .

C.W. Fu , , , J.Z. Xia , , , Y. He . . LayerPaint: a multi-layer interactive 3D painting interface . . Proc. SIGCHI Conf. on Human Factors in Computing Systems , , 2010 . . p.811 - - 820 . . DOI: 10.1145/1753326.1753445 http://doi.org/10.1145/1753326.1753445 . .

Y.X. Fu , , , Y.H. Chen . . Haptic 3D mesh painting based on dynamic subdivision . . Comput. Aid. Des. Appl. , , 2008 . . 5 ( ( 1-4 ): ): 131 - - 141 . . DOI: 10.3722/cadaps.2008.131-141 http://doi.org/10.3722/cadaps.2008.131-141 . .

A.D. Gregory , , , S.A. Ehmann , , , M.C. Lin . . inTouch: interactive multiresolution modeling and 3D painting with a haptic interface . . Proc. IEEE Virtual Reality , , 2000 . . p.45 - - 52 . . DOI: 10.1109/VR.2000.840362 http://doi.org/10.1109/VR.2000.840362 . .

C. Guo , , , Z.X. Hou , , , G.Q. Yang , , , 等 . . The simulation of the brushstroke based on force feedback technology . . Math. Prob. Eng. , , 2015 . . Article 164821 DOI: 10.1155/2015/164821 http://doi.org/10.1155/2015/164821 . .

P. Hanrahan , , , P. Haeberli . . Direct WYSIWYG painting and texturing on 3D shapes . . Proc. 17th Annual Conf. on Computer Graphics and Interactive Techniques , , 1990 . . p.215 - - 223 . . DOI: 10.1145/97880.97903 http://doi.org/10.1145/97880.97903 . .

Z.X. Hou , , , C. Guo , , , G.Z. Chen , , , 等 . . The methods of the pigment mixing and color storage in the virtual painting . . J. Inform. Comput. Sci. , , 2015 . . 12 ( ( 18 ): ): 6853 - - 6861 . . . .

T. Igarashi , , , D. Cosgrove . . Adaptive unwrapping for interactive texture painting . . Proc. Symp. on Interactive 3D Graphics , , 2001 . . p.209 - - 216 . . DOI: 10.1145/364338.364404 http://doi.org/10.1145/364338.364404 . .

D. Johnson , , , T.V. Thompson , , , M. Kaplan , , , 等 . . Painting textures with a haptic interface . . Proc. IEEE Virtual Reality , , 1999 . . p.282 - - 285 . . DOI: 10.1109/VR.1999.756963 http://doi.org/10.1109/VR.1999.756963 . .

L. Kim , , , G.S. Sukhatme , , , M. Desbrun . . Haptic editing of decoration and material properties . . Proc. 11th Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems , , 2003 . . p.213 - - 220 . . DOI: 10.1109/HAPTIC.2003.1191280 http://doi.org/10.1109/HAPTIC.2003.1191280 . .

L. Kim , , , G.S. Sukhatme , , , M. Desbrun . . A haptic-rendering technique based on hybrid surface representation . . IEEE Comput. Graph. Appl. , , 2004 . . 24 ( ( 2 ): ): 66 - - 75 . . DOI: 10.1109/MCG.2004.1274064 http://doi.org/10.1109/MCG.2004.1274064 . .

T. Larsson , , , L. K llberg . . Fast and robust approximation of smallest enclosing balls in arbitrary dimensions . . Comput. Graph. Forum , , 2013 . . 32 ( ( 5 ): ): 93 - - 101 . . DOI: 10.1111/cgf.12176 http://doi.org/10.1111/cgf.12176 . .

M.C. Lin , , , W. Baxter , , , M. Foskey , , , 等 . . Haptic inter-action for creative processes with simulated media . . IEEE Int. Conf. on Robotics and Automation , , 2002 . . p.598 - - 604 . . DOI: 10.1109/ROBOT.2002.1013424 http://doi.org/10.1109/ROBOT.2002.1013424 . .

M. Otsuki , , , M. Tsukadaira , , , A. Kimura , , , 等 . . Devel-opment of brush device facilitating painting operation in 2D/3D space . . Proc. ICROS-SICE Int. Joint Conf. , , 2009 . . p.4323 - - 4326 . . . .

M. Otsuki , , , K. Sugihara , , , A. Kimura , , , 等 . . MAI painting brush: an interactive device that realizes the feeling of real painting . . Proc. 23rd Annual ACM Symp. on User Interface Software and Technology , , 2010 . . p.97 - - 100 . . DOI: 10.1145/1866029.1866045 http://doi.org/10.1145/1866029.1866045 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰