Research progress on and prospects for virtual brush modeling in digital calligraphy and painting

Lei HUANG; Zeng-xuan HOU; You-hang ZHAO; Di-jing ZHANG

doi:10.1631/FITEE.1900195

Your Location：

Home >

Browse articles >

Research progress on and prospects for virtual brush modeling in digital calligraphy and painting

Regular Papers | Updated：2022-05-19

- Research progress on and prospects for virtual brush modeling in digital calligraphy and painting
- 数字化书法和绘画中虚拟画笔建模技术研究进展与展望
- Frontiers of Information Technology & Electronic Engineering Vol. 20, Issue 10, Pages: 1307-1321(2019)
- Affiliations：
  
  School of Mechanical Engineering, Dalian University of Technology, Dalian 116024, China
- Author bio：
  
  Lei HUANG, E-mail: 2856396202@qq.com
  [ "Zeng-xuan HOU, E-mail: hou@dlut.edu.cn" ]
  [ "You-hang ZHAO, E-mail: 2914514353@qq.com" ]
  [ "Di-jing ZHANG, E-mail: zxbdlut@163.com" ]
- Funds：
- DOI：10.1631/FITEE.1900195
  CLC： TP391.9
- Received：15 April 2019，
  
  Revised：2019-10-10，
  
  Published：2019-10
- Accepted：
Scan QR Code
Lei HUANG, Zeng-xuan HOU, You-hang ZHAO, et al. Research progress on and prospects for virtual brush modeling in digital calligraphy and painting[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(10): 1307-1321.
DOI：

Lei HUANG, Zeng-xuan HOU, You-hang ZHAO, et al. Research progress on and prospects for virtual brush modeling in digital calligraphy and painting[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(10): 1307-1321. DOI： 10.1631/FITEE.1900195.

摘要

作为文房四宝之首，书画艺术创作中使用的画笔在虚拟绘制中有至关重要作用。富有表现力的虚拟画笔模型能够反映真实画笔的行为特点，极大增强绘制过程和绘制效果的真实感。本文通过归纳和综述虚拟画笔建模国内外研究工作进展，总结了有代表性的画笔模型建模方法及其优点与存在的问题，重点论述了目前基于物理、经验建模方法的原理及其仿真效果，讨论了画笔与宣纸、宣纸与水墨、用户与绘制设备之间的交互行为对虚拟画笔建模的影响。最后，从虚拟现实角度分析了虚拟绘制领域目前面临的主要挑战及存在的问题，并展望虚拟画笔建模技术未来可能突破的方向。

Abstract

As the crown of the scholar's four jewels

the brush has occupied a cherished position in the culture of traditional Chinese painting and calligraphy since its invention. In virtual painting

virtual brush modeling plays the most important role. A powerful virtual brush model can truly reflect the characteristics of a real brush and enhance the reality of virtual painting. By reviewing the state of the art in virtual brush modeling

we summarize the basic principles

merits

and drawbacks of typical modeling methods

and discuss simulation results based on empirical methods and physical methods separately. The influences of brush-paper

paper-ink

and human-computer interactive devices on virtual brush modeling are analyzed briefly. The main challenges and problems in virtual painting are analyzed

and the prospects for research on virtual brush modeling in the future are put forward.

关键词

Keywords

references

B Adams , , , M Wicke , , , P Dutré , , , 等 . . Interactive 3D painting on point-sampled objects . . Proc 1 st Eurographics Conf on Point-Based Graphics , , 2004 . . p.57 - - 66 . . DOI: 10.2312/SPBG/SPBG04/057-066 http://doi.org/10.2312/SPBG/SPBG04/057-066 . .

BD Bai , , , YN Zhang , , , K Wong , , , 等 . . A Chinese brush model with calligraphy . . J Northwest Polytech Univ , , 2008 . . 26 ( ( 3 ): ): 391 - - 394 . . DOI: 10.3969/j.issn.1000-2758.2008.03.025 http://doi.org/10.3969/j.issn.1000-2758.2008.03.025 . .

B Baxter , , , V Scheib , , , MC Lin , , , 等 . . DAB: interactive haptic painting with 3D virtual brushes . . Proc 28 th Annual Conf on Computer Graphics and Interactive Techniques , , 2001 . . p.461 - - 468 . . DOI: 10.1145/383259.383313 http://doi.org/10.1145/383259.383313 . .

W Baxter , , , N Govindaraju . . Simple data-driven modeling of brushes . . Proc ACM SIGGRAPH Symp on Interactive 3D Graphics and Games , , 2010 . . p.135 - - 142 . . DOI: 10.1145/1730804.1730826 http://doi.org/10.1145/1730804.1730826 . .

WV Baxter , , , MC Lin . . A versatile interactive 3D brush model . . Proc 12 th Pacific Conf on Computer Graphics and Applications , , 2004 . . p.319 - - 328 . . DOI: 10.1109/PCCGA.2004.1348363 http://doi.org/10.1109/PCCGA.2004.1348363 . .

C Chan , , , E Akleman , , , J Chen . . Two methods for creating Chinese painting . . Proc 10 th Pacific Conf on Computer Graphics and Applications , , 2002 . . p.403 - - 412 . . DOI: 10.1109/PCCGA.2002.1167884 http://doi.org/10.1109/PCCGA.2002.1167884 . .

ZL Chen , , , B Kim , , , D Ito , , , 等 . . Wetbrush: GPU-based 3D painting simulation at the bristle level . . ACM Trans Graph , , 2015 . . 34 ( ( 6 ): ): 200 - - 210 . . DOI: 10.1145/2816795.2818066 http://doi.org/10.1145/2816795.2818066 . .

NSH Chu , , , CL Tai . . An efficient brush model for physically-based 3D painting . . Proc 10 th Pacific Conf on Computer Graphics and Applications , , 2002 . . p.413 - - 421 . . DOI: 10.1109/PCCGA.2002.1167885 http://doi.org/10.1109/PCCGA.2002.1167885 . .

NSH Chu , , , CL Tai . . Real-time painting with an expressive virtual Chinese brush . . IEEE Comput Graph Appl , , 2004 . . 24 ( ( 5 ): ): 76 - - 85 . . DOI: 10.1109/MCG.2004.37 http://doi.org/10.1109/MCG.2004.37 . .

NSH Chu , , , CL Tai . . MoXi: real-time ink dispersion in absorbent paper . . ACM Trans Graph , , 2005 . . 24 ( ( 3 ): ): 504 - - 511 . . DOI: 10.1145/1073204.1073221 http://doi.org/10.1145/1073204.1073221 . .

YS Chua . . Bezier brushstrokes . . Comput-Aided Des , , 1990 . . 22 ( ( 9 ): ): 550 - - 555 . . DOI: 10.1016/0010-4485(90)90040-J http://doi.org/10.1016/0010-4485(90)90040-J . .

RB Girshick . . Simulating Chinese brush painting: the parametric hairy brush . . Proc SIGGRAPH , , 2004 . . p.22 DOI: 10.1145/1186415.1186442 http://doi.org/10.1145/1186415.1186442 . .

C Guo , , , ZX Hou , , , GQ Yang , , , 等 . . The simulation of the brush stroke based on force feedback technology . . Math Probl Eng , , 2015 . . 2015 164821 DOI: 10.1155/2015/164821 http://doi.org/10.1155/2015/164821 . .

C Guo , , , ZX Hou , , , SZ Zheng , , , 等 . . The simulation of the half-dry stroke based on the force feedback technology . . Proc 8 th Int Conf on Graphic and Image Processing , , 2017a . . 10225 1022523 DOI: 10.1117/12.2266338 http://doi.org/10.1117/12.2266338 . .

C Guo , , , ZX Hou , , , YZ Shi , , , 等 . . A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology . . Front Inform Technol Electron Eng , , 2017b . . 18 ( ( 11 ): ): 1843 - - 1853 . . DOI: 10.1631/FITEE.1601283 http://doi.org/10.1631/FITEE.1601283 . .

L Guo , , , XS Ren , , , HD Ding . . Study brush pen model on digital pen simulated system of painting and calligraphy . . J Kunming Univ Sci Technol , , 2002 . . 27 ( ( 6 ): ): 83 - - 87 . . DOI: 10.16112/j.cnki.53-1223/n.2002.06.022 http://doi.org/10.16112/j.cnki.53-1223/n.2002.06.022 . .

SC Hsu , , , IHH Lee . . Drawing and animation using skeletal strokes . . Proc 21 st Annual Conf on Computer Graphics and Interactive Techniques , , 1994 . . p.109 - - 118 . . DOI: 10.1145/192161.192186 http://doi.org/10.1145/192161.192186 . .

L Huang , , , ZX Hou , , , C Guo , , , 等 . . Haptic decorating on the surface of virtual clay model . . Math Probl Eng , , 2018 . . 2018 7939706 DOI: 10.1155/2018/7939706 http://doi.org/10.1155/2018/7939706 . .

HHS Ip , , , HTF Wong . . Calligraphic character synthesis using a brush model . . Proc Computer Graphics Int , , 1997 . . p.13 - - 21 . . DOI: 10.1109/CGI.1997.601261 http://doi.org/10.1109/CGI.1997.601261 . .

O Kallmes , , , H Corte . . The structure of paper. I. The statistical geometry of an ideal two dimensional fiber network . . Tappi J , , 1960 . . 43 ( ( 9 ): ): 737 - - 752 . . DOI: 10.2312/SPBG/SPBG04/057-066 http://doi.org/10.2312/SPBG/SPBG04/057-066 . .

J Lee . . Physically-based modeling of brush painting . . Comput Netw ISDN Syst , , 1997 . . 29 ( ( 14 ): ): 1571 - - 1576 . . DOI: 10.1016/S0169-7552(97)00073-1 http://doi.org/10.1016/S0169-7552(97)00073-1 . .

J Lee . . Simulating oriental black-ink painting . . IEEE Comput Graph Appl , , 1999 . . 19 ( ( 3 ): ): 74 - - 81 . . DOI: 10.1109/38.761553 http://doi.org/10.1109/38.761553 . .

J Lee . . Diffusion rendering of black ink paintings using new paper and ink models . . Comput Graph , , 2001 . . 25 ( ( 2 ): ): 295 - - 308 . . DOI: 10.1016/S0097-8493(00)00132-1 http://doi.org/10.1016/S0097-8493(00)00132-1 . .

JF Li , , , XW Zhang , , , X Ao , , , 等 . . An interactive sketch recognition approach with real-time feedback . . J Comput- Aid Des Comput Graph , , 2005 . . 17 ( ( 11 ): ): 2453 - - 2458 . . DOI: 10.3321/j.issn:1003-9775.2005.11.011 http://doi.org/10.3321/j.issn:1003-9775.2005.11.011 . .

DJ Meyer , , , MA Peshkin , , , JE Colgate . . Tactile paintbrush: a procedural method for generating spatial haptic texture . . Proc IEEE Haptics Symp , , 2016 . . p.259 - - 264 . . DOI: 10.1109/HAPTICS.2016.7463187 http://doi.org/10.1109/HAPTICS.2016.7463187 . .

XF Mi , , , M Tang , , , JZ Lin , , , 等 . . An experience based virtual brush model . . J Comput Res Dev , , 2003 . . 40 ( ( 8 ): ): 1244 - - 1251 . . . .

M Otsuki , , , K Sugihara , , , A Toda , , , 等 . . A brush device with visual and haptic feedback for virtual painting of 3D virtual objects . . Virt Real , , 2018 . . 22 ( ( 2 ): ): 167 - - 181 . . DOI: 10.1007/s10055-017-0317-0 http://doi.org/10.1007/s10055-017-0317-0 . .

S Saito , , , M Nakajima . . 3D physics-based brush model for painting . . Proc ACM SIGGRAPH Conf , , 1999 . . p.226 DOI: 10.1145/311625.312110 http://doi.org/10.1145/311625.312110 . .

YX Shi , , , JZ Sun , , , HJ Zhang , , , 等 . . Graphical simulation algorithm for Chinese ink wash drawing by particle system . . J Comput-Aided Des Comput Graph , , 2003 . . 15 ( ( 6 ): ): 667 - - 672 . . DOI: 10.3321/j.issn:1003-9775.2003.06.006 http://doi.org/10.3321/j.issn:1003-9775.2003.06.006 . .

S Strassmann . . Hairy brushes . . ACM SIGGRAPH Comput Graph , , 1986 . . 20 ( ( 4 ): ): 225 - - 232 . . DOI: 10.1145/15886.15911 http://doi.org/10.1145/15886.15911 . .

MJ Sun , , , JZ Sun , , , B Yun . . Physical modeling of "Xuan" paper in the simulation of Chinese ink-wash drawing . . Proc Int Conf on Computer Graphics, Imaging and Visualization , , 2005 . . p.317 - - 322 . . DOI: 10.1109/CGIV.2005.59 http://doi.org/10.1109/CGIV.2005.59 . .

MJ Sun , , , JZ Sun , , , YM Zhao , , , 等 . . Graphical simulation algorithm of 3D TS' UN for Chinese landscape painting . . J Syst Simul , , 2009 . . 21 ( ( 5 ): ): 1297 - - 1301, 1304 . . DOI: 10.16182/j.cnki.joss.2009.05.043 http://doi.org/10.16182/j.cnki.joss.2009.05.043 . .

MJ Sun , , , Z Wang , , , JZ Sun . . Physical modeling based graphical simulator of water-ink diffusion and multi- stroke superposition . . Proc Int Conf on Multimedia Technology , , 2010 . . p.1 - - 7 . . DOI: 10.1109/ICMULT.2010.5629733 http://doi.org/10.1109/ICMULT.2010.5629733 . .

F Tang , , , RP McMahan , , , ED Ragan , , , 等 . . A modified tactile brush algorithm for complex touch gestures . . Proc IEEE Virtual Reality , , 2015 . . p.295 - - 296 . . DOI: 10.1109/VR.2015.7223412 http://doi.org/10.1109/VR.2015.7223412 . .

T van Laerhoven , , , F van Reeth . . Brush up your painting skills . . Vis Comput , , 2007 . . 23 ( ( 9-11 ): ): 763 - - 771 . . DOI: 10.1007/s00371-007-0158-z http://doi.org/10.1007/s00371-007-0158-z . .

HTF Wong , , , HHS Ip . . Virtual brush: a model-based synthesis of Chinese calligraphy . . Comput Graph , , 2000 . . 24 ( ( 1 ): ): 99 - - 113 . . DOI: 10.1016/S0097-8493(99)00141-7 http://doi.org/10.1016/S0097-8493(99)00141-7 . .

SH Xu , , , M Tang , , , F Lau , , , 等 . . A solid model based virtual hairy brush . . Comput Graph Forum , , 2002 . . 21 ( ( 3 ): ): 299 - - 308 . . DOI: 10.1111/1467-8659.00589 http://doi.org/10.1111/1467-8659.00589 . .

SH Xu , , , FCM Lau , , , F Tang , , , 等 . . Advanced design for a realistic virtual brush . . Comput Graph Forum , , 2003 . . 22 ( ( 3 ): ): 533 - - 542 . . DOI: 10.1111/1467-8659.t01-2-00701 http://doi.org/10.1111/1467-8659.t01-2-00701 . .

SH Xu , , , FCM Lau , , , CF Xu , , , 等 . . Virtual hairy brush for digital painting and calligraphy . . Sci China Ser F , , 2005 . . 48 ( ( 3 ): ): 285 - - 303 . . DOI: 10.1360/03yf0389 http://doi.org/10.1360/03yf0389 . .

JS Yeh , , , TY Lien , , , M Ouhyoung . . On the effects of haptic display in brush and ink simulation for Chinese painting and calligraphy . . Proc 10 th Pacific Conf on Computer Graphics and Applications , , 2002 . . p.439 - - 441 . . DOI: 10.1109/PCCGA.2002.1167892 http://doi.org/10.1109/PCCGA.2002.1167892 . .

YC Yhang , , , Y Liu , , , Q Zhu . . Modeling virtual Chinese brush using camshaft curve and stochastic process . . Proc 14 th Int Conf on Computer-Aided Design and Computer Graphics , , 2015 . . p.228 - - 229 . . DOI: 10.1109/CADGRAPHICS.2015.17 http://doi.org/10.1109/CADGRAPHICS.2015.17 . .

J Yin , , , X Ren , , , H Ding . . HUA: an interactive calligraphy and ink-wash painting system . . Proc 5 th Int Conf on Computer and Information Technology , , 2005 . . p.989 - - 995 . . DOI: 10.1109/CIT.2005.126 http://doi.org/10.1109/CIT.2005.126 . .

JH Yu , , , JD Zhang , , , YQ Cong . . A physically-based brush-pen model . . J Comput-Aid Des Comput Graph , , 1996 . . 8 ( ( 4 ): ): 241 - - 245 . . . .

YJ Yu , , , YB Lee , , , HG Cho , , , 等 . . A model based technique for realistic oriental painting . . Proc 10 th Pacific Conf on Computer Graphics and Applications , , 2002 . . p.452 - - 453 . . DOI: 10.1109/PCCGA.2002.1167898 http://doi.org/10.1109/PCCGA.2002.1167898 . .

JS Zhang , , , YY Zhang , , , CL Zhou . . Simulating the writing process from Chinese calligraphy image . . J Comput-Aid Des Comput Graph , , 2014 . . 26 ( ( 6 ): ): 963 - - 972 . . . .

ZT Zhang , , , JQ Wu , , , K Yu . . Chinese calligraphy specific style rendering system . . Proc 10 th Annual Joint Conf on Digital Libraries , , 2010 . . p.99 - - 108 . . DOI: 10.1145/1816123.1816138 http://doi.org/10.1145/1816123.1816138 . .

L Zhu , , , J Li , , , T Hu , , , 等 . . Calligraphy imitation system based on virtual brush and scale-invariant feature transform . . Proc IEEE Int Conf on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing , , 2015 . . p.1936 - - 1941 . . DOI: 10.1109/CIT/IUCC/DASC/PICOM.2015.286 http://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.286 . .

MZ Zhu , , , F Shen , , , ZC Wu , , , 等 . . Virtual brush model based on statistical analysis and its application . . Comput Eng , , 2009 . . 35 ( ( 16 ): ): 283 - - 285 . . DOI: 10.3969/j.issn.1000-3428.2009.16.102 http://doi.org/10.3969/j.issn.1000-3428.2009.16.102 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰