Visual knowledge guided intelligent generation of Chinese seal carving

Kejun ZHANG; Rui ZHANG; Yehang YIN; Yifei LI; Wenqi WU; Lingyun SUN; Fei WU; Huanghuang DENG; Yunhe PAN

doi:10.1631/FITEE.2100094

Your Location：

Home >

Browse articles >

Visual knowledge guided intelligent generation of Chinese seal carving

Regular Papers | Updated：2022-10-28

- Visual knowledge guided intelligent generation of Chinese seal carving
- 视觉知识引导的中国篆刻智能化生成
- Frontiers of Information Technology & Electronic Engineering Vol. 23, Issue 10, Pages: 1479-1493(2022)
- Affiliations：
  
  1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
  2.Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Hangzhou 310027, China
  3.School of Software Technology, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  †E-mail: zhangkejun@zju.edu.cn
  zhang_rui@zju.edu.cn
  ‡Corresponding author
- Funds：
- DOI：10.1631/FITEE.2100094
  CLC： TP301.6
- Received：22 February 2021，
  
  Revised：2022-01-25，
  
  Accepted：20 June 2021，
  
  Published Online：25 April 2022，
  
  Published：0 October 2022
- Accepted：
Scan QR Code
Kejun ZHANG, Rui ZHANG, Yehang YIN, et al. Visual knowledge guided intelligent generation of Chinese seal carving[J]. Frontiers of Information Technology & Electronic Engineering, 2022, 23(10): 1479-1493.
DOI：

Kejun ZHANG, Rui ZHANG, Yehang YIN, et al. Visual knowledge guided intelligent generation of Chinese seal carving[J]. Frontiers of Information Technology & Electronic Engineering, 2022, 23(10): 1479-1493. DOI： 10.1631/FITEE.2100094.

摘要

本文将传统篆刻艺术中的资源协同、设计创作、视觉呈现等过程以数字化方式再现，研制了篆刻艺术智能化创作的系统和平台（浙江大学智能篆刻系统：http://www.next.zju.edu.cn/seal/；篆刻搜索排版系统：http://www.next.zju.edu.cn/seal/search_app/），以视觉知识为引导突破计算机艺术学面临的难点问题。本文构建了包含字和印的求是篆刻数据库，并以此为视觉知识库，构建了篆字智能生成算法。此外，为创建印章布局，提出一种篆字变形算法调整印章字符，并结合视觉知识实现智能篆字布局，以实现智能结构。实验结果表明本文所提方法和系统可有效解决篆刻艺术生成中的难点问题，为篆刻艺术的守正与创新提供理论与应用借鉴。

Abstract

We digitally reproduce the process of resource collaboration

design creation

and visual presentation of Chinese seal-carving art. We develop an intelligent seal-carving art-generation system (Zhejiang University Intelligent Seal-Carving System

http://www.next.zju.edu.cn/seal/; the website of the seal-carving search and layout system is http://www.next.zju.edu.cn/seal/search_app/) to deal with the difficulty in using a visual knowledge guided computational art approach. The knowledge base in this study is the Qiushi Seal-Carving Database

which consists of open datasets of images of seal characters and seal stamps. We propose a seal character generation method based on visual knowledge

guided by the database and expertise. Furthermore

to create the layout of the seal

we propose a deformation algorithm to adjust the seal characters and calculate layout parameters from the database and knowledge to achieve an intelligent structure. Experimental results show that this method and system can effectively deal with the difficulties in the generation of seal carving. Our work provides theoretical and applied references for the rebirth and innovation of seal-carving art.

关键词

Keywords

references

B Baxter , , V Scheib , , MC Lin , , et al. , . 2001 . . DAB: interactive haptic painting with 3D virtual brushes . . Proc 28 th Annual Conf on Computer Graphics and Interactive Techniques , p. , 461 - - 468 . . doi: 10.1145/383259.383313 http://doi.org/10.1145/383259.383313 .

XF Bi , , M Tang , , JZ Lin , , et al. , . 2003 . . An experience based virtual brush model . . J Comput Res Dev , , 40 ( ( 8 ): ): 1244 - - 1251 . (in Chinese) . .

B Chang , , Q Zhang , , SY Pan , , et al. , . 2018 . . Generating handwritten Chinese characters using CycleGAN . . IEEE Winter Conf on Applications of Computer Vision , p. . 199 - - 207 . . doi: 10.1109/WACV.2018.00028 http://doi.org/10.1109/WACV.2018.00028 .

J Chang , , YJ Gu , , Y Zhang , , et al. , . 2018 . . Chinese handwriting imitation with hierarchical generative adversarial network . . British Machine Vision Conf , . Article 290 . .

YS Chen , . 1995 . . Computer processing on the identification of a Chinese seal image . . Proc 3 rd Int Conf on Document Analysis and Recognition , p. , 422 - - 425 . . doi: 10.1109/ICDAR.1995.599027 http://doi.org/10.1109/ICDAR.1995.599027 .

YS Chen , . 1996 . . Automatic identification for a Chinese seal image . . Patt Recogn , , 29 ( ( 11 ): ): 1807 - - 1820 . . doi: 10.1016/0031-3203(96)00032-5 http://doi.org/10.1016/0031-3203(96)00032-5 .

NSH Chu , , CL Tai , . 2004 . . Real-time painting with an expressive virtual Chinese brush . . IEEE Comput Graph Appl , , 24 ( ( 5 ): ): 76 - - 85 . . doi: 10.1109/MCG.2004.37 http://doi.org/10.1109/MCG.2004.37 .

NSH Chu , , CL Tai , . 2005 . . MoXi: real-time ink dispersion in absorbent paper . . ACM Trans Graph , , 24 ( ( 3 ): ): 504 - - 511 . . doi: 10.1145/1186822.1073221 http://doi.org/10.1145/1186822.1073221 .

J Dong , , M Xu , , YH Pan , . 2008 . . Statistic model-based simulation on calligraphy creation . . Chin J Comput , , 31 ( ( 7 ): ): 1276 - - 1282 . (in Chinese) . doi: 10.3321/j.issn:0254-4164.2008.07.023 http://doi.org/10.3321/j.issn:0254-4164.2008.07.023 .

TJ Fan , , WH Tsai , . 1984 . . Automatic Chinese seal identification . . Comput Vis Graph Image Process , , 25 ( ( 3 ): ): 311 - - 330 . . doi: 10.1016/0734-189X(84)90198-1 http://doi.org/10.1016/0734-189X(84)90198-1 .

FontLab , . 2020 . . FontLab 7 . . https://www.fontlab.com/ https://www.fontlab.com/ [Accessed on , Jan. 1, 2021 . ]. .

Founder Group , . 2020 . . FounderType . . http://www.foundertype.com/ http://www.foundertype.com/ [Accessed on , Jan. 1, 2021 . ]. .

RB Girshick , . 2004 . . Simulating Chinese brush painting: the parametric hairy brush . . ACM SIGGRAPH , . Article 22 . doi: 10.1145/1186415.1186442 http://doi.org/10.1145/1186415.1186442 .

Glyphs , . 2020 . . Glyphs . . https://glyphsapp.com/ https://glyphsapp.com/ [Accessed on , Jan. 1, 2021 . ]. .

ZL Gu , . 2013 . . Eight Lectures on the Basis of Seal Cutting . , Shanghai Painting and Calligraphy Publishing House , , : China (in Chinese) . .

QL Guo , , TL Kunii , . 1991 . . Modeling the diffuse paintings of ‘Sumie’ . In: TL Kunii (Ed.), . Modeling in Computer Graphics. IFIP Series on Computer Graphics . , Springer , , : Tokyo . doi: 10.1007/978-4-431-68147-2_21 http://doi.org/10.1007/978-4-431-68147-2_21 .

High-Logic , . 2020 . . High-Logic . . https://www.high-logic.com/ https://www.high-logic.com/ [Accessed on , Jan. 1, 2021 . ]. .

D Huang , . 1999 . . Zhongguo Lidai Yinfeng . , Chongqing Press , , : Chongqing, China (in Chinese) . .

P Isola , , JY Zhu , , TH Zhou , , et al. , . 2017 . . Image-to-image translation with conditional adversarial networks . . IEEE Conf on Computer Vision and Pattern Recognition , p. . 5967 - - 5976 . . doi: 10.1109/CVPR.2017.632 http://doi.org/10.1109/CVPR.2017.632 .

Y Jiang , , ZH Lian , , YM Tang , , et al. , . 2017 . . DCFont: an end-to-end deep Chinese font generation system . . SIGGRAPH , . Article 22 . doi: 10.1145/3145749.3149440 http://doi.org/10.1145/3145749.3149440 .

Y Jiang , , ZH Lian , , YM Tang , , et al. , . 2019 . . SCFont: structure-guided Chinese font generation via deep stacked networks . . Proc AAAI Conf on Artificial Intelligence , p. . 4015 - - 4022 . . doi: 10.1609/aaai.v33i01.33014015 http://doi.org/10.1609/aaai.v33i01.33014015 .

J Lee , . 1999 . . Simulating oriental black-ink painting . . IEEE Comput Graph Appl , , 19 ( ( 3 ): ): 74 - - 81 . . doi: 10.1109/38.761553 http://doi.org/10.1109/38.761553 .

H Leung , . 2004 . . Analysis of traditional Chinese seals and synthesis of personalized seals . . IEEE Int Conf on Multimedia and Expo , p. . 1283 - - 1286 . . doi: 10.1109/ICME.2004.1394458 http://doi.org/10.1109/ICME.2004.1394458 .

GT Li , , SD Ma , . 2009 . . Zhuankexue . , Jiangsu Education Publishing House , , : China (in Chinese) . .

W Li , , YP Song , , CL Zhou , . 2014 . . Computationally evaluating and synthesizing Chinese calligraphy . . Neurocomputing , , 135 : 299 - - 305 . . doi: 10.1016/j.neucom.2013.12.013 http://doi.org/10.1016/j.neucom.2013.12.013 .

ZH Lian , , JG Xiao , . 2012 . . Automatic shape morphing for Chinese characters . . SIGGRAPH , p. . 1 - - 4 . . doi: 10.1145/2407746.2407748 http://doi.org/10.1145/2407746.2407748 .

ZH Lian , , B Zhao , , XD Chen , , et al. , . 2018 . . EasyFont: a style learning-based system to easily build your large-scale handwriting fonts . . ACM Trans Graph , , 38 ( ( 1 ): ): 6 . doi: 10.1145/3213767 http://doi.org/10.1145/3213767 .

JW Lin , , CY Wang , , CL Ting , , et al. , . 2014 . . Font generation of personal handwritten Chinese characters . . Proc 5 th Int Conf on Graphic and Image Processing , , Article 90691T . doi: 10.1117/12.2050128 http://doi.org/10.1117/12.2050128 .

JW Lin , , CY Hong , , RI Chang , , et al. , . 2015 . . Complete font generation of Chinese characters in personal handwriting style . . IEEE 34 th Int Performance Computing and Communications Conf , p. , 1 - - 5 . . doi: 10.1109/PCCC.2015.7410321 http://doi.org/10.1109/PCCC.2015.7410321 .

J Liu , . 2010 . . Zhuanke Changyongzi Zidian . , Xiling Yinshe , , : China (in Chinese) . .

JW Lu , , C Barnes , , S DiVerdi , , et al. , . 2013 . . RealBrush: painting with examples of physical media . . ACM Trans Graph , , 32 ( ( 4 ): ): 117 . doi: 10.1145/2461912.2461998 http://doi.org/10.1145/2461912.2461998 .

PY Lyu , , X Bai , , C Yao , , et al. , . 2017 . . Auto-encoder guided GAN for Chinese calligraphy synthesis . . 14 th IAPR Int Conf on Document Analysis and Recognition , p. , 1095 - - 1100 . . doi: 10.1109/ICDAR.2017.181 http://doi.org/10.1109/ICDAR.2017.181 .

XF Mi , , J Xu , , M Tang , , et al. , . 2002 . . The droplet virtual brush for Chinese calligraphic character modeling . . Proc 6 th IEEE Workshop on Applications of Computer Vision , p. , 330 - - 334 . . doi: 10.1109/ACV.2002.1182203 http://doi.org/10.1109/ACV.2002.1182203 .

YH Pan , . 2019 . . On visual knowledge . . Front Inform Technol Electron Eng , , 20 ( ( 8 ): ): 1021 - - 1025 . . doi: 10.1631/FITEE.1910001 http://doi.org/10.1631/FITEE.1910001 .

YH Pan , . 2021 . . Miniaturized five fundamental issues about visual knowledge . . Front Inform Technol Electron Eng , , 22 ( ( 5 ): ): 615 - - 618 . . doi: 10.1631/FITEE.2040000 http://doi.org/10.1631/FITEE.2040000 .

X Qiu , , GL Matto , , J Norman , . 2000 . . Chinese Writing . , Institute of East Asian Studies , , : University of California, USA . .

S Saito , , M Nakajima , . 1999 . . 3D physics-based brush model for painting . . ACM SIGGRAPH , . Article 226 . doi: 10.1145/311625.312110 http://doi.org/10.1145/311625.312110 .

C Shi , , JG Xiao , , CH Xu , , et al. , . 2014 . . Automatic generation of Chinese character using features fusion from calligraphy and font . . The Engineering Reality of Virtual Reality , . Article 90120N . doi: 10.1117/12.2038945 http://doi.org/10.1117/12.2038945 .

S Strassmann , . 1986 . . Hairy brushes . . ACM SIGGRAPH Comput Graph , , 20 ( ( 4 ): ): 225 - - 232 . . doi: 10.1145/15886.15911 http://doi.org/10.1145/15886.15911 .

CL Su , . 2007a . . Edge distance and gray level extraction and orientation invariant transform for Chinese seal recognition . . Appl Math Comput , , 193 ( ( 2 ): ): 325 - - 334 . . doi: 10.1016/j.amc.2007.03.061 http://doi.org/10.1016/j.amc.2007.03.061 .

CL Su , . 2007b . . Ring-to-line mapping and orientation invariant transform for Chinese seal character recognition . . Int J Comput Math , , 84 ( ( 1 ): ): 11 - - 22 . . doi: 10.1080/00207160701197967 http://doi.org/10.1080/00207160701197967 .

DY Sun , , TZ Ren , , CX Li , , et al. , . 2017 . . Learning to write stylized Chinese characters by reading a handful of examples . . https://arxiv.org/abs/1712.06424v3 https://arxiv.org/abs/1712.06424v3 , .

SS Tang , , ZQ Xia , , ZH Lian , , et al. , . 2019 . . FontRNN: generating large-scale Chinese fonts via recurrent neural network . . Comput Graph Forum , , 38 ( ( 7 ): ): 567 - - 577 . . doi: 10.1111/cgf.13861 http://doi.org/10.1111/cgf.13861 .

YC Tian , . 2016 . . Rewrite . . https://github.com/kaonashi-tyc/Rewrite https://github.com/kaonashi-tyc/Rewrite [Accessed on , Jan. 1, 2021 . ]. .

YC Tian , . 2017 . . zi2zi . . https://github.com/kaonashi-tyc/zi2zi https://github.com/kaonashi-tyc/zi2zi [Accessed on , Jan. 1, 2021 . ]. .

Unicode Consortium , . 2020 . . Roadmap to the TIP . . https://unicode.org/roadmaps/tip/ https://unicode.org/roadmaps/tip/ [Accessed on , Jan. 1, 2021 . ]. .

L Wang , . 1980 . . Manuscript of Chinese History . , Zhong Hua Book Company , , : Beijing, China (in Chinese) . .

YG Wang , , YJ Pang , . 1986 . . CCC—computer Chinese calligraphy system . . Inform Contr , ( , ( 2 ): ): 38 - - 43 . (in Chinese) . .

C Wen , , J Chang , , Y Zhang , , et al. , . 2019 . . Handwritten Chinese font generation with collaborative stroke refinement . . https://arxiv.org/abs/1904.13268 https://arxiv.org/abs/1904.13268 , .

HTF Wong , , HHS Ip , . 2000 . . Virtual brush: a model-based synthesis of Chinese calligraphy . . Comput Graph , , 24 ( ( 1 ): ): 99 - - 113 . . doi: 10.1016/S0097-8493(99)00141-7 http://doi.org/10.1016/S0097-8493(99)00141-7 .

SH Xu , , M Tang , , F Lau , , et al. , . 2002 . . A solid model based virtual hairy brush . . Comput Graph Forum , , 21 ( ( 3 ): ): 299 - - 308 . . doi: 10.1111/1467-8659.00589 http://doi.org/10.1111/1467-8659.00589 .

SH Xu , , H Jiang , , FCM Lau , . 2007 . . An intelligent system for Chinese calligraphy . . Proc 22 nd National Conf on Artificial Intelligence , p. , 1578 - - 1583 . . .

SH Xu , , H Jiang , , T Jin , , et al. , . 2009 . . Automatic generation of Chinese calligraphic writings with style imitation . . IEEE Intell Syst , , 24 ( ( 2 ): ): 44 - - 53 . . doi: 10.1109/MIS.2009.23 http://doi.org/10.1109/MIS.2009.23 .

YX Xu , . 2007 . . The Research and Implementation of Chinese Calligraphy Tablet Generation Techniques . MS Thesis, . Zhejiang University , , : Hangzhou, China (in Chinese) . .

YH Yin , , ZW Chen , , YJ Zhao , , et al. , . 2020 . . Automated Chinese seal carving art creation with AI assistance . . IEEE Conf on Multimedia Information Processing and Retrieval , p. . 394 - - 395 . . doi: 10.1109/MIPR49039.2020.00086 http://doi.org/10.1109/MIPR49039.2020.00086 .

JH Yu , , QS Peng , . 2005 . . Realistic synthesis of cao shu of Chinese calligraphy . . Comput Graph , , 29 ( ( 1 ): ): 145 - - 153 . . doi: 10.1016/j.cag.2004.11.013 http://doi.org/10.1016/j.cag.2004.11.013 .

JH Yu , , JD Zhang , , YQ Cong , . 1996 . . A physically-based brush-pen model . . J Comput-Aid Des Comput Graph , , 8 ( ( 4 ): ): 241 - - 245 . (in Chinese) . doi: 10.3321/j.issn:1003-9775.1996.04.001 http://doi.org/10.3321/j.issn:1003-9775.1996.04.001 .

K Yu , . 2010 . . Researches on Some Key Technologies of Computer Calligraphy . PhD Thesis, . Zhejiang University , , : Hangzhou, China (in Chinese) . .

R Yuan , . 1979 . . Hanyin Fenyun Hebian . , Shanghai Bookstore Publishing House , , : China (in Chinese) . .

JS Zhang , . 2019 . . A survey of digital calligraphy . . Sci Sin Inform , , 49 ( ( 2 ): ): 143 - - 158 . (in Chinese) . .

YX Zhang , , Y Zhang , , WB Cai , . 2018 . . Separating style and content for generalized style transfer . . IEEE/CVF Conf on Computer Vision and Pattern Recognition , p. . 8447 - - 8455 . . doi: 10.1109/CVPR.2018.00881 http://doi.org/10.1109/CVPR.2018.00881 .

ZZ Zheng , , FY Zhang , . 2018 . . Coconditional autoencoding adversarial networks for Chinese font feature learning . . https://arxiv.org/abs/1812.04451 https://arxiv.org/abs/1812.04451 , .

BY Zhou , , WH Wang , , ZH Chen , . 2011 . . Easy generation of personal Chinese handwritten fonts . . IEEE Int Conf on Multimedia and Expo , p. . 1 - - 6 . . doi: 10.1109/ICME.2011.6011892 http://doi.org/10.1109/ICME.2011.6011892 .

A Zong , , YK Zhu , . 2014 . . StrokeBank: automating personalized Chinese handwriting generation . . Proc 28 th AAAI Conf on Artificial Intelligence , p. , 3024 - - 3029 . . .

Views

171

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

MltAuxTSPP: a unified benchmark for deep learning-based traffic state prediction with multi-source auxiliary data

Q-space-coordinate-guided neural networks for high-fidelity diffusion tensor estimation from minimal diffusion-weighted images

CRGT-SA: an interlaced and spatiotemporal deep learning model for network intrusion detection

Federated model with contrastive learning and adaptive control variates for human activity recognition

A comprehensive survey of physical adversarial vulnerabilities in autonomous driving systems

Related Author

Yusong ZHOU

Xiaoyu JIANG

Shu SUN

Xinmin ZHANG

Yuanqiu MO

Zhihuan SONG

Maokun ZHENG

Zhi LI

Related Institution

School of Mathematics, Southeast University

State Key Laboratory of Industrial Control Technology, Zhejiang University

College of Control Science and Engineering, Zhejiang University

State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University

School of Electronic and Electrical Engineering, Shanghai University of Engineering Science

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰