视觉知识引导的中国篆刻智能化生成

张克俊; 张瑞; 殷叶航; 李一非; 伍文棋; 孙凌云; 吴飞; 邓晃煌; 潘云鹤

doi:10.1631/FITEE.2100094

Your Location：

Home >

Browse articles >

视觉知识引导的中国篆刻智能化生成

常规文章 | Updated：2022-10-28

- 视觉知识引导的中国篆刻智能化生成
  Enhanced Publication
- Visual knowledge guided intelligent generation of Chinese seal carving
- 信息与电子工程前沿（英文） 2022年23卷第10期页码：1479-1493
- Affiliations：
  
  1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
  2.Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Hangzhou 310027, China
  3.School of Software Technology, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  †E-mail: zhangkejun@zju.edu.cn
  zhang_rui@zju.edu.cn
  ‡Corresponding author
- Funds：
  
  Natural Science Foundation of Zhejiang Province, China(LZ19F020002);Key R&D Program of Zhejiang Province, China(2022C03126)
- DOI：10.1631/FITEE.2100094
  中图分类号： TP301.6
- 纸质出版日期：2022-10-0 ，
  
  网络出版日期：2022-04-25，
  
  收稿日期：2021-02-22，
  
  修回日期：2022-01-25，
  
  录用日期：2021-06-20
- Accepted：
Scan QR Code
张克俊, 张瑞, 殷叶航, 等. 视觉知识引导的中国篆刻智能化生成[J]. 信息与电子工程前沿（英文）, 2022,23(10):1479-1493.

KEJUN ZHANG, RUI ZHANG, YEHANG YIN, et al. Visual knowledge guided intelligent generation of Chinese seal carving. [J]. Frontiers of information technology & electronic engineering, 2022, 23(10): 1479-1493.
张克俊, 张瑞, 殷叶航, 等. 视觉知识引导的中国篆刻智能化生成[J]. 信息与电子工程前沿（英文）, 2022,23(10):1479-1493. DOI： 10.1631/FITEE.2100094.

KEJUN ZHANG, RUI ZHANG, YEHANG YIN, et al. Visual knowledge guided intelligent generation of Chinese seal carving. [J]. Frontiers of information technology & electronic engineering, 2022, 23(10): 1479-1493. DOI： 10.1631/FITEE.2100094.

摘要

本文将传统篆刻艺术中的资源协同、设计创作、视觉呈现等过程以数字化方式再现，研制了篆刻艺术智能化创作的系统和平台（浙江大学智能篆刻系统：http://www.next.zju.edu.cn/seal/；篆刻搜索排版系统：http://www.next.zju.edu.cn/seal/search_app/），以视觉知识为引导突破计算机艺术学面临的难点问题。本文构建了包含字和印的求是篆刻数据库，并以此为视觉知识库，构建了篆字智能生成算法。此外，为创建印章布局，提出一种篆字变形算法调整印章字符，并结合视觉知识实现智能篆字布局，以实现智能结构。实验结果表明本文所提方法和系统可有效解决篆刻艺术生成中的难点问题，为篆刻艺术的守正与创新提供理论与应用借鉴。

Abstract

We digitally reproduce the process of resource collaboration

design creation

and visual presentation of Chinese seal-carving art. We develop an intelligent seal-carving art-generation system (Zhejiang University Intelligent Seal-Carving System

http://www.next.zju.edu.cn/seal/; the website of the seal-carving search and layout system is http://www.next.zju.edu.cn/seal/search_app/) to deal with the difficulty in using a visual knowledge guided computational art approach. The knowledge base in this study is the Qiushi Seal-Carving Database

which consists of open datasets of images of seal characters and seal stamps. We propose a seal character generation method based on visual knowledge

guided by the database and expertise. Furthermore

to create the layout of the seal

we propose a deformation algorithm to adjust the seal characters and calculate layout parameters from the database and knowledge to achieve an intelligent structure. Experimental results show that this method and system can effectively deal with the difficulties in the generation of seal carving. Our work provides theoretical and applied references for the rebirth and innovation of seal-carving art.

关键词

篆刻智能生成深度学习参数化模型计算机艺术

Keywords

Seal-carvingIntelligent generationDeep learningParametric modelingComputational art

references

B Baxter, , V Scheib, , MC Lin, , et al., . 2001. . DAB: interactive haptic painting with 3D virtual brushes. . Proc 28th Annual Conf on Computer Graphics and Interactive Techniques, p., 461--468. . doi: 10.1145/383259.383313http://doi.org/10.1145/383259.383313.

XF Bi, , M Tang, , JZ Lin, , et al., . 2003. . An experience based virtual brush model. . J Comput Res Dev, , 40((8):):1244--1251. (in Chinese)..

B Chang, , Q Zhang, , SY Pan, , et al., . 2018. . Generating handwritten Chinese characters using CycleGAN. . IEEE Winter Conf on Applications of Computer Vision, p.. 199--207. . doi: 10.1109/WACV.2018.00028http://doi.org/10.1109/WACV.2018.00028.

J Chang, , YJ Gu, , Y Zhang, , et al., . 2018. . Chinese handwriting imitation with hierarchical generative adversarial network. . British Machine Vision Conf, . Article 290..

YS Chen, . 1995. . Computer processing on the identification of a Chinese seal image. . Proc 3rd Int Conf on Document Analysis and Recognition, p., 422--425. . doi: 10.1109/ICDAR.1995.599027http://doi.org/10.1109/ICDAR.1995.599027.

YS Chen, . 1996. . Automatic identification for a Chinese seal image. . Patt Recogn, , 29((11):):1807--1820. . doi: 10.1016/0031-3203(96)00032-5http://doi.org/10.1016/0031-3203(96)00032-5.

NSH Chu, , CL Tai, . 2004. . Real-time painting with an expressive virtual Chinese brush. . IEEE Comput Graph Appl, , 24((5):):76--85. . doi: 10.1109/MCG.2004.37http://doi.org/10.1109/MCG.2004.37.

NSH Chu, , CL Tai, . 2005. . MoXi: real-time ink dispersion in absorbent paper. . ACM Trans Graph, , 24((3):):504--511. . doi: 10.1145/1186822.1073221http://doi.org/10.1145/1186822.1073221.

J Dong, , M Xu, , YH Pan, . 2008. . Statistic model-based simulation on calligraphy creation. . Chin J Comput, , 31((7):):1276--1282. (in Chinese). doi: 10.3321/j.issn:0254-4164.2008.07.023http://doi.org/10.3321/j.issn:0254-4164.2008.07.023.

TJ Fan, , WH Tsai, . 1984. . Automatic Chinese seal identification. . Comput Vis Graph Image Process, , 25((3):):311--330. . doi: 10.1016/0734-189X(84)90198-1http://doi.org/10.1016/0734-189X(84)90198-1.

FontLab, . 2020. . FontLab 7. . https://www.fontlab.com/https://www.fontlab.com/ [Accessed on , Jan. 1, 2021. ]..

Founder Group, . 2020. . FounderType. . http://www.foundertype.com/http://www.foundertype.com/ [Accessed on , Jan. 1, 2021. ]..

RB Girshick, . 2004. . Simulating Chinese brush painting: the parametric hairy brush. . ACM SIGGRAPH, . Article 22. doi: 10.1145/1186415.1186442http://doi.org/10.1145/1186415.1186442.

Glyphs, . 2020. . Glyphs. . https://glyphsapp.com/https://glyphsapp.com/ [Accessed on , Jan. 1, 2021. ]..

ZL Gu, . 2013. . Eight Lectures on the Basis of Seal Cutting. , Shanghai Painting and Calligraphy Publishing House, , :China(in Chinese)..

QL Guo, , TL Kunii, . 1991. . Modeling the diffuse paintings of ‘Sumie’. In: TL Kunii (Ed.), . Modeling in Computer Graphics. IFIP Series on Computer Graphics. , Springer, , :Tokyo. doi: 10.1007/978-4-431-68147-2_21http://doi.org/10.1007/978-4-431-68147-2_21.

High-Logic, . 2020. . High-Logic. . https://www.high-logic.com/https://www.high-logic.com/ [Accessed on , Jan. 1, 2021. ]..

D Huang, . 1999. . Zhongguo Lidai Yinfeng. , Chongqing Press, , :Chongqing, China(in Chinese)..

P Isola, , JY Zhu, , TH Zhou, , et al., . 2017. . Image-to-image translation with conditional adversarial networks. . IEEE Conf on Computer Vision and Pattern Recognition, p.. 5967--5976. . doi: 10.1109/CVPR.2017.632http://doi.org/10.1109/CVPR.2017.632.

Y Jiang, , ZH Lian, , YM Tang, , et al., . 2017. . DCFont: an end-to-end deep Chinese font generation system. . SIGGRAPH, . Article 22. doi: 10.1145/3145749.3149440http://doi.org/10.1145/3145749.3149440.

Y Jiang, , ZH Lian, , YM Tang, , et al., . 2019. . SCFont: structure-guided Chinese font generation via deep stacked networks. . Proc AAAI Conf on Artificial Intelligence, p.. 4015--4022. . doi: 10.1609/aaai.v33i01.33014015http://doi.org/10.1609/aaai.v33i01.33014015.

J Lee, . 1999. . Simulating oriental black-ink painting. . IEEE Comput Graph Appl, , 19((3):):74--81. . doi: 10.1109/38.761553http://doi.org/10.1109/38.761553.

H Leung, . 2004. . Analysis of traditional Chinese seals and synthesis of personalized seals. . IEEE Int Conf on Multimedia and Expo, p.. 1283--1286. . doi: 10.1109/ICME.2004.1394458http://doi.org/10.1109/ICME.2004.1394458.

GT Li, , SD Ma, . 2009. . Zhuankexue. , Jiangsu Education Publishing House, , :China(in Chinese)..

W Li, , YP Song, , CL Zhou, . 2014. . Computationally evaluating and synthesizing Chinese calligraphy. . Neurocomputing, , 135:299--305. . doi: 10.1016/j.neucom.2013.12.013http://doi.org/10.1016/j.neucom.2013.12.013.

ZH Lian, , JG Xiao, . 2012. . Automatic shape morphing for Chinese characters. . SIGGRAPH, p.. 1--4. . doi: 10.1145/2407746.2407748http://doi.org/10.1145/2407746.2407748.

ZH Lian, , B Zhao, , XD Chen, , et al., . 2018. . EasyFont: a style learning-based system to easily build your large-scale handwriting fonts. . ACM Trans Graph, , 38((1):):6. doi: 10.1145/3213767http://doi.org/10.1145/3213767.

JW Lin, , CY Wang, , CL Ting, , et al., . 2014. . Font generation of personal handwritten Chinese characters. . Proc 5th Int Conf on Graphic and Image Processing, , Article 90691T. doi: 10.1117/12.2050128http://doi.org/10.1117/12.2050128.

JW Lin, , CY Hong, , RI Chang, , et al., . 2015. . Complete font generation of Chinese characters in personal handwriting style. . IEEE 34th Int Performance Computing and Communications Conf, p., 1--5. . doi: 10.1109/PCCC.2015.7410321http://doi.org/10.1109/PCCC.2015.7410321.

J Liu, . 2010. . Zhuanke Changyongzi Zidian. , Xiling Yinshe, , :China(in Chinese)..

JW Lu, , C Barnes, , S DiVerdi, , et al., . 2013. . RealBrush: painting with examples of physical media. . ACM Trans Graph, , 32((4):):117. doi: 10.1145/2461912.2461998http://doi.org/10.1145/2461912.2461998.

PY Lyu, , X Bai, , C Yao, , et al., . 2017. . Auto-encoder guided GAN for Chinese calligraphy synthesis. . 14th IAPR Int Conf on Document Analysis and Recognition, p., 1095--1100. . doi: 10.1109/ICDAR.2017.181http://doi.org/10.1109/ICDAR.2017.181.

XF Mi, , J Xu, , M Tang, , et al., . 2002. . The droplet virtual brush for Chinese calligraphic character modeling. . Proc 6th IEEE Workshop on Applications of Computer Vision, p., 330--334. . doi: 10.1109/ACV.2002.1182203http://doi.org/10.1109/ACV.2002.1182203.

YH Pan, . 2019. . On visual knowledge. . Front Inform Technol Electron Eng, , 20((8):):1021--1025. . doi: 10.1631/FITEE.1910001http://doi.org/10.1631/FITEE.1910001.

YH Pan, . 2021. . Miniaturized five fundamental issues about visual knowledge. . Front Inform Technol Electron Eng, , 22((5):):615--618. . doi: 10.1631/FITEE.2040000http://doi.org/10.1631/FITEE.2040000.

X Qiu, , GL Matto, , J Norman, . 2000. . Chinese Writing. , Institute of East Asian Studies, , :University of California, USA..

S Saito, , M Nakajima, . 1999. . 3D physics-based brush model for painting. . ACM SIGGRAPH, . Article 226. doi: 10.1145/311625.312110http://doi.org/10.1145/311625.312110.

C Shi, , JG Xiao, , CH Xu, , et al., . 2014. . Automatic generation of Chinese character using features fusion from calligraphy and font. . The Engineering Reality of Virtual Reality, . Article 90120N. doi: 10.1117/12.2038945http://doi.org/10.1117/12.2038945.

S Strassmann, . 1986. . Hairy brushes. . ACM SIGGRAPH Comput Graph, , 20((4):):225--232. . doi: 10.1145/15886.15911http://doi.org/10.1145/15886.15911.

CL Su, . 2007a. . Edge distance and gray level extraction and orientation invariant transform for Chinese seal recognition. . Appl Math Comput, , 193((2):):325--334. . doi: 10.1016/j.amc.2007.03.061http://doi.org/10.1016/j.amc.2007.03.061.

CL Su, . 2007b. . Ring-to-line mapping and orientation invariant transform for Chinese seal character recognition. . Int J Comput Math, , 84((1):):11--22. . doi: 10.1080/00207160701197967http://doi.org/10.1080/00207160701197967.

DY Sun, , TZ Ren, , CX Li, , et al., . 2017. . Learning to write stylized Chinese characters by reading a handful of examples. . https://arxiv.org/abs/1712.06424v3https://arxiv.org/abs/1712.06424v3, .

SS Tang, , ZQ Xia, , ZH Lian, , et al., . 2019. . FontRNN: generating large-scale Chinese fonts via recurrent neural network. . Comput Graph Forum, , 38((7):):567--577. . doi: 10.1111/cgf.13861http://doi.org/10.1111/cgf.13861.

YC Tian, . 2016. . Rewrite. . https://github.com/kaonashi-tyc/Rewritehttps://github.com/kaonashi-tyc/Rewrite [Accessed on , Jan. 1, 2021. ]..

YC Tian, . 2017. . zi2zi. . https://github.com/kaonashi-tyc/zi2zihttps://github.com/kaonashi-tyc/zi2zi [Accessed on , Jan. 1, 2021. ]..

Unicode Consortium, . 2020. . Roadmap to the TIP. . https://unicode.org/roadmaps/tip/https://unicode.org/roadmaps/tip/ [Accessed on , Jan. 1, 2021. ]..

L Wang, . 1980. . Manuscript of Chinese History. , Zhong Hua Book Company, , :Beijing, China(in Chinese)..

YG Wang, , YJ Pang, . 1986. . CCC—computer Chinese calligraphy system. . Inform Contr, (, (2):):38--43. (in Chinese)..

C Wen, , J Chang, , Y Zhang, , et al., . 2019. . Handwritten Chinese font generation with collaborative stroke refinement. . https://arxiv.org/abs/1904.13268https://arxiv.org/abs/1904.13268, .

HTF Wong, , HHS Ip, . 2000. . Virtual brush: a model-based synthesis of Chinese calligraphy. . Comput Graph, , 24((1):):99--113. . doi: 10.1016/S0097-8493(99)00141-7http://doi.org/10.1016/S0097-8493(99)00141-7.

SH Xu, , M Tang, , F Lau, , et al., . 2002. . A solid model based virtual hairy brush. . Comput Graph Forum, , 21((3):):299--308. . doi: 10.1111/1467-8659.00589http://doi.org/10.1111/1467-8659.00589.

SH Xu, , H Jiang, , FCM Lau, . 2007. . An intelligent system for Chinese calligraphy. . Proc 22nd National Conf on Artificial Intelligence, p., 1578--1583. ..

SH Xu, , H Jiang, , T Jin, , et al., . 2009. . Automatic generation of Chinese calligraphic writings with style imitation. . IEEE Intell Syst, , 24((2):):44--53. . doi: 10.1109/MIS.2009.23http://doi.org/10.1109/MIS.2009.23.

YX Xu, . 2007. . The Research and Implementation of Chinese Calligraphy Tablet Generation Techniques. MS Thesis, . Zhejiang University, , :Hangzhou, China(in Chinese)..

YH Yin, , ZW Chen, , YJ Zhao, , et al., . 2020. . Automated Chinese seal carving art creation with AI assistance. . IEEE Conf on Multimedia Information Processing and Retrieval, p.. 394--395. . doi: 10.1109/MIPR49039.2020.00086http://doi.org/10.1109/MIPR49039.2020.00086.

JH Yu, , QS Peng, . 2005. . Realistic synthesis of cao shu of Chinese calligraphy. . Comput Graph, , 29((1):):145--153. . doi: 10.1016/j.cag.2004.11.013http://doi.org/10.1016/j.cag.2004.11.013.

JH Yu, , JD Zhang, , YQ Cong, . 1996. . A physically-based brush-pen model. . J Comput-Aid Des Comput Graph, , 8((4):):241--245. (in Chinese). doi: 10.3321/j.issn:1003-9775.1996.04.001http://doi.org/10.3321/j.issn:1003-9775.1996.04.001.

K Yu, . 2010. . Researches on Some Key Technologies of Computer Calligraphy. PhD Thesis, . Zhejiang University, , :Hangzhou, China(in Chinese)..

R Yuan, . 1979. . Hanyin Fenyun Hebian. , Shanghai Bookstore Publishing House, , :China(in Chinese)..

JS Zhang, . 2019. . A survey of digital calligraphy. . Sci Sin Inform, , 49((2):):143--158. (in Chinese)..

YX Zhang, , Y Zhang, , WB Cai, . 2018. . Separating style and content for generalized style transfer. . IEEE/CVF Conf on Computer Vision and Pattern Recognition, p.. 8447--8455. . doi: 10.1109/CVPR.2018.00881http://doi.org/10.1109/CVPR.2018.00881.

ZZ Zheng, , FY Zhang, . 2018. . Coconditional autoencoding adversarial networks for Chinese font feature learning. . https://arxiv.org/abs/1812.04451https://arxiv.org/abs/1812.04451, .

BY Zhou, , WH Wang, , ZH Chen, . 2011. . Easy generation of personal Chinese handwritten fonts. . IEEE Int Conf on Multimedia and Expo, p.. 1--6. . doi: 10.1109/ICME.2011.6011892http://doi.org/10.1109/ICME.2011.6011892.

A Zong, , YK Zhu, . 2014. . StrokeBank: automating personalized Chinese handwriting generation. . Proc 28th AAAI Conf on Artificial Intelligence, p., 3024--3029. ..

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

Quant 4.0: engineering quantitative investment with automated, explainable, and knowledge-driven artificial intelligence

Improved deep learning aided key recovery framework: applications to large-state block ciphers

Accurate estimation of 6-DoF tooth pose in 3D intraoral scans for dental applications using deep learning

Deep unfolding based channel estimation for wideband terahertz near-field massive MIMO systems

Combining graph neural network with deep reinforcement learning for resource allocation in computing force networks