基于机器学习的广彩瓷图案生成系统

陳思齊; 崔慧; 杜茗晗; 付铁明; 孙晓红; 纪毅; 杜本麟

doi:10.1631/FITEE.1900399

Your Location：

Home >

Browse articles >

基于机器学习的广彩瓷图案生成系统

智能设计专题 | Updated：2022-05-19

- 基于机器学习的广彩瓷图案生成系统
- Cantonese porcelain classification and image synthesis by ensemble learning and generative adversarial network
- 信息与电子工程前沿（英文） 2019年20卷第12期页码：1632-1643
- Affiliations：
  
  Department of Computer Science and Information Technology, La Trobe University, Melbourne 3086, Australia
  School of Art and Design, Guangdong University of Technology, Guangzhou 510006, China
- Author bio：
  
  Yi JI, E-mail: jiyi001@hotmail.com
- Funds：
  
  Project supported by the Guangzhou Science and Technology Project, China (No. 2018GZMZYB17)
- DOI：10.1631/FITEE.1900399
  中图分类号： TP751
- 收稿：2019-08-06，
  
  修回：2019-12-12，
  
  纸质出版：2019-12
- Accepted：
Scan QR Code
陳思齊, 崔慧, 杜茗晗, 等. 基于机器学习的广彩瓷图案生成系统[J]. 信息与电子工程前沿（英文）, 2019,20(12):1632-1643.

Steven Szu-Chi CHEN, Hui CUI, Ming-han DU, et al. Cantonese porcelain classification and image synthesis by ensemble learning and generative adversarial network[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(12): 1632-1643.
陳思齊, 崔慧, 杜茗晗, 等. 基于机器学习的广彩瓷图案生成系统[J]. 信息与电子工程前沿（英文）, 2019,20(12):1632-1643. DOI： 10.1631/FITEE.1900399.

Steven Szu-Chi CHEN, Hui CUI, Ming-han DU, et al. Cantonese porcelain classification and image synthesis by ensemble learning and generative adversarial network[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(12): 1632-1643. DOI： 10.1631/FITEE.1900399.

摘要

Abstract

Accurate recognition of modern and traditional porcelain styles is a challenging issue in Cantonese porcelain management due to the large variety and complex elements and patterns. We propose a hybrid system with porcelain style identification and image recreation modules. In the identification module

prediction of an unknown porcelain sample is obtained by logistic regression of ensembled neural networks of top-ranked design signatures

which are obtained by discriminative analysis and transformed features in principal components. The synthesis module is developed based on a conditional generative adversarial network

which enables users to provide a designed mask with porcelain elements to generate synthesized images of Cantonese porcelain. Experimental results of 603 Cantonese porcelain images demonstrate that the proposed model outperforms other methods relative to precision

recall

area under curve of receiver operating characteristic

and confusion matrix. Case studies on image creation indicate that the proposed system has the potential to engage the community in understanding Cantonese porcelain and promote this intangible cultural heritage.

关键词

Keywords

references

H Bao , , , Y Liang , , , HZ Liu , , , 等 . . A novel algorithm for extraction of the scripts part in traditional Chinese painting images . . Proc 2 nd Int Conf on Software Technology and Engineering, p , , 2010 . . p.V2-26 - - V2-30 . . DOI: 10.1109/ICSTE.2010.5608756 http://doi.org/10.1109/ICSTE.2010.5608756 . .

A Buades , , , B Coll , , , JM Morel . . A non-local algorithm for image denoising . . IEEE Computer Society Conf on Computer Vision and Pattern Recognition , , 2005 . . p.60 - - 65 . . DOI: 10.1109/CVPR.2005.38 http://doi.org/10.1109/CVPR.2005.38 . .

KH Chen . . Image Operations with cGAN , , http://www.k4ai.com/imageops/index.html http://www.k4ai.com/imageops/index.html , , 2019 . . .

China Intangible Cultural Heritage Network . . Cantonese Porcelain Inheritance Project , , http://www.ihchina.cn/project_details/14453/ http://www.ihchina.cn/project_details/14453/ , , [Accessed on July 16, 2019] (in Chinese) 2008 . . .

WG Cochran . . Some methods for strengthening the common χ 2 tests . . Int Biom Soc , , 1954 . . 10 ( ( 4 ): ): 417 - - 451 . . DOI: 10.2307/3001616 http://doi.org/10.2307/3001616 . .

D Dirvanauskas , , , R Maskeliȱnas , , , V Raudonis , , , 等 . . HEMIGEN: human embryo image generator based on generative adversarial networks . . Sensors , , 2019 . . 19 ( ( 16 ): ): 3578 DOI: 10.3390/s19163578 http://doi.org/10.3390/s19163578 . .

AA Efros , , , WT Freeman . . Image quilting for texture synthesis and transfer . . Proc 28 th Annual Conf on Computer Graphics and Interactive Techniques , , 2001 . . p.341 - - 346 . . DOI: 10.1145/383259.383296 http://doi.org/10.1145/383259.383296 . .

A El Hattami , , , Pierre-Doray , , , Y Barsalou . . Background removal using U-net . . GAN and image matting , , 2019 . . https://github.com/eti-p-doray/unet-gan-matting https://github.com/eti-p-doray/unet-gan-matting , , [Accessed on July 14, 2019] . .

H Emami , , , M Dong , , , SP Nejad-Davarani , , , 等 . . Generating synthetic CTs from magnetic resonance images using generative adversarial networks . . Med Phys , , 2018 . . 45 ( ( 8 ): ): 3627 - - 3636 . . DOI: 10.1002/mp.13047 http://doi.org/10.1002/mp.13047 . .

IJ Goodfellow , , , J Pouget-Abadie , , , M Mirza , , , 等 . . Generative adversarial nets . . Proc 27 th Int Conf on Neural Information Processing Systems , , 2014 . . p.2672 - - 2680 . . . .

A Hertzmann , , , CE Jacobs , , , N Oliver , , , 等 . . Image analogies . . Proc 28 th Annual Conf on Computer Graphics and Interactive Techniques , , 2001 . . p.327 - - 340 . . DOI: 10.1145/383259.383295 http://doi.org/10.1145/383259.383295 . .

S Iizuka , , , E Simo-Serra , , , H Ishikawa . . Let there be color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. . . ACM Trans Graph , , 2016 . . 35 ( ( 4 ): ): Article 110 DOI: 10.1145/2897824.2925974 http://doi.org/10.1145/2897824.2925974 . .

P Isola , , , JY Zhu , , , TH Zhou , , , 等 . . Image-to-image translation with conditional adversarial networks . . IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.1125 - - 1134 . . DOI: 10.1109/CVPR.2017.632 http://doi.org/10.1109/CVPR.2017.632 . .

Y Ji , , , P Tan , , , SC Chen , , , 等 . . Kansei engineering for E-commerce Cantonese porcelain selection in China . . 21 st Int Conf on Human-Computer Interaction , , 2019 . . p.463 - - 474 . . DOI: 10.1007/978-3-030-22646-6_34 http://doi.org/10.1007/978-3-030-22646-6_34 . .

SQ Jiang , , , QM Huang , , , QX Ye , , , 等 . . An effective method to detect and categorize digitized traditional Chinese paintings . . Patt Recogn Lett , , 2006 . . 27 ( ( 7 ): ): 734 - - 746 . . DOI: 10.1016/j.patrec.2005.10.017 http://doi.org/10.1016/j.patrec.2005.10.017 . .

K Kira , , , LA Rendell . . A practical approach to feature selection . . Machine Learning Proc , , 1992 . . p.249 - - 256 . . DOI: 10.1016/B978-1-55860-247-2.50037-1 http://doi.org/10.1016/B978-1-55860-247-2.50037-1 . .

R Kurin . . Safeguarding intangible cultural heritage in the 2003 UNESCO convention: a critical appraisal . . Museum Int , , 2004 . . 56 ( ( 1-2 ): ): 66 - - 77 . . DOI: 10.1111/j.1350-0775.2004.00459.x http://doi.org/10.1111/j.1350-0775.2004.00459.x . .

G Larsson , , , M Maire , , , G Shakhnarovich . . Learning representations for automatic colorization . . Proc 14 th European Conf on Computer Vision , , 2016 . . p.577 - - 593 . . DOI: 10.1007/978-3-319-46493-0_35 http://doi.org/10.1007/978-3-319-46493-0_35 . .

A Lecoutre , , , B NȦgrevergne , , , F Yger . . Recognizing art style automatically in painting with deep learning . . Proc 9 th Asian Conf on Machine Learning , , 2017 . . p.327 - - 342 . . . .

WB Li , , , PC Zhang , , , L Zhang , , , 等 . . Object-driven text-to-image synthesis . . via adversarial training , , 2019 . . https://arxiv.org/abs/1902.10740 https://arxiv.org/abs/1902.10740 , , . .

TY Lin , , , M Maire , , , S Belongie , , , 等 . . Microsoft COCO: common objects in context . . Proc 13 th European Conf on Computer Vision , , 2014 . . p.740 - - 755 . . DOI: 10.1007/978-3-319-10602-1_48 http://doi.org/10.1007/978-3-319-10602-1_48 . .

YF Liu , , , ZC Qin , , , T Wan , , , 等 . . Auto-painter: cartoon image generation from sketch by using conditional Wasserstein generative adversarial networks . . Neurocomputing , , 2018 . . 311 78 - - 87 . . DOI: 10.1016/j.neucom.2018.05.045 http://doi.org/10.1016/j.neucom.2018.05.045 . .

D Lowenthal . . Natural and cultural heritage . . Int J Herit Stud , , 2005 . . 11 ( ( 1 ): ): 81 - - 92 . . DOI: 10.1080/13527250500037088 http://doi.org/10.1080/13527250500037088 . .

XF Mao , , , SH Wang , , , LY Zheng , , , 等 . . Semantic invariant cross-domain image generation with generative adversarial networks . . Neurocomputing , , 2018 . . 293 55 - - 63 . . DOI: 10.1016/j.neucom.2018.02.092 http://doi.org/10.1016/j.neucom.2018.02.092 . .

QY Meng , , , HH Zhang , , , MQ Zhou , , , 等 . . The classification of traditional Chinese painting based on CNN . . Proc 4 th Int Conf on Cloud Computing and Security , , 2018 . . p.232 - - 241 . . DOI: 10.1007/978-3-030-00009-7_22 http://doi.org/10.1007/978-3-030-00009-7_22 . .

D Połap , , , M Wołniak , , , W Wei , , , 等 . . Multi-threaded learning control mechanism for neural networks . . Fut Gener Comput Syst , , 2018 . . 87 16 - - 34 . . DOI: 10.1016/j.future.2018.04.050 http://doi.org/10.1016/j.future.2018.04.050 . .

JR Quinlan . . Induction of decision trees . . Mach Learn , , 1986 . . 1 ( ( 1 ): ): 81 - - 106 . . DOI: 10.1007/BF00116251 http://doi.org/10.1007/BF00116251 . .

L Smith , , , N Akagawa . . Intangible Heritage . . Routledge, London, UK , , 2008 . . .

L Yu , , , H Liu . . Feature selection for high-dimensional data: a fast correlation-based filter solution . . Proc 20 th Int Conf on Machine Learning , , 2003 . . p.856 - - 863 . . . .

R Zhang , , , P Isola , , , AA Efros . . Colorful image colorization . . Proc 14 th European Conf on Computer Vision , , 2016 . . p.649 - - 666 . . DOI: 10.1007/978-3-319-46487-9_40 http://doi.org/10.1007/978-3-319-46487-9_40 . .

JY Zhu , , , T Park , , , P Isola , , , 等 . . Unpaired image-to-image translation using cycle-consistent adversarial networks . . IEEE Int Conf on Computer Vision , , 2017 . . p.2223 - - 2232 . . DOI: 10.1109/ICCV.2017.244 http://doi.org/10.1109/ICCV.2017.244 . .

J Zujovic , , , L Gandy , , , S Friedman , , , 等 . . Classifying paintings by artistic genre: an analysis of features & classifiers . . IEEE Int Workshop on Multimedia Signal Processing , , 2009 . . p.1 - - 5 . . DOI: 10.1109/MMSP.2009.5293271 http://doi.org/10.1109/MMSP.2009.5293271 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

Short text classification based on strong feature thesaurus

Binary tree of posterior probability support vector machines