A review of design intelligence: progress, problems, and challenges

Yong-chuan TANG; Jiang-jie HUANG; Meng-ting YAO; Jia WEI; Wei LI; Yong-xing HE; Ze-jian LI

doi:10.1631/FITEE.1900398

Your Location：

Home >

Browse articles >

A review of design intelligence: progress, problems, and challenges

Special Feature on Intelligent Design | Updated：2022-05-19

- A review of design intelligence: progress, problems, and challenges
- 设计智能研究综述:进展、问题和挑战
- Frontiers of Information Technology & Electronic Engineering Vol. 20, Issue 12, Pages: 1595-1617(2019)
- Affiliations：
  
  College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
  Key Laboratory of Design Intelligence and Digital Creativity of Zhejiang Province, Hangzhou 310027, China
  Zhejiang Lab, Hangzhou 310012, China
  Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Hangzhou 310027, China
- Author bio：
  
  Yong-chuan TANG, E-mail: yctang@zju.edu.cn
- Funds：
- DOI：10.1631/FITEE.1900398
  CLC： TP183
- Received：06 August 2019，
  
  Revised：2019-12-10，
  
  Published：2019-12
- Accepted：
Scan QR Code
Yong-chuan TANG, Jiang-jie HUANG, Meng-ting YAO, et al. A review of design intelligence: progress, problems, and challenges[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(12): 1595-1617.
DOI：

Yong-chuan TANG, Jiang-jie HUANG, Meng-ting YAO, et al. A review of design intelligence: progress, problems, and challenges[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(12): 1595-1617. DOI： 10.1631/FITEE.1900398.

摘要

Abstract

Design intelligence is an important branch of artificial intelligence (AI)

focusing on the intelligent models and algorithms in creativity and design. In the context of AI 2.0

studies on design intelligence have developed rapidly. We summarize mainly the current emerging framework of design intelligence and review the state-of-the-art techniques of related topics

including user needs analysis

ideation

content generation

and design evaluation. Specifically

the models and methods of intelligence-generated content are reviewed in detail. Finally

we discuss some open problems and challenges for future research in design intelligence.

关键词

Keywords

references

M Arjovsky , , , S Chintala , , , L Bottou . . Wasserstein generative adversarial networks . . Proc 34 th Int Conf on Machine Learning , , 2017 . . p.298 - - 321 . . . .

M Aubry , , , D Maturana , , , AA Efros , , , 等 . . Seeing 3D chairs: exemplar part-based 2D-3D alignment using a large dataset of CAD models . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2014 . . p.3762 - - 3769 . . DOI: 10.1109/CVPR.2014.487 http://doi.org/10.1109/CVPR.2014.487 . .

C Ballester , , , M Bertalmio , , , V Caselles , , , 等 . . Filling-in by joint interpolation of vector fields and gray levels . . IEEE Trans Image Process , , 2001 . . 10 ( ( 8 ): ): 1200 - - 1211 . . DOI: 10.1109/83.935036 http://doi.org/10.1109/83.935036 . .

M Bertalmio , , , G Sapiro , , , V Caselles , , , 等 . . Image inpainting . . Proc 27 th Annual Conf on Computer Graphics and Interactive Techniques , , 2000 . . p.417 - - 424 . . DOI: 10.1145/344779.344972 http://doi.org/10.1145/344779.344972 . .

H Bharadhwaj , , , H Park , , , BY Lim . . RecGAN: recurrent generative adversarial networks for recommendation systems . . Proc 12 th ACM Conf on Recommender Systems , , 2018 . . p.372 - - 376 . . DOI: 10.1145/3240323.3240383 http://doi.org/10.1145/3240323.3240383 . .

MA Boden . . Computer models of creativity . . AI Mag , , 2009 . . 30 ( ( 3 ): ): 23 - - 34 . . DOI: 10.1609/aimag.v30i3.2254 http://doi.org/10.1609/aimag.v30i3.2254 . .

A Brock , , , J Donahue , , , K Simonyan . . Large scale GAN training for high fidelity natural image synthesis , , 2018 . . https://arxiv.org/abs/1809.11096 https://arxiv.org/abs/1809.11096 , , . .

J Bruna , , , P Sprechmann , , , Y LeCun . . Super-resolution with deep convolutional sufficient statistics , , 2015 . . https://arxiv.org/abs/1511.05666 https://arxiv.org/abs/1511.05666 , , . .

A Chakrabarti , , , L Siddharth , , , M Dinakar , , , 等 . . Idea inspire 3.0——a tool for analogical design. In: Chakrabarti A, Chakrabarti D (Eds.), Research into Design for Communities . . Springer, Singapore , , 2017 . . p.475 - - 485 . . DOI: 10.1007/978-981-10-3521-0_41 http://doi.org/10.1007/978-981-10-3521-0_41 . .

AJ Champandard . . Semantic style transfer and turning two-bit doodles into fine artworks doodles into fine artworks , , 2016 . . https://arxiv.org/abs/1603.01768 https://arxiv.org/abs/1603.01768 , , . .

C Chan , , , S Ginosar , , , TH Zhou , , , 等 . . Everybody dance now , , 2018 . . https://arxiv.org/abs/1808.07371 https://arxiv.org/abs/1808.07371 , , . .

DD Chen , , , L Yuan , , , J Liao , , , 等 . . Stereoscopic neural style transfer . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.6654 - - 6663 . . DOI: 10.1109/CVPR.2018.00696 http://doi.org/10.1109/CVPR.2018.00696 . .

LQ Chen , , , P Wang , , , H Dong , , , 等 . . An artificial intelligence based data-driven approach for design ideation . . J Vis Commun Image Represent , , 2019 . . 61 10 - - 22 . . DOI: 10.1016/j.jvcir.2019.02.009 http://doi.org/10.1016/j.jvcir.2019.02.009 . .

V Ciesielski , , , P Barile , , , K Trist . . Finding image features associated with high aesthetic value by machine learning . . Proc 2 nd Int Conf on Evolutionary and Biologically Inspired Music, Sound, Art and Design , , 2013 . . p.47 - - 58 . . DOI: 10.1007/978-3-642-36955-1_5 http://doi.org/10.1007/978-3-642-36955-1_5 . .

A Cooper . . The Inmates Are Running the Asylum . . SAMS, Indianapolis, USA , , 1999 . . .

A Cooper , , , RM Reimann . . About Face 2.0: the Essentials of Interaction Design . . John Wiley & Sons, Indianapolis, USA , , 2003 . . .

A Dash , , , JCB Gamboa , , , S Ahmed , , , 等 . . TAC-GAN-text conditioned auxiliary classifier generative adversarial network , , 2017 . . https://arxiv.org/abs/1703.06412 https://arxiv.org/abs/1703.06412 , , . .

R Datta , , , D Joshi , , , J Li , , , 等 . . Studying aesthetics in photographic images using a computational approach . . Proc 9 th European Conf on Computer Vision , , 2006 . . 288 - - 301 . . DOI: 10.1007/11744078_23 http://doi.org/10.1007/11744078_23 . .

A de Gómez Silva Garza , , , ML Maher . . An evolutionary approach to case adaptation . . Proc 3 rd Int Conf on Case-Based Reasoning , , 1999 . . p.162 - - 173 . . DOI: 10.1007/3-540-48508-2_12 http://doi.org/10.1007/3-540-48508-2_12 . .

AG de Silva Garza . . An introduction to and comparison of computational creativity and design computing . . Artif Intell Rev , , 2019 . . 51 ( ( 1 ): ): 61 - - 76 . . DOI: 10.1007/s10462-017-9557-3 http://doi.org/10.1007/s10462-017-9557-3 . .

J Deng , , , W Dong , , , R Socher , , , 等 . . ImageNet: a large-scale hierarchical image database . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2009 . . p.248 - - 255 . . DOI: 10.1109/CVPR.2009.5206848 http://doi.org/10.1109/CVPR.2009.5206848 . .

YB Deng , , , CC Loy , , , XO Tang . . Aesthetic-driven image enhancement by adversarial learning . . Proc 26 th ACM Int Conf on Multimedia , , 2018 . . p.870 - - 878 . . DOI: 10.1145/3240508.3240531 http://doi.org/10.1145/3240508.3240531 . .

J Donahue , , , P Krähenbȹhl , , , T Darrell . . Adversarial feature learning , , 2016 . . https://arxiv.org/abs/1605.09782 https://arxiv.org/abs/1605.09782 , , . .

Q Dou , , , XS Zheng , , , TF Sun , , , 等 . . Webthetics: quantifying webpage aesthetics with deep learning. Int J Hum Comput Stud , , 2019 . . 124 56 - - 66 . . DOI: 10.1016/j.ijhcs.2018.11.006 http://doi.org/10.1016/j.ijhcs.2018.11.006 . .

KL Dugosh , , , PB Paulus , , , EJ Roland , , , 等 . . Cognitive stimulation in brainstorming . . J Pers Soc Psychol , , 2000 . . 79 ( ( 5 ): ): 722 - - 735 . . DOI: 10.1037/0022-3514.79.5.722 http://doi.org/10.1037/0022-3514.79.5.722 . .

V Dumoulin , , , F Visin . . A guide to convolution arithmetic for deep learning , , 2016 . . https://arxiv.org/abs/1603.07285 https://arxiv.org/abs/1603.07285 , , . .

RR Edelman , , , JR Hesselink , , , MB Zlatkin . . MRI: Clinical Magnetic Resonance Imaging . . Saunders, Philadelphia , , 1996 . . .

AA Efros , , , WT Freeman . . Image quilting for texture synthesis and transfer . . Proc 28 th Annual Conf on Computer Graphics and Interactive Techniques , , 2001 . . p.341 - - 346 . . DOI: 10.1145/383259.383296 http://doi.org/10.1145/383259.383296 . .

A Elgammal , , , B Liu , , , M Elhoseiny , , , 等 . . creative adversarial networks . . generating "art" by learning about styles and deviating from style norms , , 2017 . . https://arxiv.org/abs/1706.07068 https://arxiv.org/abs/1706.07068 , , . .

H Fang , , , M Zhang . . Creatism: a deep-learning photographer capable of creating professional work. , , 2017 . . https://arxiv.org/abs/1707.03491 https://arxiv.org/abs/1707.03491 , , . .

H Faste , , , N Rachmel , , , R Essary , , , 等 . . Brainstorm, chainstorm, cheatstorm, tweetstorm: new ideation strategies for distributed HCI design . . Proc Conf on Human Factors in Computing Systems , , 2013 . . p.1343 - - 1352 . . DOI: 10.1145/2470654.2466177 http://doi.org/10.1145/2470654.2466177 . .

K Fu , , , J Murphy , , , M Yang , , , 等 . . Design-by-analogy: experimental evaluation of a functional analogy search methodology for concept generation improvement . . Res Eng Des , , 2015 . . 26 ( ( 1 ): ): 77 - - 95 . . DOI: 10.1007/s00163-014-0186-4 http://doi.org/10.1007/s00163-014-0186-4 . .

CA Garabedian . . Birkhoff on aesthetic measure . . Bull Amer Math Soc , , 1934 . . 40 ( ( 1 ): ): 7 - - 10 . . DOI: 10.1090/S0002-9904-1934-05764-1 http://doi.org/10.1090/S0002-9904-1934-05764-1 . .

L Gatys , , , A Ecker , , , M Bethge . . Image style transfer using convolutional neural networks . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016a . . p.2414 - - 2423 . . DOI: 10.1109/CVPR.2016.265 http://doi.org/10.1109/CVPR.2016.265 . .

L Gatys , , , A Ecker , , , M Bethge . . A neural algorithm of artistic style . . J Vis , , 2016b . . 16 ( ( 12 ): ): 326 DOI: 10.1167/16.12.326 http://doi.org/10.1167/16.12.326 . .

JS Gero . . Design prototypes: a knowledge representation schema for design . . AI Mag , , 1990 . . 11 ( ( 4 ): ): 26 - - 36 . . . .

K Gilon , , , J Chan , , , FY Ng , , , 等 . . Analogy mining for specific design needs . . Proc CHI Conf on Human Factors in Computing Systems , , 2018 . . p.121 DOI: 10.1145/3173574.3173695 http://doi.org/10.1145/3173574.3173695 . .

AK Goel , , , S Rugaber , , , S Vattam . . Structure, behavior, and function of complex systems: the structure, behavior, and function modeling language . . AI Edam , , 2009 . . 23 ( ( 1 ): ): 23 - - 35 . . DOI: 10.1017/S0890060409000080 http://doi.org/10.1017/S0890060409000080 . .

G Goldschmidt , , , M Smolkov . . Variances in the impact of visual stimuli on design problem solving performance . . Des Stud , , 2006 . . 27 ( ( 5 ): ): 549 - - 569 . . DOI: 10.1016/j.destud.2006.01.002 http://doi.org/10.1016/j.destud.2006.01.002 . .

B Gooch , , , A Gooch . . Non-photorealistic Rendering , , : : New York, USA A K Peters/CRC Press , , 2001 . . DOI: 10.1201/9781439864173 http://doi.org/10.1201/9781439864173 . .

I Goodfellow , , , J Pouget-Abadie , , , M Mirza , , , 等 . . Generative adversarial nets . . Proc 27 th Int Conf on Neural Information Processing Systems , , 2014 . . p.2672 - - 2680 . . . .

J Grudin , , , J Pruitt . . Personas, participatory design, and product development: an infrastructure for engagement . . Proc 7 th Biennial Participatory Design Conf , , 2002 . . p.144 - - 152 . . . .

I Gulrajani , , , F Ahmed , , , M Arjovsky , , , 等 . . Improved training of Wasserstein GANs . . Advances in Neural Information Proc Systems , , 2017 . . p.5767 - - 5777 . . . .

J Han , , , F Shi , , , LQ Chen , , , 等 . . A computational tool for creative idea generation based on analogical reasoning and ontology . . Artif Intell Eng Des Anal Manuf , , 2018 . . 32 ( ( 4 ): ): 462 - - 477 . . DOI: 10.1017/S0890060418000082 http://doi.org/10.1017/S0890060418000082 . .

J Hao , , , YJ Zhou , , , QF Zhao , , , 等 . . An evolutionary computation based method for creative design inspiration generation . . J Intell Manuf , , 2019 . . 30 ( ( 4 ): ): 1673 - - 1691 . . DOI: 10.1007/s10845-017-1347-x http://doi.org/10.1007/s10845-017-1347-x . .

R Hartson , , , PS Pyla . . The UX Book: Process and Guidelines for Ensuring a Quality User Experience . . Elsevier, Amsterdam , , 2012 . . DOI: 10.1016/C2010-0-66326-7 http://doi.org/10.1016/C2010-0-66326-7 . .

KM He , , , J Sun . . Image completion approaches using the statistics of similar patches . . IEEE Trans Patt Anal Mach Intell , , 2014 . . 36 ( ( 12 ): ): 2423 - - 2435 . . DOI: 10.1109/TPAMI.2014.2330611 http://doi.org/10.1109/TPAMI.2014.2330611 . .

A Hertzmann , , , CE Jacobs , , , N Oliver , , , 等 . . Image analogies . . Proc 28 th Annual Conf on Computer Graphics and Interactive Techniques , , 2001 . . p.327 - - 340 . . DOI: 10.1145/383259.383295 http://doi.org/10.1145/383259.383295 . .

YJ Hong , , , U Hwang , , , J Yoo , , , 等 . . How generative adversarial networks and their variants work: an overview . . ACM Comput Surv , , 2019 . . 52 ( ( 1 ): ): 10 DOI: 10.1145/3301282 http://doi.org/10.1145/3301282 . .

HZ Huang , , , H Wang , , , WH Luo , , , 等 . . Real-time neural style transfer for videos . . IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.7044 - - 7052 . . DOI: 10.1109/CVPR.2017.745 http://doi.org/10.1109/CVPR.2017.745 . .

X Huang , , , S Belongie . . Arbitrary style transfer in real-time with adaptive instance normalization . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.1501 - - 1510 . . DOI: 10.1109/ICCV.2017.167 http://doi.org/10.1109/ICCV.2017.167 . .

S Iizuka , , , E Simo-Serra , , , H Ishikawa . . Globally and locally consistent image completion . . ACM Trans Graph , , 2017 . . 36 ( ( 4 ): ): DOI: 10.1145/3072959.3073659 http://doi.org/10.1145/3072959.3073659 . .

P Isola , , , JY Zhu , , , TH Zhou , , , 等 . . Image-to-image translation with conditional adversarial networks . . IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.5967 - - 5976 . . DOI: 10.1109/CVPR.2017.632 http://doi.org/10.1109/CVPR.2017.632 . .

BJ Jansen , , , SG Jung , , , J Salminen , , , 等 . . Viewed by too many or viewed too little: using information dissemination for audience segmentation . . Proc Assoc Inform Sci Technol , , 2017 . . 54 ( ( 1 ): ): 189 - - 196 . . DOI: 10.1002/pra2.2017.14505401021 http://doi.org/10.1002/pra2.2017.14505401021 . .

DG Jansson , , , SM Smith . . Design fixation . . Des Stud , , 1991 . . 12 ( ( 1 ): ): 3 - - 11 . . DOI: 10.1016/0142-694X(91)90003-F http://doi.org/10.1016/0142-694X(91)90003-F . .

J Jia , , , J Huang , , , GY Shen , , , 等 . . Learning to appreciate the aesthetic effects of clothing . . Proc 30 th AAAI Conf on Artificial Intelligence , , 2016 . . p.1216 - - 1222 . . . .

L Jia , , , N Becattini , , , G Cascini , , , 等 . . Testing ideation performance on a large set of designers: effects of analogical distance . . Int J Des Creat Innov , , 2020 . . 8 ( ( 1 ): ): 31 - - 45 . . DOI: 10.1080/21650349.2019.1618736 http://doi.org/10.1080/21650349.2019.1618736 . .

SH Jiang , , , Y Fu . . Fashion style generator . . Proc 26 th Int Joint Conf on Artificial Intelligence , , 2017 . . p.3721 - - 3727 . . DOI: 10.24963/ijcai.2017/520 http://doi.org/10.24963/ijcai.2017/520 . .

YC Jing , , , YZ Yang , , , ZL Feng , , , 等 . . Neural style transfer: a review . . IEEE Trans Vis Comput Graph, in press , , 2019 . . DOI: 10.1109/tvcg.2019.2921336 http://doi.org/10.1109/tvcg.2019.2921336 . .

Y Jo , , , J Park . . SC-FEGAN: face editing generative adversarial network with user's sketch and color , , 2019 . . https://arxiv.org/abs/1902.06838 https://arxiv.org/abs/1902.06838 , , . .

J Johnson , , , A Alahi , , , FF Li . . Perceptual losses for real-time style transfer and super-resolution . . Proc 14 th European Conf , , 2016 . . p.694 - - 711 . . DOI: 10.1007/978-3-319-46475-6_43 http://doi.org/10.1007/978-3-319-46475-6_43 . .

T Karras , , , S Laine , , , T Aila . . A style-based generator architecture for generative adversarial networks . . The IEEE Conf on Computer Vision and Pattern Recognition , , 2019 . . p.4401 - - 4410 . . . .

JC Kaufman , , , RJ Sternberg . . The International Handbook of Creativity . . Edward Elgar Publishing, Cheltenham, UK , , 2006 . . .

R Keys . . Cubic convolution interpolation for digital image processing . . IEEE Trans Acoust Speech Signal Process , , 1981 . . 29 ( ( 6 ): ): 1153 - - 1160 . . DOI: 10.1109/TASSP.1981.1163711 http://doi.org/10.1109/TASSP.1981.1163711 . .

J Kim , , , JK Lee , , , KM Lee . . Accurate image super-resolution using very deep convolutional networks . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016 . . p.1646 - - 1654 . . DOI: 10.1109/CVPR.2016.182 http://doi.org/10.1109/CVPR.2016.182 . .

DP Kingma , , , M Welling . . Auto-encoding variational Bayes , , 2013 . . https://arxiv.org/abs/1312.6114 https://arxiv.org/abs/1312.6114 , , . .

S Kong , , , XH Shen , , , Z Lin , , , 等 . . Photo aesthetics ranking network with attributes and content adaptation . . Proc 14 th European Conf on Computer Vision , , 2016 . . p.662 - - 679 . . DOI: 10.1007/978-3-319-46448-0_40 http://doi.org/10.1007/978-3-319-46448-0_40 . .

A Krizhevsky , , , G Hinton . . Learning Multiple Layers of Features from Tiny Images . . Technical Report, University of Toronto, Toronto , , 2009 . . .

H Kwak , , , J An , , , BJ Jansen . . Automatic generation of personas using YouTube social media data . . Proc 50 th Hawaii Int Conf on System Sciences , , 2017 . . p.833 - - 842 . . . .

ABL Larsen , , , SK Sønderby , , , H Larochelle , , , 等 . . Autoencoding beyond pixels using a learned similarity metric . . Proc 33 rd Int Conf on Machine Learning , , 2016 . . p.1558 - - 1566 . . . .

Y LeCun , , , L Bottou , , , Y Bengio , , , 等 . . Gradient-based learning applied to document recognition . . Proc IEEE , , 1998 . . 86 ( ( 11 ): ): 2278 - - 2323 . . DOI: 10.1109/5.726791 http://doi.org/10.1109/5.726791 . .

C Ledig , , , L Theis , , , F Huszár , , , 等 . . Photo-realistic single image super-resolution using a generative adversarial network . . IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.105 - - 114 . . DOI: 10.1109/CVPR.2017.19 http://doi.org/10.1109/CVPR.2017.19 . .

C Li , , , M Wand . . Precomputed real-time texture synthesis with Markovian generative adversarial networks . . Proc 14 th European Conf on Computer Vision , , 2016 . . p.702 - - 716 . . DOI: 10.1007/978-3-319-46487-9_43 http://doi.org/10.1007/978-3-319-46487-9_43 . .

CC Li , , , T Chen . . Aesthetic visual quality assessment of paintings . . IEEE J Sel Top Signal Process , , 2009 . . 3 ( ( 2 ): ): 236 - - 252 . . DOI: 10.1109/JSTSP.2009.2015077 http://doi.org/10.1109/JSTSP.2009.2015077 . .

HH Li , , , JG Wang , , , MM Tang , , , 等 . . Polarization-dependent effects of an Airy beam due to the spin-orbit coupling . . J Opt Soc Am A , , 2017 . . 34 ( ( 7 ): ): 1114 - - 1118 . . DOI: 10.1364/JOSAA.34.001114 http://doi.org/10.1364/JOSAA.34.001114 . .

XT Li , , , SF Liu , , , J Kautz , , , 等 . . Learning linear transformations for fast arbitrary style transfer . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2019 . . p.3809 - - 3817 . . . .

YJ Li , , , C Fang , , , JM Yang , , , 等 . . Universal style transfer via feature transforms . . Proc 31 st Conf on Neural Information Processing Systems , , 2017 . . p.386 - - 396 . . . .

GL Liu , , , FA Reda , , , KJ Shih , , , 等 . . Image inpainting for irregular holes using partial convolutions . . Proc 15 th European Conf on Computer Vision , , 2018 . . p.85 - - 105 . . DOI: 10.1007/978-3-030-01252-6_6 http://doi.org/10.1007/978-3-030-01252-6_6 . .

H Liu , , , P Singh . . ConceptNetjj——a practical commonsense reasoning tool-kit . . BT Technol J , , 2004 . . 22 ( ( 4 ): ): 211 - - 226 . . DOI: 10.1023/B:BTTJ.0000047600.45421.6d http://doi.org/10.1023/B:BTTJ.0000047600.45421.6d . .

MY Liu , , , X Huang , , , A Mallya , , , 等 . . Few-shot unsupervised image-to-image . . translation , , 2019 . . https://arxiv.org/abs/1905.01723 https://arxiv.org/abs/1905.01723 , , . .

ZW Liu , , , P Luo , , , XG Wang , , , 等 . . Deep learning face attributes in the wild . . Proc IEEE Int Conf on Computer Vision , , 2015 . . p.3730 - - 3738 . . DOI: 10.1109/ICCV.2015.425 http://doi.org/10.1109/ICCV.2015.425 . .

T Lowdermilk . . User-Centered Design: a Developer's Guide to Building User-Friendly Applications . . O'Reilly, Beijing, China , , 2013 . . .

X Lu , , , Z Lin , , , XH Shen , , , 等 . . Deep multi-patch aggregation network for image style, aesthetics, and quality estimation . . Proc IEEE Int Conf on Computer Vision , , 2015 . . p.990 - - 998 . . DOI: 10.1109/ICCV.2015.119 http://doi.org/10.1109/ICCV.2015.119 . .

YW Luo , , , XO Tang . . Photo and video quality evaluation: focusing on the subject . . Proc 10 th European Conf on Computer Vision , , 2008 . . p.386 - - 399 . . . .

S Ma , , , J Liu , , , WC Chen . . A-lamp: adaptive layout-aware multi-patch deep convolutional neural network for photo aesthetic assessment . . Proc 30 th IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.722 - - 731 . . DOI: 10.1109/CVPR.2017.84 http://doi.org/10.1109/CVPR.2017.84 . .

M Maguire , , , N Bevan . . User requirements analysis. In: Hammond J, Gross T, Wesson J (Eds.), Usability: Gaining a Competitive Edge . . Springer, Boston, USA , , 2002 . . p.133 - - 148 . . DOI: 10.1007/978-0-387-35610-5_9 http://doi.org/10.1007/978-0-387-35610-5_9 . .

L Mai , , , HL Jin , , , F Liu . . Composition-preserving deep photo aesthetics assessment . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016 . . p.497 - - 506 . . DOI: 10.1109/CVPR.2016.60 http://doi.org/10.1109/CVPR.2016.60 . .

T Matthews , , , T Judge , , , S Whittaker . . Matthews T, Judge T, Whittaker S, 2012. How do designers and user experience professionals actually perceive and use personas? . . Proc Conf on Human Factors in Computing Systems , , p.1219 - - 1228 . . DOI: 10.1145/2207676.2208573 http://doi.org/10.1145/2207676.2208573 . .

T McCaffrey , , , S Krishnamurty . . The obscure features hypothesis in design innovation . . Int J Des Creat Innov , , 2008 . . 3 ( ( 1 ): ): 1219 - - 1228 . . DOI: 10.1080/21650349.2014.893840 http://doi.org/10.1080/21650349.2014.893840 . .

J McGinn , , , N Kotamraju . . The obscure features hypothesis in design innovation . . Int J Des Creat Innov , , 2008 . . p.1521 - - 1524 . . DOI: 10.1145/1357054.1357292 http://doi.org/10.1145/1357054.1357292 . .

T Miaskiewicz , , , KA Kozar . . Personas and user-centered design: how can personas benefit product design processes . . Des Stud , , 2011 . . 32 ( ( 5 ): ): 417 - - 430 . . DOI: 10.1016/j.destud.2011.03.003 http://doi.org/10.1016/j.destud.2011.03.003 . .

T Mikolov , , , K Chen , , , G Corrado , , , 等 . . Efficient estimation of word representations in vector space , , 2013 . . https://arxiv.org/abs/1301.3781 https://arxiv.org/abs/1301.3781 , , . .

GA Miller . . Wordnet: a lexical database for English . . Commun ACM , , 1995 . . 38 ( ( 11 ): ): 39 - - 41 . . DOI: 10.1145/219717.219748 http://doi.org/10.1145/219717.219748 . .

M Mirza , , , S Osindero . . Conditional generative adversarial nets , , 2014 . . https://arxiv.org/abs/1411.1784 https://arxiv.org/abs/1411.1784 , , . .

T Miyato , , , T Kataoka , , , M Koyama , , , 等 . . Spectral normalization for generative adversarial networks . . Int Conf on Learning Representations , , 2018 . . .

N Murray , , , L Marchesotti , , , F Perronnin . . AVA: a large-scale database for aesthetic visual analysis . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2012 . . p.2408 - - 2415 . . DOI: 10.1109/CVPR.2012.6247954 http://doi.org/10.1109/CVPR.2012.6247954 . .

K Nazeri , , , E Ng , , , T Joseph , , , 等 . . Edgeconnect: generative image inpainting with adversarial edge learning , , 2019 . . https://arxiv.org/abs/1901.00212 https://arxiv.org/abs/1901.00212 , , . .

BA Nelson , , , JO Wilson , , , D Rosen , , , 等 . . Refined metrics for measuring ideation effectiveness . . Des Stud , , 2009 . . 30 ( ( 6 ): ): 737 - - 743 . . DOI: 10.1016/j.destud.2009.07.002 http://doi.org/10.1016/j.destud.2009.07.002 . .

L Nielsen , , , KS Hansen , , , J Stage , , , 等 . . A template for design personas: analysis of 47 persona descriptions from Danish industries and organizations . . Int J Sociotechnol Knowl Dev , , 2015 . . 7 ( ( 1 ): ): 45 - - 61 . . DOI: 10.4018/ijskd.2015010104 http://doi.org/10.4018/ijskd.2015010104 . .

I Niles , , , A Pease . . Towards a standard upper ontology . . Proc Int Conf on Formal Ontology in Information Systems , , 2001 . . p.2 - - 9 . . DOI: 10.1145/505168.505170 http://doi.org/10.1145/505168.505170 . .

ME Nilsback , , , A Zisserman . . Automated flower classification over a large number of classes . . Proc 6 th Indian Conf on Computer Vision, Graphics & Image Processing , , 2008 . . p.722 - - 729 . . DOI: 10.1109/ICVGIP.2008.47 http://doi.org/10.1109/ICVGIP.2008.47 . .

A Odena , , , C Olah , , , J Shlens . . Conditional image synthesis with auxiliary classifier GANs . . Proc 34 th Int Conf on Machine Learning , , 2017 . . p.4043 - - 4055 . . . .

YH Pan . . Special issue on artificial intelligence 2.0 . . Front Inform Technol Electron Eng , , 2017 . . 18 ( ( 1 ): ): 1 - - 2 . . DOI: 10.1631/FITEE.1710000 http://doi.org/10.1631/FITEE.1710000 . .

T Park , , , MY Liu , , , TC Wang , , , 等 . . Semantic image synthesis with spatially-adaptive normalization . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2019 . . p.2337 - - 2346 . . . .

D Pathak , , , P Krähenbȹhl , , , J Donahue , , , 等 . . Context encoders: feature learning by inpainting . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016 . . p.2536 - - 2544 . . DOI: 10.1109/CVPR.2016.278 http://doi.org/10.1109/CVPR.2016.278 . .

JR Peeters , , , PA Verhaegen , , , D Vandevenne , , , 等 . . Refined metrics for measuring novelty in ideation . . IDMME Virtual Concept Research in Interaction Design, Article 4. , , 2010 . . .

D Perera , , , R Zimmermann . . CNGAN: generative adversarial networks for cross-network user preference generation for non-overlapped users . . World Wide Web Conf , , 2019 . . p.3144 - - 3150 . . DOI: 10.1145/3308558.3313733 http://doi.org/10.1145/3308558.3313733 . .

J Pruitt , , , T Adlin . . The Persona Lifecycle: Keeping People in Mind Throughout Product Design . . Elsevier, Amsterdam , , 2005 . . p.724 . .

A Radford , , , L Metz , , , S Chintala . . Unsupervised representation learning with deep convolutional generative adversarial networks . . Proc 4 th Int Conf on Learning Representations , , 2016 . . .

SE Reed , , , Z Akata , , , XC Yan , , , 等 . . Generative adversarial text to image synthesis . . Proc 33 rd Int Conf on Machine Learning , , 2016a . . p.1681 - - 1690 . . . .

SE Reed , , , Z Akata , , , S Mohan , , , 等 . . Learning what and where to draw . . Advances in Neural Information Processing Systems , , 2016b . . p.217 - - 225 . . . .

J Rigau , , , M Feixas , , , M Sbert . . Informational aesthetics measures . . IEEE Comput Graph Appl , , 2008 . . 28 ( ( 2 ): ): 24 - - 34 . . DOI: 10.1109/MCG.2008.34 http://doi.org/10.1109/MCG.2008.34 . .

SJ Russell , , , P Norvig . . Artificial Intelligence: a Modern Approach . . Pearson Education Limited, Harlow, Essex , , 2016 . . .

B Saleh , , , A Elgammal . . Large-scale classification of fine-art paintings: learning the right metric on the right feature , , 2015 . . https://arxiv.org/abs/1505.00855 https://arxiv.org/abs/1505.00855 , , . .

T Salimans , , , IJ Goodfellow , , , W Zaremba , , , 等 . . Improved techniques for training GANs . . Advances in Neural Information Processing Systems , , 2016 . . p.2226 - - 2234 . . . .

J Salminen , , , S Sengȹn , , , H Kwak , , , 等 . . Generating cultural personas from social data: a perspective of middle eastern users . . Proc 5 th Int Conf on Future Internet of Things and Cloud Workshops , , 2017 . . p.120 - - 125 . . DOI: 10.1109/FiCloudW.2017.97 http://doi.org/10.1109/FiCloudW.2017.97 . .

J Salminen , , , BJ Jansen , , , J An , , , 等 . . Are personas done? Evaluating their usefulness in the age of digital analytics. . . Persona Stud , , 2018a . . 4 ( ( 2 ): ): 47 - - 65 . . DOI: 10.21153/psj2018vol4no2art737 http://doi.org/10.21153/psj2018vol4no2art737 . .

J Salminen , , , SG Jung , , , J An , , , 等 . . Findings of a user study of automatically generated personas . . Proc Conf on Human Factors in Computing Systems , , 2018b . . p.LBW097 DOI: 10.1145/3170427.3188470 http://doi.org/10.1145/3170427.3188470 . .

J Salminen , , , S Engȹn , , , SG Jung , , , 等 . . Design issues in automatically generated persona profiles: a qualitative analysis from 38 think-aloud transcripts . . Proc Conf on Human Information Interaction and Retrieval , , 2019 . . p.225 - - 229 . . DOI: 10.1145/3295750.3298942 http://doi.org/10.1145/3295750.3298942 . .

K Schwarz , , , P Wieschollek , , , HPA Lensch . . Will people like your image? Learning the aesthetic space . . Proc IEEE Winter Conf on Applications of Computer Vision , , 2018 . . p.2048 - - 2057 . . DOI: 10.1109/WACV.2018.00226 http://doi.org/10.1109/WACV.2018.00226 . .

JJ Shah , , , SV Kulkarni , , , N Vargas-Hernandez . . Evaluation of idea generation methods for conceptual design: effectiveness metrics and design of experiments . . J Mech Des , , 2000 . . 122 ( ( 4 ): ): 377 - - 384 . . DOI: 10.1115/1.1315592 http://doi.org/10.1115/1.1315592 . .

K Simonyan , , , A Zisserman . . Very deep convolutional networks for large-scale image recognition , , 2014 . . https://arxiv.org/abs/1409.1556 https://arxiv.org/abs/1409.1556 , , . .

T Strohmann , , , D Siemon , , , S Robra-Bissantz . . brAInstorm: intelligent assistance in group idea generation . . Proc 12 th Int Conf on Design Science Research in Information System and Technology , , 2017 . . p.457 - - 461 . . DOI: 10.1007/978-3-319-59144-5_31 http://doi.org/10.1007/978-3-319-59144-5_31 . .

T Strothotte , , , S Schlechtweg . . Non-photorealistic Computer Graphics: Modeling, Rendering, and Animation . . Morgan Kaufmann Publishers Inc., San Francisco, CA, USA , , 2002 . . .

X Tang , , , ZW Wang , , , WX Luo , , , 等 . . Face aging with identity-preserved conditional generative adversarial networks . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.7939 - - 7947 . . DOI: 10.1109/CVPR.2018.00828 http://doi.org/10.1109/CVPR.2018.00828 . .

XO Tang , , , W Luo , , , XG Wang . . Content-based photo quality assessment . . IEEE Trans Multim , , 2013 . . 15 ( ( 8 ): ): 1930 - - 1943 . . DOI: 10.1109/TMM.2013.2269899 http://doi.org/10.1109/TMM.2013.2269899 . .

D Vandevenne , , , PA Verhaegen , , , S Dewulf , , , 等 . . A scalable approach for ideation in biologically inspired design . . Artif Intell Eng Des Anal Manuf , , 2015 . . 29 ( ( 1 ): ): 19 - - 31 . . DOI: 10.1017/S0890060414000122 http://doi.org/10.1017/S0890060414000122 . .

LR Varshney , , , F Pinel , , , KR Varshney , , , 等 . . A big data approach to computational creativity: the curious case of Chef Watson . . IBM J Res Dev , , 2019 . . 63 ( ( 1 ): ): 7:1 - - 7:18 . . DOI: 10.1147/JRD.2019.2893905 http://doi.org/10.1147/JRD.2019.2893905 . .

P Verma , , , JO Smith . . Neural style transfer for audio spectograms , , 2018 . . https://arxiv.org/abs/1801.01589 https://arxiv.org/abs/1801.01589 , , . .

J Wang , , , LT Yu , , , WN Zhang , , , 等 . . IRGAN: a minimax game for unifying generative and discriminative information retrieval models . . Proc 40 th Int ACM SIGIR Conf on Research and Development in Information Retrieval , , 2017 . . p.515 - - 524 . . DOI: 10.1145/3077136.3080786 http://doi.org/10.1145/3077136.3080786 . .

TC Wang , , , MY Liu , , , JY Zhu , , , 等 . . Video-to-video . . synthesis , , 2018 . . https://arxiv.org/abs/1808.06601 https://arxiv.org/abs/1808.06601 , , . .

WG Wang , , , JB Shen . . Deep cropping via attention box prediction and aesthetics assessment . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.2205 - - 2213 . . DOI: 10.1109/ICCV.2017.240 http://doi.org/10.1109/ICCV.2017.240 . .

WN Wang , , , D Cai , , , L Wang , , , 等 . . Synthesized computational aesthetic evaluation of photos . . Neurocomputing , , 2016 . . 172 244 - - 252 . . DOI: 10.1016/j.neucom.2014.12.106 http://doi.org/10.1016/j.neucom.2014.12.106 . .

WS Wang , , , S Yang , , , WS Zhang , , , 等 . . Neural aesthetic image reviewer , , 2018 . . https://arxiv.org/abs/1802.10240 https://arxiv.org/abs/1802.10240 , , . .

XT Wang , , , K Yu , , , SX Wu , , , 等 . . ESRGAN: enhanced super-resolution generative adversarial networks . . European Conf on Computer Vision , , 2018 . . p.63 - - 79 . . DOI: 10.1007/978-3-030-11021-5_5 http://doi.org/10.1007/978-3-030-11021-5_5 . .

JJ Wu , , , CK Zhang , , , TF Xue , , , 等 . . Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling . . Advances in Neural Information Processing Systems , , 2016 . . p.82 - - 90 . . . .

T Xu , , , PC Zhang , , , QY Huang , , , 等 . . AttnGAN: fine-grained text to image generation with attentional generative adversarial networks . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.1316 - - 1324 . . DOI: 10.1109/CVPR.2018.00143 http://doi.org/10.1109/CVPR.2018.00143 . .

Y Yan , , , JR Wang , , , C Tang , , , 等 . . Research on the development of contemporary design intelligence driven by neural network technology. In: Marcus A, Wang WT (Eds.), Design, User Experience, and Usability. Design Philosophy and Theory . . Springer, Cham , , 2019 . . p.368 - - 381 . . DOI: 10.1007/978-3-030-23570-3_27 http://doi.org/10.1007/978-3-030-23570-3_27 . .

HY Yang , , , D Huang , , , YH Wang , , , 等 . . Learning face age progression: a pyramid architecture of GANs . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.31 - - 39 . . DOI: 10.1109/CVPR.2018.00011 http://doi.org/10.1109/CVPR.2018.00011 . .

WM Yang , , , XC Zhang , , , YP Tian , , , 等 . . Deep learning for single image super-resolution: a brief review . . IEEE Trans Multim , , 2019 . . 21 ( ( 12 ): ): 3106 - - 3121 . . DOI: 10.1109/tmm.2019.2919431 http://doi.org/10.1109/tmm.2019.2919431 . .

Y Yang , , , YT Zhuang , , , F Wu , , , 等 . . Harmonizing hierarchical manifolds for multimedia document semantics understanding and cross-media retrieval . . IEEE Trans Multim , , 2008 . . 10 ( ( 3 ): ): 437 - - 446 . . DOI: 10.1109/TMM.2008.917359 http://doi.org/10.1109/TMM.2008.917359 . .

ZL Yi , , , H Zhang , , , P Tan , , , 等 . . DualGAN: unsupervised dual learning for image-to-image translation . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.2868 - - 2876 . . DOI: 10.1109/ICCV.2017.310 http://doi.org/10.1109/ICCV.2017.310 . .

Y Yoon , , , HG Jeon , , , D Yoo , , , 等 . . Learning a deep convolutional network for light-field image super-resolution . . Proc IEEE Int Conf on Computer Vision , , 2015 . . p.57 - - 65 . . DOI: 10.1109/ICCVW.2015.17 http://doi.org/10.1109/ICCVW.2015.17 . .

S You , , , N You , , , MX Pan . . PI-REC: progressive image reconstruction network with edge and color domain , , 2019 . . https://arxiv.org/abs/1903.10146 https://arxiv.org/abs/1903.10146 , , . .

F Yu , , , YD Zhang , , , SR Song , , , 等 . . LSUN: construction of a large-scale image dataset using deep learning with humans in the loop , , 2015 . . https://arxiv.org/abs/1506.03365 https://arxiv.org/abs/1506.03365 , , . .

JH Yu , , , Z Lin , , , JM Yang , , , 等 . . Free-form image inpainting with gated convolution , , 2018a . . https://arxiv.org/abs/1806.03589 https://arxiv.org/abs/1806.03589 , , . .

JH Yu , , , Z Lin , , , JM Yang , , , 等 . . Generative image inpainting with contextual attention . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2018b . . p.5505 - - 5514 . . DOI: 10.1109/CVPR.2018.00577 http://doi.org/10.1109/CVPR.2018.00577 . .

E Zakharov , , , A Shysheya , , , E Burkov , , , 等 . . Few-shot adversarial learning of realistic . . neural talking head models , , 2019 . . https://arxiv.org/abs/1905.08233 https://arxiv.org/abs/1905.08233 , , . .

MD Zeiler , , , GW Taylor , , , R Fergus . . Adaptive deconvolutional networks for mid and high level feature learning . . Proc IEEE Int Conf on Computer Vision , , 2011 . . p.2018 - - 2025 . . DOI: 10.1109/ICCV.2011.6126474 http://doi.org/10.1109/ICCV.2011.6126474 . .

H Zhang , , , T Xu , , , H Li , , , 等 . . StackGAN: text to photo-realistic image synthesis with stacked generative adversarial networks . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.5907 - - 5915 . . . .

H Zhang , , , T Xu , , , H Li , , , 等 . . StackGAN++: realistic image synthesis with stacked generative adversarial networks . . IEEE Trans Patt Anal Mach Intell , , 2019 . . 41 ( ( 8 ): ): 1947 - - 1962 . . DOI: 10.1109/TPAMI.2018.2856256 http://doi.org/10.1109/TPAMI.2018.2856256 . .

JJ Zhang , , , JH Yu , , , K Zhang , , , 等 . . Computational aesthetic evaluation of logos . . ACM Trans Appl Perc , , 2017 . . 14 ( ( 3 ): ): DOI: 10.1145/3058982 http://doi.org/10.1145/3058982 . .

R Zhang , , , P Isola , , , AA Efros . . Colorful image colorization . . Proc 14 th European Conf on Computer Vision , , 2016 . . p.649 - - 666 . . DOI: 10.1007/978-3-319-46487-9_40 http://doi.org/10.1007/978-3-319-46487-9_40 . .

H Zhao , , , O Gallo , , , I Frosio , , , 等 . . Loss functions for image restoration with neural networks . . IEEE Trans Comput Imag , , 2016 . . 3 ( ( 1 ): ): 47 - - 57 . . DOI: 10.1109/tci.2016.2644865 http://doi.org/10.1109/tci.2016.2644865 . .

JY Zhu , , , T Park , , , P Isola , , , 等 . . Unpaired image-to-image translation using cycle-consistent adversarial networks . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.2242 - - 2251 . . DOI: 10.1109/ICCV.2017.244 http://doi.org/10.1109/ICCV.2017.244 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰