Crowdsourcing intelligent design

Wei XIANG; Ling-yun SUN; Wei-tao YOU; Chang-yuan YANG

doi:10.1631/FITEE.1700810

Your Location：

Home >

Browse articles >

Crowdsourcing intelligent design

2018 Special Issue on Artificial Intelligence 2.0: Theories and Applications | Updated：2022-05-19

- Crowdsourcing intelligent design
- 众包智能设计方法
- Frontiers of Information Technology & Electronic Engineering Vol. 19, Issue 1, Pages: 126-138(2018)
- Affiliations：
  
  State Key Lab of CAD & CG, Zhejiang University, Hangzhou 310058, China
  Modern Industrial Design Institute, Zhejiang University, Hangzhou 310027, China
  International User Experience Business Unit, Alibaba Group, Hangzhou 310000, China
- Author bio：
  
  [ "Wei XIANG, E-mail: wxiang@zju.edu.cn" ]
  Ling-yun SUN, E-mail: sunly@zju.edu.cn
  [ "Wei-tao YOU, E-mail: weitao_you@zju.edu.cn" ]
  [ "Chang-yuan YANG, E-mail: changyuan.yangcy@alibaba-inc.com" ]
- Funds：
- DOI：10.1631/FITEE.1700810
  CLC： TP391
- Received：04 December 2017，
  
  Revised：2018-;1-25，
  
  Published：2018-01
- Accepted：
Scan QR Code
Wei XIANG, Ling-yun SUN, Wei-tao YOU, et al. Crowdsourcing intelligent design[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(1): 126-138.
DOI：

Wei XIANG, Ling-yun SUN, Wei-tao YOU, et al. Crowdsourcing intelligent design[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(1): 126-138. DOI： 10.1631/FITEE.1700810.

摘要

通过利用人工智能方法解决创造性问题、产出创意方案，设计智能在新一代人工智能背景下高速发展。现有人工智能方法善于从数据中学习，难以产出不同于训练数据的创意方案。众包结合人的创意灵感与计算机的计算能力进行创意设计，有望提升设计智能的创新能力。已有众包设计多采用筛选方法，依赖参与者自身提出高质量方案，对众包控制力弱，产出方案质量不稳定。针对这些问题，本文提出一种柔性众包设计的众包智能设计方法。该方法整合参与者创意和培育创意以得到高质量方案。通过一系列研究呈现了如何利用柔性众包设计方法持续产出原创创意。特别地，描述了柔性众包设计方法的流程、众包任务、创意发展的影响因素、计算创意发展潜力的方法，以及两个柔性众包设计方法的应用案例，并据此总结该方法的设计能力。柔性众包设计方法可提升众包设计表现，支持设计智能发展。

Abstract

Design intelligence

namely

artificial intelligence to solve creative problems and produce creative ideas

has improved rapidly with the new generation artificial intelligence. However

existing methods are more skillful in learning from data and have limitations in creating original ideas different from the training data. Crowdsourcing offers a promising method to produce creative designs by combining human inspiration and machines' computational ability. We propose a crowdsourcing intelligent design method called 'flexible crowdsourcing design'. Design ideas produced through crowdsourcing design can be unreliable and inconsistent because they rely solely on selection among participants' submissions of ideas. In contrast

the flexible crowdsourcing design method employs a cultivation procedure that integrates the ideas from crowd participants and cultivates these ideas to improve design quality at the same time. We introduce a series of studies to show how flexible crowdsourcing design can produce original design ideas consistently. Specifically

we will describe the typical procedure of flexible crowdsourcing design

the refined crowdsourcing tasks

the factors that affect the idea development process

the method for calculating idea development potential

and two applications of the flexible crowdsourcing design method. Finally

it summarizes the design capabilities enabled by crowdsourcing intelligent design. This method enhances the performance of crowdsourcing design and supports the development of design intelligence.

关键词

Keywords

references

LJ Ball , , , TC Ormerod . . Structured and opportunistic processing in design: a critical discussion . . Int J Hum-Comput Stud , , 1995 . . 43 ( ( 1 ): ): 131 - - 151 . . DOI: 10.1006/ijhc.1995.1038 http://doi.org/10.1006/ijhc.1995.1038 . .

J Chan , , , S Dang , , , SP Dow . . Improving crowd innovation with expert facilitation . . Proc 19 th ACM Conf on Computer-Supported Cooperative Work & Social Computing , , 2016 . . p.1223 - - 1235 . . DOI: 10.1145/2818048.2820023 http://doi.org/10.1145/2818048.2820023 . .

DN Chang , , , CH Chen , , , KM Lee . . A crowdsourcing development approach based on a neuro-fuzzy network for creating innovative product concepts . . Neuro-computing , , 2014 . . 142 60 - - 72 . . DOI: 10.1016/j.neucom.2014.03.044 http://doi.org/10.1016/j.neucom.2014.03.044 . .

N Cross . . Designerly Ways of Knowing , , : : London Springer , , 2006 . . DOI: 10.1007/1-84628-301-9 http://doi.org/10.1007/1-84628-301-9 . .

M Dontcheva , , , RR Morris , , , JR Brandt , , , 等 . . Combining crowdsourcing and learning to improve engagement and performance . . Proc SIGCHI Conf on Human Factors in Computing Systems , , 2014 . . p.3379 - - 3388 . . DOI: 10.1145/2556288.2557217 http://doi.org/10.1145/2556288.2557217 . .

RL Flores , , , JP Belaud , , , JM le Lann , , , 等 . . Using the collective intelligence for inventive problem solving: a contribution for open computer aided innovation . . Expert Syst Appl , , 2015 . . 42 ( ( 23 ): ): 9340 - - 9352 . . DOI: 10.1016/j.eswa.2015.08.024 http://doi.org/10.1016/j.eswa.2015.08.024 . .

LA Gatys , , , AS Ecker , , , M Bethge . . Image style transfer using convolutional neural networks . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016 . . p.2414 - - 2423 . . DOI: 10.1109/CVPR.2016.265 http://doi.org/10.1109/CVPR.2016.265 . .

ME Glickman . . Parameter estimation in large dynamic paired comparison experiments . . J Roy Stat Soc Ser C , , 1999 . . 48 ( ( 3 ): ): 377 - - 394 . . DOI: 10.1111/1467-9876.00159 http://doi.org/10.1111/1467-9876.00159 . .

G Goldschmidt . . Ubiquitous serendipity: potential visual design stimuli are everywhere . . In: Gero JS (Ed.), Studying Visual and Spatial Reasoning for Design Creativity. Springer Dordrecht Netherlands , , 2015 . . p.205 - - 214 . . DOI: 10.1007/978-94-017-9297-4_12 http://doi.org/10.1007/978-94-017-9297-4_12 . .

K Ikeda , , , A Morishima , , , H Rahman , , , 等 . . Collaborative crowdsourcing with crowd4U . . Proc VLDB Endowm , , 2016 . . 9 ( ( 13 ): ): 1497 - - 1500 . . DOI: 10.14778/3007263.3007293 http://doi.org/10.14778/3007263.3007293 . .

J Kim , , , M Dontcheva , , , W Li , , , 等 . . Motif: supporting novice creativity through expert patterns . . Proc 33 rd Annual ACM Conf on Human Factors in Computing Systems , , 2015 . . p.1211 - - 1220 . . DOI: 10.1145/2702123.2702507 http://doi.org/10.1145/2702123.2702507 . .

B Lafreniere , , , T Grossman , , , F Anderson , , , 等 . . Crowdsourced fabrication . . Proc 29 th Annual Symp on User Interface Software and Technology , , 2016 . . p.15 - - 28 . . DOI: 10.1145/2984511.2984553 http://doi.org/10.1145/2984511.2984553 . .

W Li , , , WJ Wu , , , HM Wang , , , 等 . . Crowd intelligence in AI 2.0 era . . Front Inform Technol Electron Eng , , 2017 . . 18 ( ( 1 ): ): 15 - - 43 . . DOI: 10.1631/FITEE.1601859 http://doi.org/10.1631/FITEE.1601859 . .

P Michelucci , , , JL Dickinson . . The power of crowds . . Science , , 2016 . . 351 ( ( 6268 ): ): 32 - - 33 . . DOI: 10.1126/science.aad6499 http://doi.org/10.1126/science.aad6499 . .

P O'Donovan , , , A Agarwala , , , A Hertzmann . . Learning layouts for single-pagegraphic designs . . IEEE Trans Vis Comput Graph , , 2014 . . 20 ( ( 8 ): ): 1200 - - 1213 . . DOI: 10.1109/TVCG.2014.48 http://doi.org/10.1109/TVCG.2014.48 . .

YH Pan . . Special issue on artificial intelligence 2.0 . . Front Inform Technol Electron Eng , , 2017 . . 18 ( ( 1 ): ): 1 - - 2 . . DOI: 10.1631/FITEE.1710000 http://doi.org/10.1631/FITEE.1710000 . .

CH Park , , , KH Son , , , JH Lee , , , 等 . . Crowd vs. crowd: large-scale cooperative design through open team competition . . Proc Conf on Computer Supported Cooperative Work , , 2013 . . p.1275 - - 1284 . . DOI: 10.1145/2441776.2441920 http://doi.org/10.1145/2441776.2441920 . .

P Pauwels , , , R de Meyer , , , J van Campenhout . . Design thinking support: information systems versus reasoning . . Des Iss , , 2013 . . 29 ( ( 2 ): ): 42 - - 59 . . DOI: 10.1162/DESI_a_00209 http://doi.org/10.1162/DESI_a_00209 . .

F Pinel , , , LR Varshney , , , D Bhattacharjya . . A culinary computational creativity system . . In: Besold TR, Schorlemmer M, Smaill A (Eds.), Computational Creativity Research: Towards Creative Machines. Springer, Paris , , 2015 . . p.327 - - 346 . . DOI: 10.2991/978-94-6239-085-0_16 http://doi.org/10.2991/978-94-6239-085-0_16 . .

M Prats , , , CF Earl . . Exploration through drawings in the conceptual stage of product design . . In: Gero JS (Ed.), Design Computing and Cognition. Springer Dordrecht Netherlands , , 2006 . . p.83 - - 102 . . DOI: 10.1007/978-1-4020-5131-9_5 http://doi.org/10.1007/978-1-4020-5131-9_5 . .

J Ren , , , JV Nickerson , , , W Mason , , , 等 . . Increasing the crowd's capacity to create: how alternative generation affects the diversity, relevance and effectiveness of generated ads . . Dec Supp Syst , , 2014 . . 65 28 - - 39 . . DOI: 10.1016/j.dss.2014.05.009 http://doi.org/10.1016/j.dss.2014.05.009 . .

OS Schneider , , , H Seifi , , , S Kashani , , , 等 . . HapTurk: crowdsourcing affective ratings of vibrotactile icons . . Proc CHI Conf on Human Factors in Computing Systems , , 2016 . . p.3248 - - 3260 . . DOI: 10.1145/2858036.2858279 http://doi.org/10.1145/2858036.2858279 . .

LY Sun , , , W Xiang , , , CL Chai , , , 等 . . Creative segment: a descriptive theory applied to computer-aided sketching . . Des Stud , , 2014a . . 35 ( ( 1 ): ): 54 - - 79 . . DOI: 10.1016/j.destud.2013.10.003 http://doi.org/10.1016/j.destud.2013.10.003 . .

LY Sun , , , W Xiang , , , CL Chai , , , 等 . . Designers' perception during sketching: an examination of creative segment theory using eye movements . . Des Stud , , 2014b . . 35 ( ( 6 ): ): 593 - - 613 . . DOI: 10.1016/j.destud.2014.04.004 http://doi.org/10.1016/j.destud.2014.04.004 . .

LY Sun , , , W Xiang , , , S Chen , , , 等 . . Collaborative sketching in crowdsourcing design: a new method for idea generation . . Int J Technol Des Educat , , 2015 . . 25 ( ( 3 ): ): 409 - - 427 . . DOI: 10.1007/s10798-014-9283-y http://doi.org/10.1007/s10798-014-9283-y . .

R Suzuki , , , N Salehi , , , MS Lam , , , 等 . . Atelier: repurposing expert crowdsourcing tasks as micro-internships . . Proc CHI Conf on Human Factors in Computing Systems , , 2016 . . p.2645 - - 2656 . . DOI: 10.1145/2858036.2858121 http://doi.org/10.1145/2858036.2858121 . .

L van der Maaten , , , K Weinberger . . Stochastic triplet embedding . . IEEE Int Workshop on Machine Learning for Signal Processing , , 2012 . . p.1 - - 6 . . DOI: 10.1109/MLSP.2012.6349720 http://doi.org/10.1109/MLSP.2012.6349720 . .

C Wah , , , G van Horn , , , S Branson , , , 等 . . Similarity comparisons for interactive fine-grained categorization . . IEEE Conf on Computer Vision and Pattern Recognition , , 2014 . . p.859 - - 866 . . DOI: 10.1109/CVPR.2014.115 http://doi.org/10.1109/CVPR.2014.115 . .

SC Warby , , , SL Wendt , , , P Welinder , , , 等 . . Sleep-spindle detection: crowdsourcing and evaluating performance of experts, non-experts and automated methods . . Nat Methods , , 2014 . . 11 ( ( 4 ): ): 385 - - 392 . . DOI: 10.1038/nmeth.2855 http://doi.org/10.1038/nmeth.2855 . .

S Wiltschnig , , , BT Christensen , , , LJ Ball . . Collaborative problem-solution co-evolution in creative design . . Des Stud , , 2013 . . 34 ( ( 5 ): ): 515 - - 542 . . DOI: 10.1016/j.destud.2013.01.002 http://doi.org/10.1016/j.destud.2013.01.002 . .

W Xiang , , , LY Sun , , , SC Xia , , , 等 . . An evolutionary computation method of crowdsourcing ideation that integrates the balanced-exploration pattern . . J Mech Eng , , 2017 . . 53 ( ( 15 ): ): 73 - - 80 . . DOI: 10.3901/JME.2017.15.073 http://doi.org/10.3901/JME.2017.15.073 . .

AB Xu , , , HM Rao , , , SP Dow , , , 等 . . A classroom study of using crowd feedback in the iterative design process . . Proc 18 th ACM Conf on Computer Supported Cooperative Work & Social Computing , , 2015 . . p.1637 - - 1648 . . DOI: 10.1145/2675133.2675140 http://doi.org/10.1145/2675133.2675140 . .

LX Yu , , , JV Nickerson . . Cooks or cobblers?: crowd creativity through combination . . Proc SIGCHI Conf on Human Factors in Computing Systems , , 2011 . . p.1393 - - 1402 . . DOI: 10.1145/1978942.1979147 http://doi.org/10.1145/1978942.1979147 . .

LX Yu , , , A Kittur , , , RE Kraut . . Distributed analogical idea generation: inventing with crowds . . Proc SIGCHI Conf on Human Factors in Computing Systems , , 2014 . . p.1245 - - 1254 . . DOI: 10.1145/2556288.2557371 http://doi.org/10.1145/2556288.2557371 . .

LX Yu , , , RE Kraut , , , A Kittur . . Distributed analogical idea generation with multiple constraints . . Proc 19 th ACM Conf on Computer-Supported Cooperative Work & Social Computing , , 2016 . . p.1236 - - 1245 . . DOI: 10.1145/2818048.2835201 http://doi.org/10.1145/2818048.2835201 . .

Q Zhao , , , ZH Huang , , , FM Harper , , , 等 . . Precision crowdsourcing: closing the loop to turn information consumers into information contributors . . Proc 19 th ACM Conf on Computer-Supported Cooperative Work & Social Computing , , 2016 . . p.1615 - - 1625 . . DOI: 10.1145/2818048.2819957 http://doi.org/10.1145/2818048.2819957 . .

JY Zhu , , , P Kr henbühl , , , E Shechtman , , , 等 . . Generative visual manipulation on the natural image manifold . . Proc 14 th European Conf on Computer Vision , , 2016 . . p.597 - - 613 . . DOI: 10.1007/978-3-319-46454-1_36 http://doi.org/10.1007/978-3-319-46454-1_36 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Crowd intelligence in AI 2.0 era

Related Author

LI Wei

Wen-jun WU

Huai-min WANG

Xue-qi CHENG

Hua-jun CHEN

Zhi-hua ZHOU

Rong DING

Related Institution

State Key Laboratory of Software Development, Beihang University

National Laboratory for Parallel and Distributed Processing, College of Computer, National University of Defense Technology

Institute of Computing Technology, Chinese Academy of Sciences

College of Computer Science and Technology, Zhejiang University

National Key Laboratory for Novel Software Technology, Nanjing University

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰