Automatic synthesis of advertising images according to a specified style

Wei-tao YOU; Hao JIANG; Zhi-yuan YANG; Chang-yuan YANG; Ling-yun SUN

doi:10.1631/FITEE.1900367

Your Location：

Home >

Browse articles >

Automatic synthesis of advertising images according to a specified style

Regular Papers | Updated：2022-05-19

- Automatic synthesis of advertising images according to a specified style
- 针对特定风格的平面广告图像自动生成
- Frontiers of Information Technology & Electronic Engineering Vol. 21, Issue 10, Pages: 1455-1466(2020)
- Affiliations：
  
  Key Laboratory of Design Intelligence and Digital Creativity of Zhejiang Province, Hangzhou 310027, China
  International Design Institute, Zhejiang University, Hangzhou 310058, China
  International User Experience Business Unit, Alibaba Group, Hangzhou 311121, China
- Author bio：
  
  [ "Wei-tao YOU, E-mail: weitao_you@zju.edu.cn" ]
  Hao JIANG, E-mail: jiang_hao@zju.edu.cn
  [ "Zhi-yuan YANG, E-mail: youngs@zju.edu.cn" ]
  [ "Chang-yuan YANG, E-mail: changyuan.yangcy@alibaba-inc.com" ]
- Funds：
- DOI：10.1631/FITEE.1900367
  CLC： TP391
- Received：22 July 2019，
  
  Revised：2020-;6-19，
  
  Published Online：05 August 2020，
  
  Published：2020-10
- Accepted：
Scan QR Code
Wei-tao YOU, Hao JIANG, Zhi-yuan YANG, et al. Automatic synthesis of advertising images according to a specified style[J]. Frontiers of Information Technology & Electronic Engineering, 2020, 21(10): 1455-1466.
DOI：

Wei-tao YOU, Hao JIANG, Zhi-yuan YANG, et al. Automatic synthesis of advertising images according to a specified style[J]. Frontiers of Information Technology & Electronic Engineering, 2020, 21(10): 1455-1466. DOI： 10.1631/FITEE.1900367.

摘要

公司常用平面广告图像宣传产品，提高品牌知名度。设计平面广告图像不仅需要清晰地传达产品信息，还需考虑广告的目标产品、产品品牌和目标用户等内容，因此自动平面广告生成具有挑战性。本文提出数据驱动的方法捕获平面广告图像中设计特征与各个元素之间的特征关系，从而根据特定的风格，将输入的元素自动合成平面广告图像。为实现多样式的平面广告生成，构建了包含13280张平面广告图像的数据集，标签涵盖图像中产品类别、元素位置、颜色等内容。利用本文的概率模型，用户通过附加的约束（例如，基于上下文关键字）引导合成广告的风格。将本文方法用于大量设计任务，并针对生成结果进行用户感知和评价实验。结果表明，本文方法生成结果的用户满意度比非专业学生的设计结果提高了7.1%，生成的广告配色也比由色彩和谐模型与Colormind得到的结果获得更多用户好感。

Abstract

Images are widely used by companies to advertise their products and promote awareness of their brands. The automatic synthesis of advertising images is challenging because the advertising message must be clearly conveyed while complying with the style required for the product

brand

or target audience. In this study

we proposed a data-driven method to capture individual design attributes and the relationships between elements in advertising images with the aim of automatically synthesizing the input of elements into an advertising image according to a specified style. To achieve this multi-format advertisement design

we created a dataset containing 13 280 advertising images with rich annotations that encompassed the outlines and colors of the elements

in addition to the classes and goals of the advertisements. Using our probabilistic models

users guided the style of synthesized advertisements via additional constraints (e.g.

context-based keywords). We applied our method to a variety of design tasks

and the results were evaluated in several perceptual studies

which showed that our method improved users' satisfaction by 7.1 % compared to designs generated by nonprofessional students

and that more users preferred the coloring results of our designs to those generated by the color harmony model and Colormind.

关键词

Keywords

references

A Antonacopoulos , , , D Bridson , , , C Papadopoulos , , , 等 . . A realistic dataset for performance evaluation of document layout analysis . . 10 th Int Conf on Document Analysis and Recognition , , 2009 . . p.296 - - 300 . . DOI: 10.1109/ICDAR.2009.271 http://doi.org/10.1109/ICDAR.2009.271 . .

A Borji , , , MM Cheng , , , H Jiang , , , 等 . . Salient object detection: a benchmark . . IEEE Trans Image Process , , 2015 . . 24 ( ( 12 ): ): 5706 - - 5722 . . DOI: 10.1109/TIP.2015.2487833 http://doi.org/10.1109/TIP.2015.2487833 . .

A Buldas , , , A Kroonmaa , , , R Laanoja . . Keyless signatures' infrastructure: how to build global distributed hash-trees . . Nordic Conf on Secure IT Systems , , 2013 . . p.313 - - 320 . . DOI: 10.1007/978-3-642-41488-6_21 http://doi.org/10.1007/978-3-642-41488-6_21 . .

Y Cao , , , AB Chan , , , RW Lau . . Automatic stylistic manga layout . . ACM Trans Graph , , 2012 . . 31 ( ( 6 ): ): 141 - - 151 . . DOI: 10.1145/2366145.2366160 http://doi.org/10.1145/2366145.2366160 . .

G Charpiat , , , M Hofmann , , , B Schlkopf . . Automatic image colorization via multimodal predictions . . European Conf on Computer Vision , , 2008 . . p.126 - - 139 . . DOI: 10.1007/978-3-540-88690-7_10 http://doi.org/10.1007/978-3-540-88690-7_10 . .

J Choi , , , C Kim . . Object-aware image thumbnailing using image classification and enhanced detection of ROI . . Multim Tools Appl , , 2016 . . 75 ( ( 23 ): ): 16191 - - 16207 . . DOI: 10.1007/s11042-015-2926-5 http://doi.org/10.1007/s11042-015-2926-5 . .

J Geigel , , , A Loui . . Using genetic algorithms for album page layouts . . IEEE Multim , , 2003 . . 10 ( ( 4 ): ): 16 - - 27 . . DOI: 10.1109/MMUL.2003.1237547 http://doi.org/10.1109/MMUL.2003.1237547 . .

Z Gu , , , J Lou . . Data driven webpage color design . . Comput Aid Des , , 2016 . . 77 46 - - 59 . . DOI: 10.1016/j.cad.2016.03.001 http://doi.org/10.1016/j.cad.2016.03.001 . .

Z Hussain , , , M Zhang , , , X Zhang , , , 等 . . Automatic understanding of image and video advertisements . . IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.1705 - - 1715 . . DOI: 10.1109/CVPR.2017.123 http://doi.org/10.1109/CVPR.2017.123 . .

A Jahanian , , , J Liu , , , DR Tretter , , , 等 . . Automatic design of magazine covers . . IS&T/SPIE Electronic Imaging, Article 83020N , , 2012 . . DOI: 10.1117/12.914596 http://doi.org/10.1117/12.914596 . .

B Jiang , , , L Zhang , , , H Lu , , , 等 . . Saliency detection via absorbing Markov chain . . IEEE Int Conf on Computer Vision , , 2013 . . p.1665 - - 1672 . . DOI: 10.1109/TIP.2017.2766787 http://doi.org/10.1109/TIP.2017.2766787 . .

LI Labrecque , , , GR Milne . . Exciting red and competent blue: the importance of color in marketing . . J Acad Mark Sci , , 2012 . . 40 ( ( 5 ): ): 711 - - 727 . . DOI: 10.1007/s11747-010-0245-y http://doi.org/10.1007/s11747-010-0245-y . .

J Li , , , T Xu , , , J Zhang , , , 等 . . https://arxiv.org/abs/1901.06767 https://arxiv.org/abs/1901.06767 , , LayoutGAN: generating graphic layouts with wireframe discriminator , , 2019 . . .

X Li , , , H Zhao , , , G Nie , , , 等 . . Image recoloring using geodesic distance based color harmonization . . Comput Vis Media , , 2015 . . 1 ( ( 2 ): ): 143 - - 155 . . DOI: 10.1007/s41095-015-0013-5 http://doi.org/10.1007/s41095-015-0013-5 . .

Y Li , , , H Qi , , , J Dai , , , 等 . . Fully convolutional instance-aware semantic segmentation . . IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.2359 - - 2367 . . DOI: 10.1109/CVPR.2017.472 http://doi.org/10.1109/CVPR.2017.472 . .

S Lin , , , P Hanrahan . . Modeling how people extract color themes from images . . SIGCHI Conf on Human Factors in Computing Systems , , 2013 . . p.3101 - - 3110 . . DOI: 10.1145/2470654.2466424 http://doi.org/10.1145/2470654.2466424 . .

S Lin , , , D Ritchie , , , M Fisher , , , 等 . . Probabilistic color-by-numbers: suggesting pattern colorizations using factor graphs . . ACM Trans Graph , , 2013 . . 32 ( ( 4 ): ): 37 DOI: 10.1145/2461912.2461988 http://doi.org/10.1145/2461912.2461988 . .

KL Liu , , , W Li , , , CY Yang , , , 等 . . Intelligent design of multimedia content in Alibaba . . Front Inform Technol Electron Eng , , 2019 . . 20 ( ( 12 ): ): 1657 - - 1664 . . DOI: 10.1631/FITEE.1900580 http://doi.org/10.1631/FITEE.1900580 . .

P O'Donovan , , , A Agarwala , , , A Hertzmann . . Color compatibility from large datasets . . ACM Trans Graph , , 2011 . . 30 ( ( 4 ): ): 63 - - 75 . . DOI: 10.1145/2010324.1964958 http://doi.org/10.1145/2010324.1964958 . .

P O'Donovan , , , A Agarwala , , , A Hertzmann . . Learning layouts for single-pagegraphic designs . . IEEE Trans Vis Comput Graph , , 2014 . . 20 ( ( 8 ): ): 1200 - - 1213 . . DOI: 10.1109/TVCG.2014.48 http://doi.org/10.1109/TVCG.2014.48 . .

P O'Donovan , , , A Agarwala , , , A Hertzmann . . DesignScape: design with interactive layout suggestions . . 33 rd Annual ACM Conf on Human Factors in Computing Systems , , 2015 . . p.1221 - - 1224 . . DOI: 10.1145/2702123.2702149 http://doi.org/10.1145/2702123.2702149 . .

YT Qiang , , , YW Fu , , , X Yu , , , 等 . . Learning to generate posters of scientific papers by probabilistic graphical models . . J Comput Sci Techn , , 2019 . . 34 ( ( 1 ): ): 155 - - 169 . . DOI: 10.1007/s11390-019-1904-1 http://doi.org/10.1007/s11390-019-1904-1 . .

BC Russell , , , A Torralba , , , KP Murphy , , , 等 . . Labelme: a database and web-based tool for image annotation . . Int J Comput Vis , , 2008 . . 77 ( ( 1-3 ): ): 157 - - 173 . . DOI: 10.1007/s11263-007-0090-8 http://doi.org/10.1007/s11263-007-0090-8 . .

DW Scott , , , SR Sain . . 9 - multidimensional density estimation . . Handbook Stat , , 2005 . . 24 229 - - 261 . . DOI: 10.1016/S0169-7161(04)24009-3 http://doi.org/10.1016/S0169-7161(04)24009-3 . .

S Seo , , , Y Park , , , V Ostromoukhov . . Image recoloring using linear template mapping . . Multim Tools Appl , , 2013 . . 64 ( ( 2 ): ): 293 - - 308 . . DOI: 10.1007/s11042-012-1024-1 http://doi.org/10.1007/s11042-012-1024-1 . .

YC Tang , , , JJ Huang , , , MT Yao , , , 等 . . A review of design intelligence: progress, problems, and challenges . . Front Inform Technol Electron Eng , , 2019 . . 20 ( ( 12 ): ): 1595 - - 1617 . . DOI: 10.1631/FITEE.1900398 http://doi.org/10.1631/FITEE.1900398 . .

M Tokumaru , , , N Muranaka , , , S Imanishi . . Color design support system considering color harmony . . IEEE World Congress on Computational Intelligence , , 2002 . . p.378 - - 383 . . DOI: 10.1109/FUZZ.2002.1005020 http://doi.org/10.1109/FUZZ.2002.1005020 . .

AN Tuch , , , JA Bargas-Avila , , , K Opwis . . Symmetry and aesthetics in website design: it's a man's business . . Comput Human Behav , , 2010 . . 26 ( ( 6 ): ): 1831 - - 1837 . . DOI: 10.1016/j.chb.2010.07.016 http://doi.org/10.1016/j.chb.2010.07.016 . .

TC Wang , , , MY Liu , , , JY Zhu , , , 等 . . High-resolution image synthesis and semantic manipulation with conditional GANs . . IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.8798 - - 8807 . . DOI: 10.1109/CVPR.2018.00917 http://doi.org/10.1109/CVPR.2018.00917 . .

T Xu , , , P Zhang , , , Q Huang , , , 等 . . AttnGAN: fine-grained text to image generation with attentional generative adversarial networks . . IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.1316 - - 1324 . . DOI: 10.1109/CVPR.2018.00143 http://doi.org/10.1109/CVPR.2018.00143 . .

X Yang , , , T Mei , , , YQ Xu , , , 等 . . Automatic generation of visual-textual presentation layout . . ACM Trans Multim Comput Commun Appl , , 2016 . . 12 ( ( 2 ): ): 33 - - 55 . . DOI: 10.1145/2818709 http://doi.org/10.1145/2818709 . .

WT You , , , LY Sun , , , ZY Yang , , , 等 . . Automatic advertising image color design incorporating a visual color analyzer . . J Comput Lang , , 2019 . . 55 100910 DOI: 10.1016/j.cola.2019.100910 http://doi.org/10.1016/j.cola.2019.100910 . .

LF Yu , , , SK Yeung , , , CK Tang , , , 等 . . Make it home: automatic optimization of furniture arrangement . . ACM Trans Graph , , 2011 . . 30 ( ( 4 ): ): 86:1 - - 86:12 . . DOI: 10.1145/2010324.1964981 http://doi.org/10.1145/2010324.1964981 . .

Y Zhang , , , K Hu , , , P Ren , , , 等 . . Layout style modeling for automating banner design . . Thematic Workshops of ACM Multimedia , , 2017 . . p.451 - - 459 . . DOI: 10.1145/3126686.3126718 http://doi.org/10.1145/3126686.3126718 . .

X Zheng , , , X Qiao , , , Y Cao , , , 等 . . Content-aware generative modeling of graphic design layouts . . ACM Trans Graph , , 2019 . . 38 ( ( 4 ): ): 133 DOI: 10.1145/3306346.3322971 http://doi.org/10.1145/3306346.3322971 . .

JY Zhu , , , T Park , , , P Isola , , , 等 . . Unpaired image-to-image translation using cycle-consistent adversarial networks . . IEEE Int Conf on Computer Vision , , 2017 . . p.2223 - - 2232 . . DOI: 10.1109/ICCV.2017.244 http://doi.org/10.1109/ICCV.2017.244 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰