Intelligent design of multimedia content in Alibaba

Kui-long LIU; Wei LI; Chang-yuan YANG; Guang YANG

doi:10.1631/FITEE.1900580

Your Location：

Home >

Browse articles >

Intelligent design of multimedia content in Alibaba

Special Feature on Intelligent Design | Updated：2022-05-19

- Intelligent design of multimedia content in Alibaba
- 智能多媒体内容设计在阿里巴巴的应用
- Frontiers of Information Technology & Electronic Engineering Vol. 20, Issue 12, Pages: 1657-1664(2019)
- Affiliations：
  
  Alibaba Group, Hangzhou 311121, China
- Author bio：
  
  [ "Kui-long LIU, E-mail: kuilong.lkl@alibaba-inc.com" ]
  [ "Wei LI, pangeng.lw@alibaba-inc.com" ]
  [ "Chang-yuan YANG, changyuan.yangcy@alibaba-inc.com" ]
  [ "Guang YANG, qingyun@taobao.com" ]
- Funds：
- DOI：10.1631/FITEE.1900580
  CLC： TP391
- Received：23 October 2019，
  
  Revised：2019-12-15，
  
  Published：2019-12
- Accepted：
Scan QR Code
Kui-long LIU, Wei LI, Chang-yuan YANG, et al. Intelligent design of multimedia content in Alibaba[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(12): 1657-1664.
DOI：

Kui-long LIU, Wei LI, Chang-yuan YANG, et al. Intelligent design of multimedia content in Alibaba[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(12): 1657-1664. DOI： 10.1631/FITEE.1900580.

摘要

Abstract

Multimedia content is an integral part of Alibaba's business ecosystem and is in great demand. The production of multimedia content usually requires high technology and much money. With the rapid development of artificial intelligence (AI) technology in recent years

to meet the design requirements of multimedia content

many AI auxiliary tools for the production of multimedia content have emerged and become more and more widely used in Alibaba's business ecology. Related applications include mainly auxiliary design

graphic design

video generation

and page production. In this report

a general pipeline of the AI auxiliary tools is introduced. Four representative tools applied in the Alibaba Group are presented for the applications mentioned above. The value brought by multimedia content design combined with AI technology has been well verified in business through these tools. This reflects the great role played by AI technology in promoting the production of multimedia content. The application prospects of the combination of multimedia content design and AI are also indicated.

关键词

Keywords

references

S Azadi , , , M Fisher , , , VG Kim , , , 等 . . Multi-content GAN for few-shot font style transfer . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.7564 - - 7573 . . . .

G Bradski , , , A Kaehler . . Learning OpenCV: Computer Vision with the OpenCV Library . . O'Reilly Media, Inc , , 2008 . . .

M Bretan , , , G Weinberg , , , L Heck . . A unit selection methodology for music generation using deep neural networks , , 2016 . . https://arxiv.org/abs/1612.03789 https://arxiv.org/abs/1612.03789 , , . .

Z Cao , , , T Simon , , , SE Wei , , , 等 . . Realtime multi-person 2D pose estimation using part affinity fields . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.7291 - - 7299 . . DOI: 10.1109/CVPR.2017.143 http://doi.org/10.1109/CVPR.2017.143 . .

LC Chen , , , YK Zhu , , , G Papandreou , , , 等 . . Encoderdecoder with atrous separable . . convolution for semantic image segmentation , , 2018 . . https://arxiv.org/abs/1802.02611 https://arxiv.org/abs/1802.02611 , , . .

F Chollet . . Xception: deep learning with depthwise separable convolutions . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.1251 - - 1258 . . DOI: 10.1109/CVPR.2017.195 http://doi.org/10.1109/CVPR.2017.195 . .

IJ Goodfellow , , , J Pouget-Abadie , , , M Mirza , , , 等 . . Generative adversarial nets . . Proc 27 th Int Conf on Neural Information Processing Systems , , 2014 . . p.2672 - - 2680 . . . .

KM He , , , XY Zhang , , , SQ Ren , , , 等 . . Deep residual learning for image recognition . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016 . . p.770 - - 778 . . DOI: 10.1109/CVPR.2016.90 http://doi.org/10.1109/CVPR.2016.90 . .

KM He , , , G Gkioxari , , , P DollȤr , , , 等 . . Mask R-CNN . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.2961 - - 2969 . . DOI: 10.1109/ICCV.2017.322 http://doi.org/10.1109/ICCV.2017.322 . .

S Hochreiter , , , J Schmidhuber . . Long short-term memory . . Neur Comput , , 1997 . . 9 ( ( 8 ): ): 1735 - - 1780 . . DOI: 10.1162/neco.1997.9.8.1735 http://doi.org/10.1162/neco.1997.9.8.1735 . .

X Huang , , , YX Peng . . TPCKT: two-level progressive cross-media knowledge transfer . . IEEE Trans Multim , , 2019 . . 21 ( ( 11 ): ): 2850 - - 2862 . . DOI: 10.1109/TMM.2019.2911456 http://doi.org/10.1109/TMM.2019.2911456 . .

KS Kim , , , DN Zhang , , , MC Kang , , , 等 . . Improved simple linear iterative clustering superpixels . . IEEE Int Symp on Consumer Electronics , , 2013 . . p.259 - - 260 . . DOI: 10.1109/ISCE.2013.6570216 http://doi.org/10.1109/ISCE.2013.6570216 . .

A Levin , , , D Lischinski , , , Y Weiss . . A closed-form solution to natural image matting . . IEEE Trans Patt Anal Mach Intell , , 2007 . . 30 ( ( 2 ): ): 228 - - 242 . . DOI: 10.1109/TPAMI.2007.1177 http://doi.org/10.1109/TPAMI.2007.1177 . .

TY Lin , , , P DollȤr , , , R Girshick , , , 等 . . Feature pyramid networks for object detection . . Proc Conf on Computer Vision and Pattern Recognition , , 2017 . . p.2117 - - 2125 . . DOI: 10.1109/CVPR.2017.106 http://doi.org/10.1109/CVPR.2017.106 . .

J Ngiam , , , A Khosla , , , M Kim , , , 等 . . Multimodal deep learning . . Proc 28 th Int Conf on Machine Learning , , 2011 . . p.689 - - 696 . . . .

G Papandreou , , , T Zhu , , , LC Chen , , , 等 . . PersonLab: person pose estimation and instance segmentation with a bottom-up, part-based . . geometric embedding model , , 2018 . . .

YX Peng , , , WW Zhu , , , Y Zhao , , , 等 . . Cross-media analysis and reasoning: advances and directions . . Front Inform Technol Electron Eng , , 2017 . . 18 ( ( 1 ): ): 44 - - 57 . . DOI: 10.1631/FITEE.1601787 http://doi.org/10.1631/FITEE.1601787 . .

YX Peng , , , X Huang , , , YZ Zhao . . An overview of crossmedia retrieval: concepts, methodologies, benchmarks, and challenges . . IEEE Trans Circ Syst Video Technol , , 2018 . . 28 ( ( 9 ): ): 2372 - - 2385 . . DOI: 10.1109/TCSVT.2017.2705068 http://doi.org/10.1109/TCSVT.2017.2705068 . .

YX Peng , , , JW Qi , , , X Huang . . Current research status and prospects on multimedia content understanding . . J Comput Res Devel , , 2019 . . 56 ( ( 1 ): ): 187 - - 212 . . DOI: 10.7544/issn1000-1239.2019.20180770 http://doi.org/10.7544/issn1000-1239.2019.20180770 . .

SQ Ren , , , KM He , , , R Girshick , , , 等 . . Faster R-CNN: towards real-time object detection with region proposal networks . . IEEE Trans Patt Anal Mach Intell , , 2017 . . 39 ( ( 6 ): ): 1137 - - 1149 . . DOI: 10.1109/TPAMI.2016.2577031 http://doi.org/10.1109/TPAMI.2016.2577031 . .

E Ristani , , , C Tomasi . . Features for multi-target multicamera tracking and re-identification . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2018 . . p.6036 - - 6046 . . DOI: 10.1109/CVPR.2018.00632 http://doi.org/10.1109/CVPR.2018.00632 . .

C Rother , , , V Kolmogorov , , , A Blake . . pGrabCutq: interactive foreground extraction using iterated graph cuts . . ACM Trans Graph , , 2004 . . 23 ( ( 3 ): ): 309 - - 314 . . DOI: 10.1145/1015706.1015720 http://doi.org/10.1145/1015706.1015720 . .

K Simonyan , , , A Zisserman . . Very deep convolutional networks for large-scale image recognition , , 2015 . . https://arxiv.org/abs/1409.1556 https://arxiv.org/abs/1409.1556 , , . .

SJ Song , , , W Zhang , , , JY Liu , , , 等 . . Unsupervised person image generation with semantic parsing transformation , , 2019 . . https://arxiv.org/abs/1904.03379 https://arxiv.org/abs/1904.03379 , , . .

A Vaswani , , , N Shazeer , , , N Parmar , , , 等 . . Attention is all you need . . Advances in Neural Information Processing Systems , , 2017 . . p.5998 - - 6008 . . . .

FT Xia , , , P Wang , , , XJ Chen , , , 等 . . Joint multi-person pose estimation and semantic part segmentation . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.6769 - - 6778 . . DOI: 10.1109/CVPR.2017.644 http://doi.org/10.1109/CVPR.2017.644 . .

SF Zhang , , , XY Zhu , , , Z Lei , , , 等 . . S3FD: single shot scale-invariant face detector . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.192 - - 201 . . DOI: 10.1109/ICCV.2017.30 http://doi.org/10.1109/ICCV.2017.30 . .

BL Zhou , , , A Khosla , , , A Lapedriza , , , 等 . . Learning deep features for discriminative localization . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016 . . p.2921 - - 2929 . . DOI: 10.1109/CVPR.2016.319 http://doi.org/10.1109/CVPR.2016.319 . .

JY Zhu , , , T Park , , , P Isola , , , 等 . . Unpaired imageto-image translation using cycle-consistent adversarial networks . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p.2223 - - 2232 . . DOI: 10.1109/ICCV.2017.244 http://doi.org/10.1109/ICCV.2017.244 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Integrated communication and localization in millimeter-wave systems

Artificial intelligence and statistics

Related Author

Jing XU

Xiao LI

Shi JIN

Bo GAO

Jie YANG

Bin YU

Karl KUMBIER

Zuozhu Liu

Related Institution

ZTE Corporation

State Key Laboratory of Mobile Network and Mobile Multimedia Technology

National Mobile Communications Research Laboratory, Southeast University

Department of Statistics, University of California, Berkeley

Department of Electrical Engineering and Computer Sciences, University of California, Berkeley

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰