视觉知识：智能创意初探

庄越挺; 汤斯亮

doi:10.1631/FITEE.2100116

Your Location：

Home >

Browse articles >

视觉知识：智能创意初探

视觉知识专栏 | Updated：2022-05-19

- 视觉知识：智能创意初探
  Enhanced Publication
- Visual knowledge: an attempt to explore machine creativity
- 信息与电子工程前沿（英文） 2021年22卷第5期页码：619-624
- Affiliations：
  
  College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  Yueting ZHUANG, E-mail: yzhuang@zju.edu.cn
  [ "Siliang TANG, E-mail: siliang@zju.edu.cn" ]
- Funds：
- DOI：10.1631/FITEE.2100116
  中图分类号：
- 收稿：2021-03-03，
  
  修回：2021-;4-29，
  
  纸质出版：2021-05
- Accepted：
Scan QR Code
庄越挺, 汤斯亮. 视觉知识：智能创意初探[J]. 信息与电子工程前沿（英文）, 2021,22(5):619-624.

Yueting ZHUANG, Siliang TANG. Visual knowledge: an attempt to explore machine creativity[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(5): 619-624.
庄越挺, 汤斯亮. 视觉知识：智能创意初探[J]. 信息与电子工程前沿（英文）, 2021,22(5):619-624. DOI： 10.1631/FITEE.2100116.

Yueting ZHUANG, Siliang TANG. Visual knowledge: an attempt to explore machine creativity[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(5): 619-624. DOI： 10.1631/FITEE.2100116.

摘要

Abstract

关键词

Keywords

references

R Arnheim . . Visual Thinking , , : : San Francisco, USA University of California Press , , 1997 . . .

D Bau , , , JY Zhu , , , J Wulff , , , 等 . . Seeing what a GAN cannot generate . . Proc IEEE/CVF Int Conf on Computer Vision , , 2019 . . p.4501 - - 4510 . . DOI: 10.1109/ICCV.2019.00460 http://doi.org/10.1109/ICCV.2019.00460 . .

L Chen , , , HW Zhang , , , J Xiao , , , 等 . . Counterfactual critic multi-agent training for scene graph generation . . Proc IEEE/CVF Int Conf on Computer Vision , , 2019 . . p. 4612 - - 4622 . . DOI: 10.1109/ICCV.2019.00471 http://doi.org/10.1109/ICCV.2019.00471 . .

M Denis . . Imagery and thinking. In: Cornoldi C, McDaniel MA (Eds. ), Imagery and Cognition . . Springer, New York, NY, USA , , 1991 . . p. 103 - - 131 . . DOI: 10.1007/978-1-4684-6407-8_4 http://doi.org/10.1007/978-1-4684-6407-8_4 . .

A Elgammal , , , BC Liu , , , M Elhoseiny , , , 等 . . CAN: creative adversarial networks, generating "art" by learning about styles and deviating from style norms . . 2017 . . https://arxiv.org/abs/1706.07068 https://arxiv.org/abs/1706.07068 , , . .

MS Gazzaniga . . The split brain in man . . Sci Am , , 1967 . . 217 ( ( 2 ): ): 24 - - 29 . . DOI: 10.1038/scientificamerican0867-24 http://doi.org/10.1038/scientificamerican0867-24 . .

JX Gu , , , HD Zhao , , , Z Lin , , , 等 . . Scene graph generation with external knowledge and image reconstruction . . Proc IEEE/CVF Conf on Computer Vision and Pattern Recognition , , 2019 . . p. 1969 - - 1978 . . DOI: 10.1109/CVPR.2019.00207 http://doi.org/10.1109/CVPR.2019.00207 . .

M Haurilet , , , A Roitberg , , , R Stiefelhagen . . It's not about the journey; it's about the destination: following soft paths under question-guidance for visual reasoning . . Proc IEEE/CVF Conf on Computer Vision and Pattern Recognition , , 2019 . . p. 1930 - - 1939 . . DOI: 10.1109/CVPR.2019.00203 http://doi.org/10.1109/CVPR.2019.00203 . .

R Herzig , , , A Bar , , , HJ Xu , , , 等 . . Learning canonical representations for scene graph to image generation . . 16 th European Conf on Computer Vision , , 2020 . . p. 210 - - 227 . . DOI: 10.1007/978-3-030-58574-7_13 http://doi.org/10.1007/978-3-030-58574-7_13 . .

DA Hudson , , , CD Manning . . GQA: a new dataset for real-world visual reasoning and compositional question answering . . 2019 . . https://arxiv.org/abs/1902.09506 https://arxiv.org/abs/1902.09506 , , . .

J Johnson , , , A Gupta , , , FF Li . . Image generation from scene graphs . . Proc IEEE/CVF Conf on Computer Vision and Pattern Recognition , , 2018 . . p. 1219 - - 1228 . . DOI: 10.1109/CVPR.2018.00133 http://doi.org/10.1109/CVPR.2018.00133 . .

J Kolodner . . Case-Based Reasoning . . Morgan Kaufmann, San Mateo, USA , , 2014 . . .

R Krishna , , , YK Zhu , , , O Groth , , , 等 . . Visual genome: connecting language and vision using crowdsourced dense image annotations . . Int J Comput Vis , , 2017 . . 123 ( ( 1 ): ): 32 - - 73 . . DOI: 10.1007/s11263-016-0981-7 http://doi.org/10.1007/s11263-016-0981-7 . .

ML Li , , , A Zareian , , , Q Zeng , , , 等 . . Cross-media structured common space for multimedia event extraction . . 2020 . . https://arxiv.org/abs/2005.02472 https://arxiv.org/abs/2005.02472 , , . .

YL Li , , , L Xu , , , XJ Huang , , , 等 . . HAKE: human activity knowledge engine . . 2019 . . https://arxiv.org/abs/1904.06539v2 https://arxiv.org/abs/1904.06539v2 , , . .

DQ Liu , , , HW Zhang , , , ZJ Zha , , , 等 . . Referring expression grounding by marginalizing scene graph likelihood . . 2019 . . https://arxiv.org/abs/1906.03561v1 https://arxiv.org/abs/1906.03561v1 , , . .

J McCarthy , , , ML Minsky , , , N Rochester , , , 等 . . A proposal for the Dartmouth summer research project on artificial intelligence . . AI Mag , , 2006 . . 27 ( ( 4 ): ): 12 - - 14 . . . .

G Mittal , , , S Agrawal , , , A Agarwal , , , 等 . . Interactive image generation using scene graphs . . 2019 . . https://arxiv.org/abs/1905.03743 https://arxiv.org/abs/1905.03743 , , . .

Z Mu , , , S Tang , , , J Tan , , , 等 . . Disentangled motif-aware graph learning for phrase grounding . . Proc 35 th AAAI Conf on Artificial Intelligence , , 2021 . . .

W Norcliffe-Brown , , , E Vafeais , , , S Parisot . . Learning conditioned graph structures for interpretable visual question answering . . 2018 . . https://arxiv.org/abs/1806.07243v1 https://arxiv.org/abs/1806.07243v1 , , . .

YH Pan . . On visual knowledge . . Front Inform Technol Electron Eng , , 2019 . . 20 ( ( 8 ): ): 1021 - - 1025 . . DOI: 10.1631/FITEE.1910001 http://doi.org/10.1631/FITEE.1910001 . .

YH Pan . . Miniaturized five fundamental issues about visual knowledge . . 2020a . . DOI: 10.1631/FITEE.2040000 http://doi.org/10.1631/FITEE.2040000 . .

YH Pan . . Multiple knowledge representation of artificial intelligence . . Engineering , , 2020b . . 6 ( ( 3 ): ): 216 - - 217 . . DOI: 10.1016/j.eng.2019.12.011 http://doi.org/10.1016/j.eng.2019.12.011 . .

A Radford , , , L Metz , , , S Chintala . . Unsupervised representation learning with deep convolutional generative adversarial networks . . 2015 . . https://arxiv.org/abs/1511.06434 https://arxiv.org/abs/1511.06434 , , . .

K Shen , , , LF Wu , , , FL Xu , , , 等 . . Hierarchical attention based spatial-temporal graph-to-sequence learning for grounded video description . . Proc 29 th Int Joint Conf on Artificial Intelligence , , 2020 . . p. 941 - - 947 . . DOI: 10.24963/ijcai.2020/131 http://doi.org/10.24963/ijcai.2020/131 . .

S Tripathi , , , A Bhiwandiwalla , , , A Bastidas , , , 等 . . Using scene graph context to improve image generation . . 2019 . . https://arxiv.org/abs/1901.03762 https://arxiv.org/abs/1901.03762 , , . .

JW Yang , , , JS Lu , , , S Lee , , , 等 . . Graph R-CNN for scene graph generation . . Proc 15 th European Conf on Computer Vision , , 2018 . . p. 690 - - 706 . . DOI: 10.1007/978-3-030-01246-5_41 http://doi.org/10.1007/978-3-030-01246-5_41 . .

X Yang , , , KH Tang , , , HW Zhang , , , 等 . . Auto-encoding scene graphs for image captioning . . Proc IEEE/CVF Conf on Computer Vision and Pattern Recognition , , 2019 . . p. 10677 - - 10686 . . DOI: 10.1109/CVPR.2019.01094 http://doi.org/10.1109/CVPR.2019.01094 . .

XY Yang , , , T Mei , , , YQ Xu , , , 等 . . Automatic generation of visual-textual presentation layout . . ACM Trans Multim Comput Commun Appl , , 2016 . . 12 ( ( 2 ): ): 33 DOI: 10.1145/2818709 http://doi.org/10.1145/2818709 . .

RC Yu , , , A Li , , , VI Morariu , , , 等 . . Visual relationship detection with internal and external linguistic knowledge distillation . . Proc IEEE Int Conf on Computer Vision , , 2017 . . p. 1068 - - 1076 . . DOI: 10.1109/ICCV.2017.121 http://doi.org/10.1109/ICCV.2017.121 . .

A Zareian , , , S Karaman , , , SF Chang . . Weakly supervised visual semantic parsing . . Proc IEEE/CVF Conf on Computer Vision and Pattern Recognition , , 2020 . . p. 3733 - - 3742 . . DOI: 10.1109/CVPR42600.2020.00379 http://doi.org/10.1109/CVPR42600.2020.00379 . .

HW Zhang , , , Z Kyaw , , , SF Chang , , , 等 . . Visual translation embedding network for visual relation detection . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p. 3107 - - 3115 . . DOI: 10.1109/CVPR.2017.331 http://doi.org/10.1109/CVPR.2017.331 . .

W Zhang , , , XE Wang , , , S Tang , , , 等 . . Relational graph learning for grounded video description generation . . Proc 28 th ACM Int Conf on Multimedia , , 2020 . . p. 3807 - - 3828 . . DOI: 10.1145/3394171.3413746 http://doi.org/10.1145/3394171.3413746 . .

W Zhang , , , H Shi , , , S Tang , , , 等 . . Consensus graph representation learning for better grounded image captioning . . Proc 35 th AAAI Conf on Artificial Intelligence , , 2021 . . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据