A survey of script learning

Yi HAN; Linbo QIAO; Jianming ZHENG; Hefeng WU; Dongsheng LI; Xiangke LIAO

doi:10.1631/FITEE.2000347

Your Location：

Home >

Browse articles >

A survey of script learning

Regular Papers | Updated：2022-05-19

- A survey of script learning
- 脚本学习综述
- Frontiers of Information Technology & Electronic Engineering Vol. 22, Issue 3, Pages: 341-373(2021)
- Affiliations：
  
  Science and Technology on Parallel and Distributed Processing Laboratory, National University of Defense Technology, Changsha 410000, China
  Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410000, China
  School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510006, China
- Author bio：
  
  [ "", "Yi HAN, first author of this invited paper, received his BS and MS degrees from the National University of Defense Technology (NUDT), Changsha, China in 2016 and 2018, respectively, and is currently a PhD candidate at the College of Computer Science, NUDT. His research interests include natural language processing, event extraction, and few-shot learning", "Yi HAN, E-mail: hanyi12@nudt.edu.cn" ]
  [ "", "Linbo QIAO, corresponding author of this invited paper, received his BS, MS, and PhD degrees in computer science and technology from NUDT, Changsha, China in 2010, 2012, and 2017, respectively. Now, he is an assistant research fellow at the National Lab for Parallel and Distributed Processing, NUDT. He worked as a research assistant at the Chinese University of Hong Kong from May to Oct. 2014. His research interests include structured sparse learning, online and distributed optimization, and deep learning for graph and graphical models" ]
  [ "", "Jianming ZHENG received the BS and MS degrees from NUDT, China in 2016 and 2018, respectively, and is currently a PhD candidate at the School of System Engineering, NUDT. His research interests include semantics representation, few-shot learning and its applications in information retrieval. He has several papers published in SIGIR, WWW, COLING, IPM, Cognitive Computation, etc", "Jianming ZHENG, E-mail: zhengjianming12@nudt.edu.cn" ]
  [ "", "Hefeng WU received the BS degree in Computer Science and Technology and the PhD degree in Computer Application Technology from Sun Yat-sen University, China in 2008 and 2013, respectively. He is currently a full research scientist with the School of Data and Computer Science, Sun Yat-sen University. His research interests include computer vision, multimedia, and machine learning. He has served as a reviewer for many academic journals and conferences, including TIP, TCYB, TSMC, TCSVT, PR, CVPR, ICCV, NeurIPS, and ICML", "Hefeng WU, E-mail: wuhefeng@mail.sysu.edu.cn" ]
  [ "", "Dongsheng LI received his BS degree (with honors) and PhD degree (with honors) in computer science from the College of Computer Science, NUDT, Changsha, China in 1999 and 2005, respectively. He was awarded the prize of National Excellent Doctoral Dissertation by the Ministry of Education of China in 2008, and the National Science Fund for Distinguished Young Scholars in 2020. He is now a full professor at the National Lab for Parallel and Distributed Processing, NUDT. He is a corresponding expert of Frontiers of Information Technology & Electronic Engineering. His research interests include parallel and distributed computing, cloud computing, and large-scale data management", "Dongsheng LI, E-mail: dsli@nudt.edu.cn" ]
  [ "", "Xiangke LIAO received his BS degree from the Department of Computer Science and Technology, Tsinghua University, Beijing, China in 1985, and his MS degree from NUDT, Changsha, China in 1988. He is currently a full professor of NUDT, and an academician of the Chinese Academy of Engineering. His research interests include parallel and distributed computing, highperformance computer systems, operating systems, cloud computing, and networked embedded systems", "Xiangke LIAO, E-mail: xkliao@nudt.edu.cn" ]
- Funds：
- DOI：10.1631/FITEE.2000347
  CLC： TP391
- Received：13 July 2020，
  
  Revised：2101-;1-;8，
  
  Published：2021-03
- Accepted：
Scan QR Code
Yi HAN, Linbo QIAO, Jianming ZHENG, et al. A survey of script learning[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(3): 341-373.
DOI：

Yi HAN, Linbo QIAO, Jianming ZHENG, et al. A survey of script learning[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(3): 341-373. DOI： 10.1631/FITEE.2000347.

摘要

脚本是现实世界中日常事件的结构化知识表示。学习脚本中蕴含的丰富常识知识可以帮助机器理解自然语言并做出常识性推理。脚本学习是一个颇具用途及潜力的研究方向，一个经过训练的脚本学习系统可以处理叙事文本，捕捉其中的脚本知识进而做出推理。然而目前尚不存在针对脚本学习的综述性文章，因此我们写作本文以深入研究脚本学习的基本框架和主要研究方向。脚本学习主要包括3个重点研究内容：事件表示方式、脚本学习模型以及性能评估方法。针对每一主题，对现有脚本学习系统进行了系统总结和分类，仔细分析和比较了其中代表性系统的优缺点。此外，研究并讨论了脚本学习的发展现状以及未来研究方向。

Abstract

Script is the structured knowledge representation of prototypical real-life event sequences.Learning the commonsense knowledge inside the script can be helpful for machines in understanding natural language and drawing commonsensible inferences.Script learning is an interesting and promising research direction

in which a trained script learning system can process narrative texts to capture script knowledge and draw inferences.However

there are currently no survey articles on script learning

so we are providing this comprehensive survey to deeply investigate the standard framework and the major research topics on script learning.This research field contains three main topics: event representations

script learning models

and evaluation approaches.For each topic

we systematically summarize and categorize the existing script learning systems

and carefully analyze and compare the advantages and disadvantages of the representative systems.We also discuss the current state of the research and possible future directions.

关键词

Keywords

references

AB Arrieta , , , N Díaz-Rodríguez , , , J Del Ser , , , 等 . . Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI . . Inform Fus , , 2020 . . 58 82 - - 115 . . DOI: 10.1016/j.inffus.2019.12.012 http://doi.org/10.1016/j.inffus.2019.12.012 . .

N Balasubramanian , , , S Soderland , , , Mausam , , , 等 . . Generating coherent event schemas at scale . . Proc Conf on Empirical Methods in Natural Language Processing , , 2013 . . p. 1721 - - 1731 . . . .

M Baroni , , , R Zamparelli . . Nouns are vectors, adjectives are matrices: representing adjective-noun constructions in semantic space . . Proc Conf on Empirical Methods in Natural Language Processing , , 2010 . . p.1183 - - 1193 . . DOI: 10.5555/1870658.1870773 http://doi.org/10.5555/1870658.1870773 . .

Y Bengio , , , R Ducharme , , , P Vincent , , , 等 . . A neural probabilistic language model . . J Mach Learn Res , , 2003 . . 3 1137 - - 1155 . . DOI: 10.5555/944919.944966 http://doi.org/10.5555/944919.944966 . .

A Bordes , , , N Usunier , , , A Garcia-Durán , , , 等 . . Translating embeddings for modeling multi-relational data . . Proc 26 th Int Conf on Neural Information Processing Systems , , 2013 . . p. 2787 - - 2795 . . DOI: 10.5555/2999792.2999923 http://doi.org/10.5555/2999792.2999923 . .

GH Bower , , , JB Black , , , TJ Turner . . Scripts in memory for text . . Cogn Psychol , , 1979 . . 11 ( ( 2 ): ): 177 - - 220 . . DOI: 10.1016/0010-0285(79)90009-4 http://doi.org/10.1016/0010-0285(79)90009-4 . .

N Chambers . . Behind the scenes of an evolving event cloze test . . Proc 2 nd Workshop on Linking Models of Lexical, Sentential and Discourse-Level Semantics , , 2017 . . p. 41 - - 45 . . DOI: 10.18653/v1/w17-0905 http://doi.org/10.18653/v1/w17-0905 . .

N Chambers , , , D Jurafsky . . Unsupervised learning of narrative event chains . . Proc 46 th Annual Meeting of the Association for Computational Linguistics , , 2008 . . p. 789 - - 797 . . . .

N Chambers , , , D Jurafsky . . Unsupervised learning of narrative schemas and their participants . . Proc Joint Conf of the 47 th Annual Meeting of the ACL and the 4 th Int Joint Conf on Natural Language Processing of the AFNLP , , 2009 . . p.602 - - 610 . . DOI: 10.5555/1690219.1690231 http://doi.org/10.5555/1690219.1690231 . .

J Chung , , , C Gulcehre , , , K Cho , , , 等 . . Empirical evaluation of gated recurrent neural networks on sequence modeling . . modeling , , 2014 . . https: //arxiv. org/abs/1412.3555 https: //arxiv. org/abs/1412.3555 , , . .

KW Church , , , P Hanks . . Word association norms, mutual information, and lexicography . . Comput Ling , , 1990 . . 16 ( ( 1 ): ): 22 - - 29 . . DOI: 10.5555/89086.89095 http://doi.org/10.5555/89086.89095 . .

RE Cullingford . . Script Application: Computer Understanding of Newspaper Stories . . PhD Thesis, Yale University, New Haven, CT, USA. , , 1978 . . .

GF DeJong . . Skimming Stories in Real Time: an Experiment in Integrated Understanding . . PhD Thesis, Yale University, New Haven, CT, USA , , 1979 . . .

J Devlin , , , MW Chang , , , K Lee , , , 等 . . BERT: pre-training of deep bidirectional transformers for language understanding . . Proc Conf of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , , 2019 . . p.4171 - - 4186 . . DOI: 10.18653/v1/n19-1423 http://doi.org/10.18653/v1/n19-1423 . .

X Ding , , , ZY Li , , , T Liu , , , 等 . . ELG: an event logic . . graph , , 2019a . . https: //arxiv. org/abs/1907.08015 https: //arxiv. org/abs/1907.08015 , , . .

X Ding , , , K Liao , , , T Liu , , , 等 . . Event representation learning enhanced with external commonsense knowledge . . Proc Conf on Empirical Methods in Natural Language Processing and the 9 th Int Joint Conf on Natural Language Processing , , 2019b . . p. 4896 - - 4905 . . DOI: 10.18653/v1/D19-1495 http://doi.org/10.18653/v1/D19-1495 . .

K Erk , , , S Padó . . A structured vector space model for word meaning in context . . Proc Conf on Empirical Methods in Natural Language Processing , , 2008 . . p. 897 - - 906 . . DOI: 10.5555/1613715.1613831 http://doi.org/10.5555/1613715.1613831 . .

CJ Fillmore . . Frame semantics and the nature of language . . Ann N Y Acad Sci , , 1976 . . 280 ( ( 1 ): ): 20 - - 32 . . DOI: 10.1111/j.1749-6632.1976.tb25467.x http://doi.org/10.1111/j.1749-6632.1976.tb25467.x . .

G Glavaš , , , J Šnajder . . Construction and evaluation of event graphs . . Nat Lang Eng , , 2015 . . 21 ( ( 4 ): ): 607 - - 652 . . DOI: 10.1017/S1351324914000060 http://doi.org/10.1017/S1351324914000060 . .

AS Gordon . . Browsing image collections with representations of common-sense activities . . J Am Soc Inform Sci Technol , , 2001 . . 52 ( ( 11 ): ): 925 - - 929 . . DOI: 10.1002/asi.1143 http://doi.org/10.1002/asi.1143 . .

M Granroth-Wilding , , , S Clark . . What happens next . . Event prediction using a compositional neural network model. Proc 30 th AAAI Conf on Artificial Intelligence , , 2016 . . p. 2727 - - 2733 . . DOI: 10.5555/3016100.3016283 http://doi.org/10.5555/3016100.3016283 . .

R Gupta , , , MJ Kochenderfer . . Common sense data acquisition for indoor mobile robots . . Proc 19 th National Conf on Artifical Intelligence , , 2004 . . p. 605 - - 610 . . DOI: 10.5555/1597148.1597246 http://doi.org/10.5555/1597148.1597246 . .

ZS Harris . . Distributional structure . . Word , , 1954 . . 10 ( ( 2-3 ): ): 146 - - 162 . . . .

S Hochreiter , , , J Schmidhuber . . Long short-term memory . . Neur Comput , , 1997 . . 9 ( ( 8 ): ): 1735 - - 1780 . . DOI: 10.1162/neco.1997.9.8.1735 http://doi.org/10.1162/neco.1997.9.8.1735 . .

LM Hu , , , JZ Li , , , LQ Nie , , , 等 . . What happens next . . Future subevent prediction using contextual hierarchical LSTM. Proc 31 st AAAI Conf on Artificial Intelligence , , 2017 . . p. 3450 - - 3456 . . DOI: 10.5555/3298023.3298070 http://doi.org/10.5555/3298023.3298070 . .

B Jans , , , S Bethard , , , Vulic , , , 等 . . Skip N-grams and ranking functions for predicting script events . . Proc 13 th Conf of the European Chapter of the Association for Computational Linguistics , , 2012 . . p. 336 - - 344 . . . .

MP Jones , , , JH Martin . . Contextual spelling correction using latent semantic analysis . . Proc 5 th Conf on Applied Natural Language Processing , , 1997 . . p.166 - - 173 . . DOI: 10.3115/974557.974582 http://doi.org/10.3115/974557.974582 . .

LP Kaelbling , , , ML Littman , , , AW Moore . . Reinforcement learning: a survey . . J Artif Intell Res , , 1996 . . 4 237 - - 285 . . DOI: 10.1613/jair.301 http://doi.org/10.1613/jair.301 . .

A Khan , , , N Salim , , , YJ Kumar . . A framework for multi-document abstractive summarization based on semantic role labelling . . Appl Soft Comput , , 2015 . . 30 737 - - 747 . . DOI: 10.1016/j.asoc.2015.01.070 http://doi.org/10.1016/j.asoc.2015.01.070 . .

R Kiros , , , YK Zhu , , , R Salakhutdinov , , , 等 . . Skip-thought vectors . . Proc 28 th Int Conf on Neural Information Processing Systems , , 2015 . . p. 3294 - - 3302 . . DOI: 10.5555/2969442.2969607 http://doi.org/10.5555/2969442.2969607 . .

PW Koh , , , P Liang . . Understanding black-box predictions via influence functions . . Proc 34 th Int Conf on Machine Learning , , 2017 . . p. 1885 - - 1894 . . . .

AHF Laender , , , BA Ribeiro-Neto , , , AS Da Silva , , , 等 . . A brief survey of web data extraction tools . . ACM SIGMOD Rec , , 2002 . . 31 ( ( 2 ): ): 84 - - 93 . . DOI: 10.1145/565117.565137 http://doi.org/10.1145/565117.565137 . .

G Lee , , , M Flowers , , , MG Dyer . . Learning distributed representations of conceptual knowledge and their application to script-based story processing . . In: Sharkey N (Ed.), Connectionist Natural Language Processing. Springer, Dordrecht , , 1992 . . p. 215 - - 247 . . DOI: 10.1007/978-94-011-2624-3\_11 http://doi.org/10.1007/978-94-011-2624-3\_11 . .

IT Lee , , , D Goldwasser . . FEEL: featured event embedding learning . . Proc 32 nd AAAI Conf on Artificial Intelligence , , 2018 . . .

IT Lee , , , D Goldwasser . . Multi-relational script learning for discourse relations . . Proc 57 th Annual Meeting of the Association for Computational Linguistics , , 2019 . . p.4214 - - 4226 . . DOI: 10.18653/v1/p19-1413 http://doi.org/10.18653/v1/p19-1413 . .

JW Li , , , W Monroe , , , A Ritter , , , 等 . . Deep reinforcement learning for dialogue generation . . Proc Conf on Empirical Methods in Natural Language Processing , , 2016 . . p. 1192 - - 1202 . . DOI: 10.18653/v1/D16-1127 http://doi.org/10.18653/v1/D16-1127 . .

Q Li , , , ZW Li , , , JM Wei , , , 等 . . A multi-attention based neural network with external knowledge for story ending predicting task . . Proc 27 th Int Conf on Computational Linguistics , , 2018 . . p. 1754 - - 1762 . . . .

ZY Li , , , X Ding , , , T Liu . . Constructing narrative event evolutionary graph for script event prediction . . Proc 27 th Int Joint Conf on Artificial Intelligence , , 2018 . . p.4201 - - 4207 . . DOI: 10.5555/3304222.3304354 http://doi.org/10.5555/3304222.3304354 . .

ZY Li , , , X Ding , , , T Liu . . Story ending prediction by transferable BERT . . Proc 28 th Int Joint Conf on Artificial Intelligence , , 2019 . . p. 1800 - - 1806 . . DOI: 10.24963/ijcai.2019/249 http://doi.org/10.24963/ijcai.2019/249 . .

YK Lin , , , ZY Liu , , , MS Sun , , , 等 . . Learning entity and relation embeddings for knowledge graph completion . . Pro 29 th AAAI Conf on Artificial Intelligence , , 2015 . . .

ZH Lin , , , MW Feng , , , CN Dos Santos , , , 等 . . A structured self-attentive sentence embedding . . Proc 5 th Int Conf on Learning Representations. , , 2017 . . .

T Luong , , , H Pham , , , CD Manning . . Effective approaches to attention-based neural machine translation . . Proc Conf on Empirical Methods in Natural Language Processing , , 2015 . . p.1412 - - 1421 . . DOI: 10.18653/v1/d15-1166 http://doi.org/10.18653/v1/d15-1166 . .

SW Lv , , , WH Qian , , , LT Huang , , , 等 . . SAM-Net: integrating event-level and chain-level attentions to predict what happens next . . Proc AAAI Conf on Artificial Intelligence , , 2019 . . p. 6802 - - 6809 . . DOI: 10.1609/aaai.v33i01.33016802 http://doi.org/10.1609/aaai.v33i01.33016802 . .

Mausam , , , M Schmitz , , , R Bart , , , 等 . . Open language learning for information extraction . . Proc Joint Conf on Empirical Methods in Natural Language Processing and Computational Natural Language Learning , , 2012 . . p. 523 - - 534 . . DOI: 10.5555/2390948.2391009 http://doi.org/10.5555/2390948.2391009 . .

B McCann , , , J Bradbury , , , CM Xiong , , , 等 . . Learned in translation: contextualized word vectors . . Proc 31 st Int Conf on Neural Information Processing Systems , , 2017 . . p. 6297 - - 6308 . . DOI: 10.5555/3295222.3295377 http://doi.org/10.5555/3295222.3295377 . .

R Miikkulainen . . Discern: a distributed neural network model of script processing and memory . . University Twente, Connectionism and Natural Language Processing , , 1992 . . p. 115 - - 124 . . . .

R Miikkulainen . . Subsymbolic Natural Language Processing: an Integrated Model of Scripts, Lexicon, and Memory , , : : Cambridge, USA. MIT Press, , , 1993 . . .

T Mikolov , , , K Chen , , , G Corrado , , , 等 . . Efficient estimation of word representations in vector space . . space , , 2013 . . https://arxiv.org/abs/1301.3781 https://arxiv.org/abs/1301.3781 , , . .

GA Miller . . WordNet: a lexical database for English . . Commun ACM , , 1995 . . 38 ( ( 11 ): ): 39 - - 41 . . DOI: 10.1145/219717.219748 http://doi.org/10.1145/219717.219748 . .

M Minsky . . A framework for representing knowledge . . In: Winston PH (Ed.), The Psychology of Computer Vision. McGraw-Hill Book, New York, USA , , 1975 . . .

A Mnih , , , G Hinton . . Three new graphical models for statistical language modelling . . Proc 24 th Int Conf on Machine Learning , , 2007 . . p.641 - - 648 . . DOI: 10.1145/1273496.1273577 http://doi.org/10.1145/1273496.1273577 . .

A Modi . . Event embeddings for semantic script modeling . . Proc 20 th SIGNLL Conf on Computational Natural Language Learning , , 2016 . . p. 75 - - 83 . . DOI: 10.18653/v1/k16-1008 http://doi.org/10.18653/v1/k16-1008 . .

A Modi , , , I Titov . . Inducing neural models of script knowledge . . Proc 18 th Conf on Computational Natural Language Learning , , 2014a . . p. 49 - - 57 . . DOI: 10.3115/v1/w14-1606 http://doi.org/10.3115/v1/w14-1606 . .

A Modi , , , I Titov . . Learning semantic script knowledge with event embeddings . . Proc 2 nd Int Conf on Learning Representations , , 2014b . . .

A Modi , , , T Anikina , , , S Ostermann , , , 等 . . InScript: narrative texts annotated with script information . . InScript: narrative texts annotated with script information. Proc 10 th Int Conf on Language Resources and Evaluation. , , 2016 . . .

A Modi , , , I Titov , , , V Demberg , , , 等 . . Modeling semantic expectation: using script knowledge for referent prediction . . Trans Assoc Comput Ling , , 2017 . . 5 ( ( 2 ): ): 31 - - 44 . . DOI: 10.1162/tacl\_a\_00044 http://doi.org/10.1162/tacl\_a\_00044 . .

N Mostafazadeh , , , N Chambers , , , XD He , , , 等 . . A corpus and cloze evaluation for deeper understanding of commonsense stories . . Proc Conf of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , , 2016 . . p. 839 - - 849 . . DOI: 10.18653/v1/n16-1098 http://doi.org/10.18653/v1/n16-1098 . .

ET Mueller . . Natural Language Processing with ThoughtTreasure , , : : New York, USA. Signiform, , , 1998 . . .

R Navigli . . Word sense disambiguation: a survey . . ACM Comput Surv , , 2009 . . 41 ( ( 2 ): ): 10 DOI: 10.1145/1459352.1459355 http://doi.org/10.1145/1459352.1459355 . .

JW Orr , , , P Tadepalli , , , JR Doppa , , , 等 . . Learning scripts as hidden Markov models . . Proc 28 th AAAI Conf on Artificial Intelligence , , 2014 . . p. 1565 - - 1571 . . DOI: 10.5555/2892753.2892770 http://doi.org/10.5555/2892753.2892770 . .

AH Osman , , , N Salim , , , MS Binwahlan , , , 等 . . Plagiarism detection scheme based on semantic role labeling . . Proc Int Conf on Information Retrieval & Knowledge Management , , 2012 . . p. 30 - - 33 . . DOI: 10.1109/InfRKM.2012.6204978 http://doi.org/10.1109/InfRKM.2012.6204978 . .

KX Pei , , , YZ Cao , , , JF Yang , , , 等 . . DeepXplore: automated whitebox testing of deep learning systems . . Proc 26 th Symp on Operating Systems Principles , , 2017 . . p. 1 - - 18 . . DOI: 10.1145/3132747.3132785 http://doi.org/10.1145/3132747.3132785 . .

J Pennington , , , R Socher , , , C Manning . . GloVe: global vectors for word representation . . Proc Conf on Empirical Methods in Natural Language Processing , , 2014 . . p. 1532 - - 1543 . . DOI: 10.3115/v1/d14-1162 http://doi.org/10.3115/v1/d14-1162 . .

B Perozzi , , , R Al-Rfou , , , S Skiena . . DeepWalk: online learning of social representations . . Proc 20 th ACM SIGKDD Int Conf on Knowledge Discovery and Data Mining , , 2014 . . p. 701 - - 710 . . DOI: 10.1145/2623330.2623732 http://doi.org/10.1145/2623330.2623732 . .

M Peters , , , M Neumann , , , M Iyyer , , , 等 . . Deep contextualized word representations . . Proc Conf of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , , 2018 . . p. 2227 - - 2237 . . DOI: 10.18653/v1/n18-1202 http://doi.org/10.18653/v1/n18-1202 . .

K Pichotta , , , R Mooney . . Statistical script learning with multi-argument events . . Proc 14 th Conf of the European Chapter of the Association for Computational Linguistics , , 2014 . . p. 220 - - 229 . . DOI: 10.3115/v1/e14-1024 http://doi.org/10.3115/v1/e14-1024 . .

K Pichotta , , , RJ Mooney . . Learning statistical scripts with LSTM recurrent neural networks . . Proc 30 th AAAI Conf on Artificial Intelligence , , 2016a . . p. 2800 - - 2806 . . DOI: 10.5555/3016100.3016293 http://doi.org/10.5555/3016100.3016293 . .

K Pichotta , , , RJ Mooney . . Using sentence-level LSTM language models for script inference . . Proc 54 th Annual Meeting of the Association for Computational Linguistics , , 2016b . . p. 279 - - 289 . . DOI: 10.18653/v1/p16-1027 http://doi.org/10.18653/v1/p16-1027 . .

R Prasad , , , N Dinesh , , , A Lee , , , 等 . . The Penn discourse Treebank 2.0 . . Proc Int 6 th Conf on Language Resources and Evaluation , , 2008 . . p. 2961 - - 2968 . . . .

XP Qiu , , , TX Sun , , , YG Xu , , , 等 . . Pre-trained models for natural language processing: . . a survey , , 2020 . . https: //arxiv.org/abs/2003.08271 https: //arxiv.org/abs/2003.08271 , , . .

A Radford , , , K Narasimhan , , , T Salimans , , , 等 . . Improving language understanding by generative pre-training . . Proc Conf of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , , 2019 . . p. 4171 - - 4186 . . . .

K Radinsky , , , E Agichtein , , , E Gabrilovich , , , 等 . . A word at a time: computing word relatedness using temporal semantic analysis . . Proc 20 th Int Conf on World Wide Web , , 2011 . . p.337 - - 346 . . DOI: 10.1145/1963405.1963455 http://doi.org/10.1145/1963405.1963455 . .

H Rashkin , , , M Sap , , , E Allaway , , , 等 . . Event2Mind: commonsense inference on events, intents, and reactions . . Proc 56 th Annual Meeting of the Association for Computational Linguistics , , 2018 . . p. 463 - - 473 . . DOI: 10.18653/v1/P18-1043 http://doi.org/10.18653/v1/P18-1043 . .

M Regneri , , , A Koller , , , M Pinkal . . Learning script knowledge with web experiments . . Proc 48 th Annual Meeting of the Association for Computational Linguistics , , 2010 . . p. 979 - - 988 . . DOI: 10.5555/1858681.1858781 http://doi.org/10.5555/1858681.1858781 . .

R Rudinger , , , P Rastogi , , , F Ferraro , , , 等 . . Script induction as language modeling . . Proc Conf on Empirical Methods in Natural Language Processing , , 2015 . . p. 1681 - - 1686 . . DOI: 10.18653/v1/d15-1195 http://doi.org/10.18653/v1/d15-1195 . .

DE Rumelhart . . Schemata: the building blocks of cognition . . In: Spiro RJ (Ed.), Theoretical Issues in Reading Comprehension. Erlbaum, Hillsdale , , 1980 . . p. 33 - - 58 . . . .

M Sap , , , R Le Bras , , , E Allaway , , , 等 . . ATOMIC: an atlas of machine commonsense for if-then reasoning . . Proc AAAI Conf on Artificial Intelligence , , 2019 . . p.3027 - - 3035 . . DOI: 10.1609/aaai.v33i01.33013027 http://doi.org/10.1609/aaai.v33i01.33013027 . .

RC Schank . . Tell Me a Story: a New Look at Real and Artificial Memory , , : : New York, USA. Charles Scribner, , , 1990 . . .

RC Schank , , , RP Abelson . . Scripts, Plans, Goals and Understanding: an Inquiry into Human Knowledge Structures . . L. Erlbaum, Hillsdale, USA. , , 1977 . . .

RC Schank . . Dynamic Memory: a Theory of Reminding and Learning in Computers and People . . New York, USA.: Cambridge University Press, , , 1983 . . .

KK Schuler . . VerbNet: a Broad-Coverage, Comprehensive Verb Lexicon . . PhD Thesis, University of Pennsylvania, Pennsylvania, USA. , , 2005 . . .

D Shen , , , M Lapata . . Using semantic roles to improve question answering . . Proc Joint Conf on Empirical Methods in Natural Language Processing and Computational Natural Language Learning , , 2007 . . p.12 - - 21 . . . .

R Socher , , , B Huval , , , CD Manning , , , 等 . . Semantic compositionality through recursive matrix-vector spaces . . Proc Joint Conf on Empirical Methods in Natural Language Processing and Computational Natural Language Learning , , 2012 . . p.1201 - - 1211 . . DOI: 10.5555/2390948.2391084 http://doi.org/10.5555/2390948.2391084 . .

RS Sutton , , , AG Barto . . Reinforcement Learning: an Introduction (2 nd Ed.). , , : : Cambridge, USA. MIT Press, , , 2018 . . .

WL Taylor . . "Cloze procedure": a new tool for measuring readability . . J Mass Commun Q , , 1953 . . 30 ( ( 4 ): ): 415 - - 433 . . DOI: 10.1177/107769905303000401 http://doi.org/10.1177/107769905303000401 . .

WS Terry . . Learning and Memory: Basic Principles, Processes, and Procedures . . Allyn and Bacon, Boston, USA. , , 2006 . . .

E Tulving . . Elements of Episodic Memory , , : : New York, USA. Oxford University Press , , 1983 . . .

Z Wang , , , JW Zhang , , , JL Feng , , , 等 . . Knowledge graph embedding by translating on hyperplanes . . Proc 28 th AAAI Conf on Artificial Intelligence , , 2014 . . p.1112 - - 1119 . . DOI: 10.5555/2893873.2894046 http://doi.org/10.5555/2893873.2894046 . .

ZQ Wang , , , Y Zhang , , , CY Chang . . Integrating order information and event relation for script event prediction . . Proc Conf on Empirical Methods in Natural Language Processing , , 2017 . . p. 57 - - 67 . . DOI: 10.18653/v1/d17-1006 http://doi.org/10.18653/v1/d17-1006 . .

N Weber , , , N Balasubramanian , , , N Chambers . . Event representations with tensor-based compositions . . Proc 32 nd AAAI Conf on Artificial Intelligence , , 2018 . . p. 4946 - - 4953 . . . .

J Weston , , , S Chopra , , , A Bordes . . Memory networks . . networks , , 2015 . . https: //arxiv.org/abs/1410.3916 https: //arxiv.org/abs/1410.3916 , , . .

SD Zhao , , , Q Wang , , , S Massung , , , 等 . . Constructing and embedding abstract event causality networks from text snippets . . Proc 10 th ACM Int Conf on Web Search and Data Mining , , 2017 . . p.335 - - 344 . . DOI: 10.1145/3018661.3018707 http://doi.org/10.1145/3018661.3018707 . .

JM Zheng , , , F Cai , , , HH Chen . . Incorporating scenario knowledge into a unified fine-tuning architecture for event representation . . Proc 43 rd Int ACM SIGIR Conf on Research and Development in Information Retrieval , , 2020 . . p.249 - - 258 . . DOI: 10.1145/3397271.3401173 http://doi.org/10.1145/3397271.3401173 . .

MT Zhou , , , ML Huang , , , XY Zhu . . Story ending selection by finding hints from pairwise candidate endings . . IEEE/ACM Trans Audio Speech Lang Process , , 2019 . . 27 ( ( 4 ): ): 719 - - 729 . . DOI: 10.1109/TASLP.2019.2893499 http://doi.org/10.1109/TASLP.2019.2893499 . .

Views

164

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Advances and challenges in artificial intelligence text generation

Emerging topic identification from app reviews via adaptive online biterm topic modeling

Related Author

Bing LI

Peng YANG

Yuankang SUN

Zhongjian HU

Meng YI

Wan ZHOU

Yong WANG

Cuiyun GAO

Related Institution

School of Computer Science and Engineering, Southeast University

Key Laboratory of Computer Network and Information Integration, Ministry of Education, Southeast University

School of Information and Computer, Anhui Polytechnic University

State Key Laboratory for Novel Software Technology, Nanjing University

School of Computer Science and Technology, Harbin Institute of Technology

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰