基于众包标签数据深度学习的命名实体消歧算法

周乐夔; 汤斯亮; 肖俊; 吴飞; 庄越挺

doi:10.1631/FITEE.1601835

Your Location：

Home >

Browse articles >

基于众包标签数据深度学习的命名实体消歧算法

人工智能2.0专辑 | Updated：2022-05-19

- 基于众包标签数据深度学习的命名实体消歧算法
- Disambiguating named entities with deep supervised learning via crowd labels
- 信息与电子工程前沿（英文） 2017年18卷第1期页码：97-106
- Affiliations：
  
  Institute of Artificial Intelligence, College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  E-mail:luckiezhou@zju.edu.cn
  E-mail:siliang@zju.edu.cn
  E-mail:junx@zju.edu.cn
  E-mail:wufei@zju.edu.cn
  E-mail:yzhuang@zju.edu.cn
- Funds：
  
  Project supported by the National Basic Research Program of China (No. 2015CB352300), the National Natural Science Foundation of China (Nos. 61402401 and U1509206), the Zhejiang Provincial Natural Science Foundation of China (No. LQ14F010004), the China Knowledge Centre for Engineering Sciences and Technology, the Fundamental Research Funds for the Central Universities, and the Qianjiang Talents Program of Zhejiang Province, China
- DOI：10.1631/FITEE.1601835
  中图分类号： TP391.4
- 收稿：2016-12-20，
  
  录用：2016-12-22，
  
  纸质出版：2017-01
- Accepted：
Scan QR Code
周乐夔, 汤斯亮, 肖俊, 等. 基于众包标签数据深度学习的命名实体消歧算法[J]. 信息与电子工程前沿（英文）, 2017,18(1):97-106.

Le-kui ZHOU, Si-liang TANG, Jun XIAO, et al. Disambiguating named entities with deep supervised learning via crowd labels[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(1): 97-106.
周乐夔, 汤斯亮, 肖俊, 等. 基于众包标签数据深度学习的命名实体消歧算法[J]. 信息与电子工程前沿（英文）, 2017,18(1):97-106. DOI： 10.1631/FITEE.1601835.

Le-kui ZHOU, Si-liang TANG, Jun XIAO, et al. Disambiguating named entities with deep supervised learning via crowd labels[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(1): 97-106. DOI： 10.1631/FITEE.1601835.

摘要

命名实体消歧主要研究如何将存在歧义的文本描述映射到其对应知识库（例如Wikipedia）中的实体。本文结合群体智能（即群体用户生成的标签）和深度学习（即数据驱动学习），提出了在命名实体消歧过程中生成区别度更高的特征方法。具体来说，通过设计一个众包模型，学习文本描述或实体所对应"众包特征"，然后利用"众包特征"对动态卷积神经网络（Dynamic convolutional neural network

DCNN）进行优化，最后用优化得到的DCNN来提取"深度众包特征"，以此来解决传统命名实体消歧算法中单独依赖手工设计特征的不足。本文所提出方法巧妙将群体认知（由众包标签反映）结合到命名实体消歧深度学习框架中。实验分析表明，当有足够多众包标签时，所提出方法优于传统手工设计特征。

Abstract

Named entity disambiguation (NED) is the task of linking mentions of ambiguous entities to their referenced entities in a knowledge base such as Wikipedia. We propose an approach to effectively disentangle the discriminative features in the manner of collaborative utilization of collective wisdom (via human-labeled crowd labels) and deep learning (via human-generated data) for the NED task. In particular

we devise a crowd model to elicit the underlying features (crowd features) from crowd labels that indicate a matching candidate for each mention

and then use the crowd features to fine-tune a dynamic convolutional neural network (DCNN). The learned DCNN is employed to obtain deep crowd features to enhance traditional hand-crafted features for the NED task. The proposed method substantially benefits from the utilization of crowd knowledge (via crowd labels) into a generic deep learning for the NED task. Experimental analysis demonstrates that the proposed approach is superior to the traditional hand-crafted features when enough crowd labels are gathered.

关键词

Keywords

references

A Alhelbawy , , , R Gaizauskas . . Graph ranking for collective named entity disambiguation . . 2014 . . Proc. 52nd Annual Meeting of the Association for Computational Linguistics . . 75 - - 80 . . . .

A Bagga , , , B Baldwin . . Entity-based cross-document coreferencing using the vector space model . . 1998 . . Proc. 36th Annual Meeting of the Association for Computational Linguistics and 17th Int. Conf. on Computational Linguistics . . 79 - - 85 . . DOI: 10.3115/980845.980859 http://doi.org/10.3115/980845.980859 . .

DM Blei , , , AY Ng , , , MI Jordan . . Latent Dirichlet allocation . . J. Mach. Learn. Res. , , 2003 . . 3 993 - - 1022 . . . .

R Bunescu , , , M Paca . . Using encyclopedic knowledge for named entity disambiguation . . Proc. 11th Conf. of the European Chapter of the Association for Computational Linguistics , , 2006 . . 9 - - 7 . . . .

S Cucerzan . . Large-scale named entity disambiguation based on Wikipedia data . . 2007 . . Proc. Joint Conf. on Empirical Methods in Natural Language Processing and Computational Natural Language Learning . . 708 - - 716 . . . .

G Demartini , , , DE Difallah , , , P Cudr-Mauroux . . ZenCrowd: leveraging probabilistic reasoning and crowdsourcing techniques for large-scale entity linking . . 2012 . . Proc. 21st Int. Conf. on World Wide Web . . 469 - - 478 . . DOI: 10.1145/2187836.2187900 http://doi.org/10.1145/2187836.2187900 . .

E Gabrilovich , , , S Markovitch . . Computing semantic relatedness using Wikipedia-based explicit semantic analysis . . 2007 . . Proc. Int. Joint Conf. on Artificial Intelligence . . 1606 - - 1611 . . DOI: 10.1145/2063576.2063865 http://doi.org/10.1145/2063576.2063865 . .

AL Gentile , , , ZQ Zhang , , , L Xia , , , 等 . . Graph-based semantic relatedness for named entity disambiguation . . 2009 . . Proc. Int. Conf. on Software, Services & Semantic Technologies . . 13 - - 20 . . . .

K Haas , , , P Mika , , , P Tarjan , , , 等 . . Enhanced results for web search . . 2011 . . Proc. 34th Int. ACM SIGIR Conf. on Research and Development in Information Retrieval . . 725 - - 734 . . DOI: 10.1145/2009916.2010014 http://doi.org/10.1145/2009916.2010014 . .

S Hakimov , , , SA Oto , , , E Dogdu . . Named entity recognition and disambiguation using linked data and graph-based centrality scoring . . 2012 . . Proc. 4th Int. Workshop on Semantic Web Information Management, Article 4 . . DOI: 10.1145/2237867.2237871 http://doi.org/10.1145/2237867.2237871 . .

S Hochreiter , , , J Schmidhuber . . Long short-term memory . . Neur. Comput. , , 1997 . . 9 ( ( 8 ): ): 1735 - - 1780 . . . .

N Kalchbrenner , , , E Grefenstette , , , P Blunsom . . A convolutional neural network for modelling sentences . . 2014 . . Proc. 52nd Annual Meeting of the Association for Computational Linguistics . . 655 - - 665 . . . .

T Mikolov , , , I Sutskever , , , K Chen , , , 等 . . Distributed representations of words and phrases and their compositionality . . 2013 . . Advances in Neural Information Processing Systems . . 3111 - - 3119 . . . .

YH Pan . . Heading toward artificial intelligence 2.0 . . Engineering , , 2016 . . 2 ( ( 4 ): ): 409 - - 413 . . DOI: 10.1016/J.ENG.2016.04.018 http://doi.org/10.1016/J.ENG.2016.04.018 . .

F Wu , , , ZH Wang , , , ZF Zhang , , , 等 . . Weakly semi-supervised deep learning for multi-label image annotation . . IEEE Trans. Big Data , , 2015 . . 1 ( ( 3 ): ): 109 - - 122 . . DOI: 10.1109/TBDATA.2015.2497270 http://doi.org/10.1109/TBDATA.2015.2497270 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

MltAuxTSPP: a unified benchmark for deep learning-based traffic state prediction with multi-source auxiliary data

Q-space-coordinate-guided neural networks for high-fidelity diffusion tensor estimation from minimal diffusion-weighted images

CRGT-SA: an interlaced and spatiotemporal deep learning model for network intrusion detection

Federated model with contrastive learning and adaptive control variates for human activity recognition

A comprehensive survey of physical adversarial vulnerabilities in autonomous driving systems