Topic discovery and evolution in scientific literature based on content and citations

Hou-kui ZHOU; Hui-min YU; Roland HU

doi:10.1631/FITEE.1601125

Your Location：

Home >

Browse articles >

Topic discovery and evolution in scientific literature based on content and citations

Regular Papers | Updated：2022-05-19

- Topic discovery and evolution in scientific literature based on content and citations
- 基于内容和引用的科研文献的主题发现和演化
- Frontiers of Information Technology & Electronic Engineering Vol. 18, Issue 10, Pages: 1511-1524(2017)
- Affiliations：
  
  College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China
  State Key Lab of CAD & CG, Zhejiang University, Hangzhou 310027, China
  School of Information Engineering, Zhejiang A & F University, Lin'an 311300, China
  Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Lin'an 311300, China
- Author bio：
  
  Hui-min YU, E-mail: yhm2005@zju.edu.cn
- Funds：
- DOI：10.1631/FITEE.1601125
  CLC： TP391
- Received：01 April 2016，
  
  Revised：2017-;9-22，
  
  Published：2017-10
- Accepted：
Scan QR Code
Hou-kui ZHOU, Hui-min YU, Roland HU. Topic discovery and evolution in scientific literature based on content and citations[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(10): 1511-1524.
DOI：

Hou-kui ZHOU, Hui-min YU, Roland HU. Topic discovery and evolution in scientific literature based on content and citations[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(10): 1511-1524. DOI： 10.1631/FITEE.1601125.

摘要

科研文献数据库中的重要主题随时间的演化的方式已经越来越受到全球研究者的关注。在一个科研论文数据集中，任何一篇论文可以被认为是由组成论文本身的词和论文引用的文献所组成的。在本文中，我们提出了一种名为"Citation-content-LDA (latent Dirichlet allocation)"的主题发现方法，该方法在一个概率生成模型中同时生成文献的引用关系和文献本身的词。Citation-content-LDA模型利用了一种两层结构的主题模型，即利用引用信息生成父主题和利用文本信息生成子主题。模型参数通过吉布斯采样算法来估计。我们还提出了一个主题演化算法，该算法包括主题分割和主题间依赖关系计算两个步骤。我们在

IEEE Transactionson Pattern Analysis and Machine Intelligence (PAMI)

和IEEE Computer Society (CS)两个数据集上测试了提出的Citation-content-LDA模型和主题演化算法，证明了我们提出的算法能有效的发现重要的主题和反映重要研究主题的主题演化情况。经过我们的评价指标的评测，Citation-content-LDA算法的性能优于Content-LDA和Citation-LDA算法。

Abstract

Researchers across the globe have been increasingly interested in the manner in which important research topics evolve over time within the corpus of scientific literature. In a dataset of scientific articles

each document can be considered to comprise both the words of the document itself and its citations of other documents. In this paper

we propose a citation-content-latent Dirichlet allocation (LDA) topic discovery method that accounts for both document citation relations and the content of the document itself via a probabilistic generative model. The citation-content-LDA topic model exploits a two-level topic model that includes the citation information for 'father' topics and text information for sub-topics. The model parameters are estimated by a collapsed Gibbs sampling algorithm. We also propose a topic evolution algorithm that runs in two steps: topic segmentation and topic dependency relation calculation. We have tested the proposed citation-content-LDA model and topic evolution algorithm on two online datasets

IEEE Transactions on Pattern Analysis and Machine Intelligence

(PAMI) and IEEE Computer Society (CS)

to demonstrate that our algorithm effectively discovers important topics and reflects the topic evolution of important research themes. According to our evaluation metrics

citation-content-LDA outperforms both content-LDA and citation-LDA.

关键词

Keywords

references

A. Ahmed , , , E.P. Xing . . Timeline: a dynamic hierarchical Dirichlet process model for recovering birth/death and evolution of topics in text stream. Proc. 26th Conf . . on Uncertainty in Artificial Intelligence , , 2010 . . p.20 - - 29 . . . .

D.M. Blei , , , J.D. Lafferty . . Dynamic topic models. Proc. 23rd ACM Int. Conf . . on Machine Learning , , 2006 . . 113 - - 120 . . DOI: 10.1145/1143844.1143859 http://doi.org/10.1145/1143844.1143859 . .

D.M. Blei , , , A.Y. Ng , , , M.I. Jordan . . Latent Dirichlet allocation . . J. Mach. Learn. Res , , 2003 . . 3 - - 1022 . . . .

B.S. Brin , , , L. Page . . The anatomy of a large scale hypertextual web search engine . . Comput. Netw. ISDN Syst , , 1998 . . 30 ( ( 98 ): ): 107 - - 117 . . DOI: 10.1016/S0169-7552(98)00110-X http://doi.org/10.1016/S0169-7552(98)00110-X . .

J. Chang , , , D.M. Blei . . Relational topic models for document networks . . Proc. 12th Int. Conf. on Artificial Intelligence and Statistics , , 2009 . . 81 - - 88 . . . .

D. Cohn , , , H. Chang . . Learning to probabilistically identify authoritative documents . . Proc. 17th Int. Conf. on Machine Learning , , 2000 . . 167 - - 174 . . . .

L. Dietz , , , S. Bickel , , , T. Scheffer . . Unsupervised prediction of citation influences . . Proc. 24th ACM Int. Conf. on Machine Learning , , 2007 . . 233 - - 240 . . DOI: 10.1145/1273496.1273526 http://doi.org/10.1145/1273496.1273526 . .

E. Erosheva , , , S. Fienberg , , , J. Lafferty . . Mixed-membership models of scientific publications . . PNAS , , 2004 . . 101 ( ( Suppl 1 ): ): 5220 - - 5227 . . DOI: 10.1073/pnas.0307760101 http://doi.org/10.1073/pnas.0307760101 . .

T.L. Griffiths , , , M. Steyvers . . Finding scientific topics . . PNAS , , 2004 . . 101 ( ( Suppl 1 ): ): 5228 - - 5235 . . DOI: 10.1073/pnas.0307752101 http://doi.org/10.1073/pnas.0307752101 . .

Z. Guo , , , Z. Zhang , , , S. Zhu , , , 等 . . A two-level topic model towards knowledge discovery from citation networks . . IEEE Trans. Knowl. Data Eng , , 2014 . . 26 ( ( 4 ): ): 780 - - 794 . . DOI: 10.1109/TKDE.2013.56 http://doi.org/10.1109/TKDE.2013.56 . .

Q. He , , , B. Chen , , , J. Pei , , , 等 . . Detecting topic evolution in scientific literature: how can citations help . . Proc. 18th ACM Conf. on Information and Knowledge Management , , 2009 . . 957 - - 966 . . DOI: 10.1145/1645953.1646076 http://doi.org/10.1145/1645953.1646076 . .

T. Hofmann . . Unsupervised learning by probabilistic latent semantic analysis . . Mach. Learn , , 2001 . . 42 ( ( 1-2 ): ): 177 - - 196 . . DOI: 10.1023/A:1007617005950 http://doi.org/10.1023/A:1007617005950 . .

F.R. Lin , , , F.M. Huang , , , C.H. Liang . . Individualized storyline-based news topic retrospection . . Pacific Asia Conf. on Information Systems, Article , , 2007 . . 140 . .

Z. Lu , , , N. Mamoulis , , , D.W. Cheung . . A collective topic model for milestone paper discovery . . Proc. 37th Int. ACM SIGIR Conf. on Research & Development in Information Retrieval , , 2014 . . 1019 - - 1022 . . DOI: 10.1145/2600428.2609499 http://doi.org/10.1145/2600428.2609499 . .

M.H. Macroberts , , , B.R. Macroberts . . Problems of citation analysis: a critical review . . J. Am. Soc. Inform. Sci , , 1989 . . 40 ( ( 5 ): ): 342 - - 349 . . DOI: 10.1002/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U http://doi.org/10.1002/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U . .

Q. Mei , , , C. Zhai . . Discovering evolutionary theme patterns from text: an exploration of temporal text mining . . Proc. 11th ACM SIGKDD Int. Conf. on Knowledge Discovery in Data Mining , , 2005 . . 198 - - 207 . . DOI: 10.1145/1081870.1081895 http://doi.org/10.1145/1081870.1081895 . .

Q. Mei , , , D. Cai , , , D. Zhang , , , 等 . . Topic modeling with network regularization . . Proc. 17th Int. Conf. on World Wide Web , , 2008 . . 101 - - 110 . . DOI: 10.1145/1367497.1367512 http://doi.org/10.1145/1367497.1367512 . .

R. Nallapati , , , W.W. Cohen . . Link-PLSA-LDA: a new unsupervised model for topics and influence of blogs . . Proc. 2nd Int. Conf. on Weblogs and Social Media , , 2008 . . 84 - - 92 . . . .

R.M. Nallapati , , , A. Ahmed , , , E.P. Xing , , , 等 . . Joint latent topic models for text and citations . . Proc. 14th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining , , 2008 . . 542 - - 550 . . DOI: 10.1145/1401890.1401957 http://doi.org/10.1145/1401890.1401957 . .

X.L. Wang , , , C.X. Zhai , , , D. Roth . . Understanding evolution of research themes: a probabilistic generative model for citations . . Proc. 19th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining , , 2013 . . 1115 - - 1123 . . DOI: 10.1145/2487575.2487698 http://doi.org/10.1145/2487575.2487698 . .

X.R. Wang , , , A. McCallum . . Topics over time: a non-Markov continuous-time model of topical trends . . Proc. 12th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining , , 2006 . . 424 - - 433 . . DOI: 10.1145/1150402.1150450 http://doi.org/10.1145/1150402.1150450 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰