Discovering semantically related technical terms and web resources in Q&amp;A discussions

Junfang JIA; Valeriia TUMANIAN; Guoqiang LI

doi:10.1631/FITEE.2000186

Your Location：

Home >

Browse articles >

Discovering semantically related technical terms and web resources in Q&A discussions

Regular Papers | Updated：2021-11-25

- Discovering semantically related technical terms and web resources in Q&A discussions
- 从问答讨论中发现语义相关的技术术语和网络资源
- Frontiers of Information Technology & Electronic Engineering Vol. 22, Issue 7, Pages: 969-985(2021)
- Affiliations：
  
  School of Computer and Network Engineering, Shanxi Datong University, Datong 037009, China
  School of Software, Shanghai Jiao Tong University, Shanghai 200240, China
- Author bio：
  
  Guoqiang LI, E-mail: li.g@sjtu.edu.cn
- Funds：
- DOI：10.1631/FITEE.2000186
  CLC： TP311
- Received：21 April 2020，
  
  Revised：2021-;6-16，
  
  Accepted：23 December 2020，
  
  Published：2021-07
- Accepted：
Scan QR Code
Junfang JIA, Valeriia TUMANIAN, Guoqiang LI. Discovering semantically related technical terms and web resources in Q&A discussions[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(7): 969-985.
DOI：

Junfang JIA, Valeriia TUMANIAN, Guoqiang LI. Discovering semantically related technical terms and web resources in Q&A discussions[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(7): 969-985. DOI： 10.1631/FITEE.2000186.

摘要

目前网络上拥有大量可用于软件工程实践的技术和网络资源，并且这个数量还在持续增长。发现语义相似或相关的技术术语和网络资源，可以设计吸引人的服务，以促进信息检索和信息发现的机会。本文从问答（Q

A）讨论的社区中提取技术术语和网络资源，并提出一种基于神经网络语言模型的技术术语和网络资源在联合低维向量空间中的语义表示方法。方法仅基于讨论线程中技术术语（或网络资源）的周围技术术语和web资源，将技术术语和网络资源映射到语义向量空间，而不需挖掘讨论的文本内容。将方法应用于2018年3月的堆栈溢出数据转储。对聚类、搜索和语义推理任务的定量和定性分析表明，所学习的技术术语和网络资源向量表示可以捕获技术术语和网络资源的语义相关性，通过简单的

近邻搜索和在嵌入空间中对学习的向量表示作简单的代数运算，可以支持各种搜索和语义推理任务。

Abstract

A sheer number of techniques and web resources are available for software engineering practice and this number continues to grow. Discovering semantically similar or related technical terms and web resources offers the opportunity to design appealing services to facilitate information retrieval and information discovery. In this study

we extract technical terms and web resources from a community of question and answer (Q

A) discussions and propose an approach based on a neural language model to learn the semantic representations of technical terms and web resources in a joint low-dimensional vector space. Our approach maps technical terms and web resources to a semantic vector space based only on the surrounding technical terms and web resources of a technical term (or web resource) in a discussion thread

without the need for mining the text content of the discussion. We apply our approach to Stack Overflow data dump of March 2018. Through both quantitative and qualitative analyses in the clustering

and semantic reasoning tasks

we show that the learnt technical-term and web-resource vector representations can capture the semantic relatedness of technical terms and web resources

and they can be exploited to support various search and semantic reasoning tasks

by means of simple

-nearest neighbor search and simple algebraic operations on the learnt vector representations in the embedding space.

关键词

Keywords

references

R Agrawal , , , T Imieliński , , , A Swami . . Mining association rules between sets of items in large databases . . ACM SIGMOD Rec , , 1993 . . 22 ( ( 2 ): ): 207 - - 216 . . DOI: 10.1145/170036.170072 http://doi.org/10.1145/170036.170072 . .

M Bansal , , , K Gimpel , , , K Livescu . . Tailoring continuous word representations for dependency parsing . . Proc $52^{\rm nd}$ Annual Meeting of the Association for Computational Linguistics , , 2014 . . p.809 - - 815 . . DOI: 10.3115/v1/P14-2131 http://doi.org/10.3115/v1/P14-2131 . .

M Baroni , , , G Dinu , , , G Kruszewski . . Don't count, predict . . A systematic comparison of context-counting vs. context-predicting semantic vectors. Proc $52^{\rm nd}$ Annual Meeting of the Association for Computational Linguistics , , 2014 . . p.238 - - 247 . . DOI: 10.3115/v1/P14-1023 http://doi.org/10.3115/v1/P14-1023 . .

A Barua , , , SW Thomas , , , AE Hassan . . What are developers talking about . . An analysis of topics and trends in Stack Overflow. Empir Softw Eng , , 2014 . . 19 ( ( 3 ): ): 619 - - 654 . . DOI: 10.1007/s10664-012-9231-y http://doi.org/10.1007/s10664-012-9231-y . .

DM Blei , , , AY Ng , , , MI Jordan . . Latent Dirichlet allocation . . J Mach Learn Res , , 2003 . . 3 ( ( 4-5 ): ): 993 - - 1022 . . . .

JA Bullinaria , , , JP Levy . . Extracting semantic representations from word co-occurrence statistics: stop-lists, stemming, and SVD . . Behav Res Methods , , 2012 . . 44 ( ( 3 ): ): 890 - - 907 . . DOI: 10.3758/s13428-011-0183-8 http://doi.org/10.3758/s13428-011-0183-8 . .

WL Chen , , , Y Zhang , , , M Zhang . . Feature embedding for dependency parsing . . Proc $25^{\rm th}$ Int Conf on Computational Linguistics , , 2014 . . p.816 - - 826 . . . .

R Collobert , , , J Weston , , , L Bottou , , , 等 . . Natural language processing (almost) from scratch . . J Mach Learn Res , , 2011 . . 12 2493 - - 2537 . . . .

M Grbovic , , , N Djuric , , , V Radosavljevic , , , 等 . . Context-and content-aware embeddings for query rewriting in sponsored search . . Proc $38^{\rm th}$ Int ACM SIGIR Conf on Research and Development in Information Retrieval , , 2015 . . p.383 - - 392 . . DOI: 10.1145/2766462.2767709 http://doi.org/10.1145/2766462.2767709 . .

SRB Gummidi , , , XK Xie , , , TB Pedersen . . A survey of spatial crowdsourcing . . ACM Trans Database Syst , , 2019 . . 44 ( ( 2 ): ): 8 DOI: 10.1145/3291933 http://doi.org/10.1145/3291933 . .

MU Gutmann , , , A Hyvärinen . . Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics . . J Mach Learn Res , , 2012 . . 13 ( ( 1 ): ): 307 - - 361 . . . .

ZS Harris . . Distributional structure . . Word , , 1954 . . 10 146 - - 162 . . . .

LJ Hong , , , BD Davison . . Empirical study of topic modeling in Twitter . . Proc $1^{\rm st}$ Workshop on Social Media Analytics , , 2010 . . p.80 - - 88 . . DOI: 10.1145/1964858.1964870 http://doi.org/10.1145/1964858.1964870 . .

Q Huang , , , X Xia , , , ZC Xing , , , 等 . . API method recommendation without worrying about the task-API knowledge gap . . Proc $33^{\rm rd}$ ACM/IEEE Int Conf on Automated Software Engineering , , 2018 . . p.293 - - 304 . . DOI: 10.1145/3238147.3238191 http://doi.org/10.1145/3238147.3238191 . .

JF Jia , , , GQ Li . . Learning natural ordering of tags in domain-specific Q&A sites . . Front Inform Technol Electron Eng , , 2021 . . 22 ( ( 2 ): ): 170 - - 184 . . DOI: 10.1631/FITEE.1900645 http://doi.org/10.1631/FITEE.1900645 . .

JF Jia , , , V Tumanian , , , GQ Li . . In favour of or against multi-lingual Q&A sites . . Exploring the evidence from user and knowledge perspectives. Behav Inform Technol , , 2020 . . p.1 - - 16 . . DOI: 10.1080/0144929X.2020.1752308 http://doi.org/10.1080/0144929X.2020.1752308 . .

O Levy , , , Y Goldberg . . Dependency-based word embeddings . . Proc $52^{\rm nd}$ Annual Meeting of the Association for Computational Linguistics , , 2014a . . p.302 - - 308 . . DOI: 10.3115/v1/P14-2050 http://doi.org/10.3115/v1/P14-2050 . .

O Levy , , , Y Goldberg . . Linguistic regularities in sparse and explicit word representations . . Proc $18^{\rm th}$ Conf on Computational Natural Language Learning , , 2014b . . p.171 - - 180 . . DOI: 10.3115/v1/W14-1618 http://doi.org/10.3115/v1/W14-1618 . .

O Levy , , , Y Goldberg . . Neural word embedding as implicit matrix factorization . . Proc $27^{\rm th}$ Int Conf on Neural Information Processing Systems , , 2014c . . p.2177 - - 2185 . . . .

O Levy , , , Y Goldberg , , , I Dagan . . Improving distributional similarity with lessons learned from word embeddings . . Trans Assoc Comput Ling , , 2015 . . 3 211 - - 225 . . DOI: 10.1162/tacl_a_00134 http://doi.org/10.1162/tacl_a_00134 . .

J Li , , , ZC Xing , , , AX Sun . . LinkLive: discovering web learning resources for developers from Q&A discussions . . World Wide Web , , 2019 . . 22 ( ( 4 ): ): 1699 - - 1725 . . DOI: 10.1007/s11280-018-0621-y http://doi.org/10.1007/s11280-018-0621-y . .

J MacQueen . . Some methods for classification and analysis of multivariate observations . . Proc $5^{\rm th}$ Berkeley Symp on Mathematical Statistics and Probability , , 1967 . . p.281 - - 297 . . . .

T Mikolov , , , I Sutskever , , , K Chen , , , 等 . . Distributed representations of words and phrases and their compositionality . . Proc $26^{\rm th}$ Int Conf on Neural Information Processing Systems , , 2013a . . p.3111 - - 3119 . . . .

T Mikolov , , , K Chen , , , G Corrado , , , 等 . . Efficient estimation of word representations in vector space , , 2013b . . https://arxiv.org/abs/1301.3781 https://arxiv.org/abs/1301.3781 , , . .

B Mitra . . Exploring session context using distributed representations of queries and reformulations . . Proc $38^{\rm th}$ Int ACM SIGIR Conf on Research and Development in Information Retrieval , , 2015 . . p.3 - - 12 . . DOI: 10.1145/2766462.2767702 http://doi.org/10.1145/2766462.2767702 . .

A Passos , , , V Kumar , , , A McCallum . . Lexicon infused phrase embeddings for named entity resolution , , 2014 . . https://arxiv.org/abs/1404.5367 https://arxiv.org/abs/1404.5367 , , . .

SY Qiu , , , Q Cui , , , J Bian , , , 等 . . Co-learning of word representations and morpheme representations . . Proc $25^{\rm th}$ Int Conf on Computational Linguistics , , 2014 . . p.141 - - 150 . . . .

WM Rand . . Objective criteria for the evaluation of clustering methods . . J Am Stat Assoc , , 1971 . . 66 ( ( 336 ): ): 846 - - 850 . . . .

XX Ren , , , ZC Xing , , , X Xia , , , 等 . . Discovering, explaining and summarizing controversial discussions in community Q&A sites . . Proc $34^{\rm th}$ IEEE/ACM Int Conf on Automated Software Engineering , , 2019 . . p.151 - - 162 . . DOI: 10.1109/ASE.2019.00024 http://doi.org/10.1109/ASE.2019.00024 . .

M Robillard , , , R Walker , , , T Zimmermann . . Recommendation systems for software engineering . . IEEE Softw , , 2010 . . 27 ( ( 4 ): ): 80 - - 86 . . DOI: 10.1109/MS.2009.161 http://doi.org/10.1109/MS.2009.161 . .

C Rosen , , , E Shihab . . What are mobile developers asking about . . A large scale study using Stack OverFlow. Empir Softw Eng , , 2015 . . 21 ( ( 3 ): ): 1192 - - 1223 . . DOI: 10.1007/s10664-015-9379-3 http://doi.org/10.1007/s10664-015-9379-3 . .

J Sillito , , , F Maurer , , , SM Nasehi , , , 等 . . What makes a good code example?: a study of programming Q&A in StackOverflow . . Proc IEEE Int Conf on Software Maintenance , , 2012 . . p.25 - - 34 . . DOI: 10.1109/ICSM.2012.6405249 http://doi.org/10.1109/ICSM.2012.6405249 . .

Y Tian , , , D Lo , , , J Lawall . . Automated construction of a software-specific word similarity database . . Proc Software Evolution Week-IEEE Conf on Software Maintenance, Reengineering, and Reverse Engineering , , 2014a . . p.44 - - 53 . . DOI: 10.1109/CSMR-WCRE.2014.6747213 http://doi.org/10.1109/CSMR-WCRE.2014.6747213 . .

Y Tian , , , D Lo , , , J Lawall . . SEWordSim: software-specific word similarity database . . Companion Proc $36^{\rm th}$ Int Conf on Software Engineering , , 2014b . . p.568 - - 571 . . DOI: 10.1145/2591062.2591071 http://doi.org/10.1145/2591062.2591071 . .

SW Wang , , , D Lo , , , LX Jiang . . Inferring semantically related software terms and their taxonomy by leveraging collaborative tagging . . Proc $28^{\rm th}$ IEEE Int Conf on Software Maintenance , , 2012 . . p.604 - - 607 . . DOI: 10.1109/ICSM.2012.6405332 http://doi.org/10.1109/ICSM.2012.6405332 . .

SW Wang , , , D Lo , , , LX Jiang . . An empirical study on developer interactions in Stack Overflow . . Proc $28^{\rm th}$ Annual ACM Symp on Applied Computing , , 2013 . . p.1019 - - 1024 . . DOI: 10.1145/2480362.2480557 http://doi.org/10.1145/2480362.2480557 . .

X Xia , , , LF Bao , , , D Lo , , , 等 . . What do developers search for on the web . . Empir Softw Eng , , 2017 . . 22 ( ( 6 ): ): 3149 - - 3185 . . DOI: 10.1007/s10664-017-9514-4 http://doi.org/10.1007/s10664-017-9514-4 . .

XK Xie , , , P Jin , , , ML Yiu , , , 等 . . Enabling scalable geographic service sharing with weighted imprecise Voronoi cells . . IEEE Trans Knowl Data Eng , , 2016 . . 28 ( ( 2 ): ): 439 - - 453 . . DOI: 10.1109/TKDE.2015.2464804 http://doi.org/10.1109/TKDE.2015.2464804 . .

XK Xie , , , X Lin , , , JL Xu , , , 等 . . Reverse keyword-based location search . . Proc IEEE $33^{\rm rd}$ Int Conf on Data Engineering , , 2017 . . p.375 - - 386 . . DOI: 10.1109/ICDE.2017.96 http://doi.org/10.1109/ICDE.2017.96 . .

BW Xu , , , ZC Xing , , , X Xia , , , 等 . . AnswerBot: automated generation of answer summary to developers' technical questions . . Proc $32^{\rm nd}$ IEEE/ACM Int Conf on Automated Software Engineering , , 2017 . . p.706 - - 716 . . DOI: 10.1109/ASE.2017.8115681 http://doi.org/10.1109/ASE.2017.8115681 . .

C Xu , , , YL Bai , , , J Bian , , , 等 . . RC-NET: a general framework for incorporating knowledge into word representations . . Proc $23^{\rm rd}$ ACM Int Conf on Information and Knowledge Management , , 2014 . . p.1219 - - 1228 . . DOI: 10.1145/2661829.2662038 http://doi.org/10.1145/2661829.2662038 . .

JQ Yang , , , L Tan . . SWordNet: inferring semantically related words from software context . . Empir Softw Eng , , 2014 . . 19 ( ( 6 ): ): 1856 - - 1886 . . DOI: 10.1007/s10664-013-9264-x http://doi.org/10.1007/s10664-013-9264-x . .

Views

101

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰

Discovering semantically related technical terms and web resources in Q&A discussions

DOI：10.1631/FITEE.2000186

摘要

Abstract

关键词

Keywords

references