基于机器学习的抄袭源检索的查询生成方法

孔蕾蕾; 卢志茂; 齐浩亮; 韩中元

doi:10.1631/FITEE.1601344

Your Location：

Home >

Browse articles >

基于机器学习的抄袭源检索的查询生成方法

常规文章 | Updated：2022-05-19

- 基于机器学习的抄袭源检索的查询生成方法
- A machine learning approach to query generation in plagiarism source retrieval
- 信息与电子工程前沿（英文） 2017年18卷第10期页码：1556-1572
- Affiliations：
  
  College of Information and Communication Engineering, Harbin Engineering University, Harbin 150001, China
  School of Computer Science and Technology, Heilongjiang Institute of Technology, Harbin 150050, China
  State Key Laboratory of Digital Publishing Technology, Beijing 100871, China
- Author bio：
  
  [ "KONG Lei-lei, E-mail: kongleilei1979@gmail.com" ]
  QI Hao-liang, E-mail: haoliang.qi@gmail.com
- Funds：
  
  Project supported by the National Social Science Foundation of China (No. 14CTQ032) and the National Natural Science Foundation of China (No. 61370170)
- DOI：10.1631/FITEE.1601344
  中图分类号： TP391.3
- 收稿：2016-06-17，
  
  修回：2017-11-;1，
  
  纸质出版：2017-10
- Accepted：
Scan QR Code
孔蕾蕾, 卢志茂, 齐浩亮, 等. 基于机器学习的抄袭源检索的查询生成方法[J]. 信息与电子工程前沿（英文）, 2017,18(10):1556-1572.

Lei-lei KONG, Zhi-mao LU, Hao-liang QI, et al. A machine learning approach to query generation in plagiarism source retrieval[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(10): 1556-1572.
孔蕾蕾, 卢志茂, 齐浩亮, 等. 基于机器学习的抄袭源检索的查询生成方法[J]. 信息与电子工程前沿（英文）, 2017,18(10):1556-1572. DOI： 10.1631/FITEE.1601344.

Lei-lei KONG, Zhi-mao LU, Hao-liang QI, et al. A machine learning approach to query generation in plagiarism source retrieval[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(10): 1556-1572. DOI： 10.1631/FITEE.1601344.

摘要

抄袭源检索是抄袭检测的核心任务。使用从可疑文档提取的查询来检索抄袭源已成为抄袭源检索的标准方法。从可疑文档生成查询是源检索最重要的步骤。当前研究主要使用了基于启发式的查询生成方法。然而，每个启发式方法都有其优点，不同方法生成的查询可以获得不同的源检索结果，没有一种方法生成的查询的源检索性能可以在所有的文本片段上具有统计有效性地优于其他方法。这使得基于启发式的源检索查询生成方法的性能改善主要依赖专家经验。因此，很难开发一种可以克服现有启发式方法的新方法。本文提出使用统计机器学习方法解决源检索的查询生成问题，将源检索的查询生成形式化到一个排序学习的框架下，从备选查询中选择有利于提高源检索性能的查询，力争在每个可疑文档片段上获得最优的源检索性能。据我们所知，这是第一项应用机器学习方法解决源检索查询生成问题的工作。为了解决排序学习训练用例的缺失，提出了基于现有源检索语料构建查询生成语料的方法。在PAN抄袭源检索评测数据上的试验结果证明了该方法具有统计意义地优于多个基线方法。

Abstract

Plagiarism source retrieval is the core task of plagiarism detection. It has become the standard for plagiarism detection to use the queries extracted from suspicious documents to retrieve the plagiarism sources. Generating queries from a suspicious document is one of the most important steps in plagiarism source retrieval. Heuristic-based query generation methods are widely used in the current research. Each heuristic-based method has its own advantages

and no one statistically outperforms the others on all suspicious document segments when generating queries for source retrieval. Further improvements on heuristic methods for source retrieval rely mainly on the experience of experts. This leads to difficulties in putting forward new heuristic methods that can overcome the shortcomings of the existing ones. This paper paves the way for a new statistical machine learning approach to select the best queries from the candidates. The statistical machine learning approach to query generation for source retrieval is formulated as a ranking framework. Specifically

it aims to achieve the optimal source retrieval performance for each suspicious document segment. The proposed method exploits learning to rank to generate queries from the candidates. To our knowledge

our work is the first research to apply machine learning methods to resolve the problem of query generation for source retrieval. To solve the essential problem of an absence of training data for learning to rank

the building of training samples for source retrieval is also conducted. We rigorously evaluate various aspects of the proposed method on the publicly available PAN source retrieval corpus. With respect to the established baselines

the experimental results show that applying our proposed query generation method based on machine learning yields statistically significant improvements over baselines in source retrieval effectiveness.

关键词

Keywords

references

S.M. Alzahrani , , , N. Salim , , , A. Abraham . . Understanding plagiarism linguistic patterns, textual features, and detection methods . . IEEE Trans. Syst. Man Cybern. C , , 2012 . . 42 ( ( 2 ): ): 133 - - 149 . . DOI: 10.1109/TSMCC.2011.2134847 http://doi.org/10.1109/TSMCC.2011.2134847 . .

A. Barrón-Cedeo , , , M. Vila , , , Martí , , , A. M. , , , 等 . . Plagiarism meets paraphrasing: insights for the next generation in automatic plagiarism detection . . Comput. Ling. , , 2013 . . 39 ( ( 4 ): ): 917 - - 947 . . DOI: 10.1162/COLI_a_00153 http://doi.org/10.1162/COLI_a_00153 . .

Y. Cao , , , J. Xu , , , T.Y. Liu , , , 等 . . Adapting ranking SVM to document retrieval . . Proc. 29th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval , , 2006 . . 186 - - 193 . . DOI: 10.1145/1148170.1148205 http://doi.org/10.1145/1148170.1148205 . .

C. Cortes , , , V. Vapnik . . Support-vector networks . . Mach. Learn. , , 1995 . . 20 ( ( 3 ): ): 273 - - 297 . . DOI: 10.1023/A:1022627411411 http://doi.org/10.1023/A:1022627411411 . .

V. Elizalde . . Using statistic and semantic analysis to detect plagiarism——notebook for PAN at CLEF 2013 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2013 . . .

L. Gillam . . Guess again and see if they line up: surrey's runs at plagiarism detection——notebook for PAN at CLEF 2013 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2013 . . .

M. Hagen , , , M. Potthast , , , B. Stein . . Source retrieval for plagiarism detection from large web corpora: recent approaches . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2015 . . .

O. Haggag , , , S. El-Beltagy . . Plagiarism candida-te retrieval using selective query formulation and discriminative query scoring——notebook for PAN at CLEF 2013 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2013 . . .

T. Hastie , , , R. Tibshirani , , , J. Friedman . . The Elements of Statistical Learning: Data Mining, Inference and Prediction , , : : Boca Raton CRC Press , , 2001 . . .

R. Herbrich , , , T. Graepel , , , K. Obermayer . . Large margin rank boundaries for ordinal regression . . In: Smola A.J., Bartlett P., Schlkopf B., et al. (Eds.), Advances in Large Margin Classifiers. MIT Press, Cambridge , , 2000 . . 115 - - 132 . . . .

K.U. Hffgen , , , H.U. Simon , , , K.S. Vanhorn . . Robust trainability of single neurons . . J. Comput. Syst. Sci. , , 1995 . . 50 ( ( 1 ): ): 114 - - 125 . . DOI: 10.1006/jcss.1995.1011 http://doi.org/10.1006/jcss.1995.1011 . .

A. Jayapal . . Similarity overlap metric and greedy string tiling at PAN 2012: plagiarism detection——notebook for PAN at CLEF 2012 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2012 . . .

T. Joachims . . Optimizing search engines using clickthrough data . . Proc. 8th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining , , 2002 . . 133 - - 142 . . DOI: 10.1145/775047.775067 http://doi.org/10.1145/775047.775067 . .

L.L. Kong , , , H.L. Qi , , , S. Wang , , , 等 . . Approaches for candidate document retrieval and detailed comparison of plagiarism detection——notebook for PAN at CLEF 2012 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2012 . . .

T. Lee , , , J. Chae , , , K. Park , , , 等 . . CopyCaptor: plagiarized source retrieval system using global word frequency and local feedback——notebook for PAN at CLEF 2013 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2013 . . .

R. Nallapati . . Discriminative models for information retrieval . . Proc. 27th Annual ACM SIGIR Int. Conf. on Research and Development in Information Retrieval , , 2004 . . 64 - - 71 . . DOI: 10.1145/1008992.1009006 http://doi.org/10.1145/1008992.1009006 . .

M. Potthast , , , T. Gollub , , , M. Hagen , , , 等 . . Overview of the 4th International Competition on Plagiarism Detection . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2012a . . .

M. Potthast , , , M. Hagen , , , B. Stein , , , 等 . . ChatNoir: a search engine for the ClueWeb09 corpus . . Proc. 35th Int. ACM SIGIR Conf. on Research and Development in Information Retrieval , , 2012b . . 1004 DOI: 10.1145/2348283.2348429 http://doi.org/10.1145/2348283.2348429 . .

M. Potthast , , , M. Hagen , , , T. Gollub , , , 等 . . Overview of the 5th International Competition on Plagiarism Detection . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2013a . . .

M. Potthast , , , M. Hagen , , , M. Vlske , , , 等 . . Crowdsourcing interaction logs to understand text reuse from the web . . Proc. 51st ACM Annual Meeting of the Association of Computational Linguistics , , 2013b . . 1212 - - 1221 . . . .

M. Potthast , , , M. Hagen , , , A. Beyer , , , 等 . . Overview of the 6th International Competition on Plagiarism Detection . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2014 . . .

A. Prakash , , , S. Saha . . Experiments on document chunking and query formation for plagiarism source retrieval——notebook for PAN at CLEF 2014 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2014 . . .

J. Rafiei , , , S. Mohtaj , , , V. Zarrabi , , , 等 . . Source retrieval plagiarism detection based on noun phrase and keyword phrase extraction——notebook for PAN at CLEF 2015 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2015 . . .

S.E. Robertson . . Overview of the Okapi projects . . J. Docum , , 1997 . . 53 ( ( 1 ): ): 3 - - 7 . . DOI: 10.1108/EUM0000000007186 http://doi.org/10.1108/EUM0000000007186 . .

. Suchomel , , , M. Brandejs . . Improving synoptic querying for source retrieval——notebook for PAN at CLEF 2015 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2015 . . .

K. Toutanova , , , D. Klein , , , C.D. Manning , , , 等 . . Feature-rich part-of-speech tagging with a cyclic dependency network . . Proc. Conf. of the North American Chapter of the Association for Computational Linguistics on Human Language Technology , , 2003 . . 173 - - 180 . . DOI: 10.3115/1073445.1073478 http://doi.org/10.3115/1073445.1073478 . .

K. Williams , , , H.H. Chen , , , S.R. Choudhury , , , 等 . . Unsupervised ranking for plagiarism source retrieval—— notebook for PAN at CLEF 2013 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2013 . . .

K. Williams , , , H.H. Chen , , , C.L. Giles . . Supervised ranking for plagiarism source retrieval——notebook for PAN at CLEF 2014 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2014a . . .

K. Williams , , , H.H. Chen , , , C.L. Giles . . Classifying and ranking search engine results as potential sources of plagiarism . . Proc. ACM Symp. on Document Engineering , , 2014b . . 97 - - 106 . . DOI: 10.1145/2644866.2644879 http://doi.org/10.1145/2644866.2644879 . .

D. Zubarev , , , I. Sochenkov . . Using sentence similarity measure for plagiarism source retrieval——notebook for PAN at CLEF 2014 . . Proc. CLEF Evaluation Labs and Workshop, Working Notes Papers , , 2014 . . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

Domain adaptation in reinforcement learning: a comprehensive and systematic study

Towards sustainable adversarial training with successive perturbation generation

Advances and challenges in artificial intelligence text generation

A disk failure prediction model for multiple issues

Data-driven soft sensors in blast furnace ironmaking: a survey