一种面向软件缺陷预测的相似性度量特征选择方法

于巧; 姜淑娟; 王荣存; 王红阳

doi:10.1631/FITEE.1601322

Your Location：

Home >

Browse articles >

一种面向软件缺陷预测的相似性度量特征选择方法

常规文章 | Updated：2022-05-19

- 一种面向软件缺陷预测的相似性度量特征选择方法
- A feature selection approach based on a similarity measure for software defect prediction
- 信息与电子工程前沿（英文） 2017年18卷第11期页码：1744-1753
- Affiliations：
  
  School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China
  Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, China
- Author bio：
  
  [ "Qiao YU, E-mail: yuqiao@cumt.edu.cn" ]
  Shu-juan JIANG, E-mail: shjjiang@cumt.edu.cn
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 61673384 and 61502497), the Guangxi Key Laboratory of Trusted Software (No. kx201530), the China Postdoctoral Science Foundation (No. 2015M581887), and the Scientific Research Innovation Project for Graduate Students of Jiangsu Province, China (No. KYLX15_1443)
- DOI：10.1631/FITEE.1601322
  中图分类号： TP311
- 收稿：2016-06-11，
  
  修回：2017-11-26，
  
  纸质出版：2017-11
- Accepted：
Scan QR Code
于巧, 姜淑娟, 王荣存, 等. 一种面向软件缺陷预测的相似性度量特征选择方法[J]. 信息与电子工程前沿（英文）, 2017,18(11):1744-1753.

Qiao YU, Shu-juan JIANG, Rong-cun WANG, et al. A feature selection approach based on a similarity measure for software defect prediction[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1744-1753.
于巧, 姜淑娟, 王荣存, 等. 一种面向软件缺陷预测的相似性度量特征选择方法[J]. 信息与电子工程前沿（英文）, 2017,18(11):1744-1753. DOI： 10.1631/FITEE.1601322.

Qiao YU, Shu-juan JIANG, Rong-cun WANG, et al. A feature selection approach based on a similarity measure for software defect prediction[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1744-1753. DOI： 10.1631/FITEE.1601322.

摘要

软件缺陷预测旨在通过历史数据和能反映软件模块特性的软件特征来发现潜在缺陷。然而，有的特征可能与类别（有缺陷或无缺陷）的相关性较高，有的特征可能是冗余的或无关的。针对软件缺陷预测中不同特征与类别的相关性差异，本文提出一种基于相似性度量（similarity measure

SM）的特征选择方法。首先，根据不同类样本间的相似性来更新特征权重；然后，按照特征权重值降序排列生成特征排序列表，并依次选取特征排序列表中的所有特征子集；最后，在KNN（

-nearest neighbor）模型上验证所有特征子集的分类性能，并采用AUC（areaunder curve）指标进行度量。在11个美国航空航天局（NASA）数据集上进行实验验证，结果表明，与其它四种特征选择方法相比，本文方法具有与之相当甚至更高的分类性能。

Abstract

Software defect prediction is aimed to find potential defects based on historical data and software features. Software features can reflect the characteristics of software modules. However

some of these features may be more relevant to the class (defective or non-defective)

but others may be redundant or irrelevant. To fully measure the correlation between different features and the class

we present a feature selection approach based on a similarity measure (SM) for software defect prediction. First

the feature weights are updated according to the similarity of samples in different classes. Second

a feature ranking list is generated by sorting the feature weights in descending order

and all feature subsets are selected from the feature ranking list in sequence. Finally

all feature subsets are evaluated on a

-nearest neighbor (KNN) model and measured by an area under curve (AUC) metric for classification performance. The experiments are conducted on 11 National Aeronautics and Space Administration (NASA) datasets

and the results show that our approach performs better than or is comparable to the compared feature selection approaches in terms of classification performance.

关键词

Keywords

references

D.W. Aha , , , D. Kibler , , , M.K. Albert . . Instance-based learning algorithms . . Mach. Learn. , , 1991 . . 6 ( ( 1 ): ): 37 - - 66 . . DOI: 10.1007/BF00153759 http://doi.org/10.1007/BF00153759 . .

C. Catal , , , B. Diri . . Investigating the effect of dataset size, metrics sets, and feature selection techniques on software fault prediction problem . . Inform. Sci. , , 2009 . . 179 ( ( 8 ): ): 1040 - - 1058 . . DOI: 10.1016/j.ins.2008.12.001 http://doi.org/10.1016/j.ins.2008.12.001 . .

W. Duch , , , T. Wieczorek , , , J. Biesiada , , , 等 . . Comparison of feature ranking methods based on information entropy . . Int. Joint Conf. on Neural Networks , , 2004 . . p.1415 - - 1419 . . DOI: 10.1109/IJCNN.2004.1380157 http://doi.org/10.1109/IJCNN.2004.1380157 . .

M. Galar , , , A. Fernández , , , E. Barrenechea , , , 等 . . A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches . . IEEE Trans. Syst. Man Cybern. Part C , , 2012 . . 42 ( ( 4 ): ): 463 - - 484 . . DOI: 10.1109/TSMCC.2011.2161285 http://doi.org/10.1109/TSMCC.2011.2161285 . .

K. Gao , , , T.M. Khoshgoftaar , , , H. Wang , , , 等 . . Choosing software metrics for defect prediction: an investigation on feature selection techniques . . Softw. Pract. Exper. , , 2011 . . 41 ( ( 5 ): ): 579 - - 606 . . DOI: 10.1002/spe.1043 http://doi.org/10.1002/spe.1043 . .

A.S. Ghareb , , , A.A. Bakar , , , A.R. Hamdan . . Hybrid feature selection based on enhanced genetic algorithm for text categorization . . Expert Syst. Appl. , , 2016 . . 49 31 - - 47 . . DOI: 10.1016/j.eswa.2015.12.004 http://doi.org/10.1016/j.eswa.2015.12.004 . .

D. Gray , , , D. Bowes , , , N. Davey , , , 等 . . The misuse of the NASA metrics data program data sets for automated software defect prediction . . Int. Conf. on Evaluation and Assessment in Software Engineering , , 2011 . . p.96 - - 103 . . DOI: 10.1049/ic.2011.0012 http://doi.org/10.1049/ic.2011.0012 . .

I. Guyon , , , A. Elisseeff . . An introduction to variable and feature selection . . J. Mach. Learn. Res. , , 2003 . . 3 1157 - - 1182 . . . .

M.A. Hall . . Correlation-Based Feature Selection for Machine Learning , , : : Hamilton, New Zealand University of Waikato , , 1999 . . .

M.H. Halstead . . Elements of Software Science , , : : New York, USA Elsevier , , 1977 . . .

Y. Han , , , K. Park , , , D. Guan , , , 等 . . Topological similarity-based feature selection for graph classification . . Comput. J. , , 2013 . . 58 ( ( 9 ): ): 1884 - - 1893 . . DOI: 10.1093/comjnl/bxt123 http://doi.org/10.1093/comjnl/bxt123 . .

R.C. Holte . . Very simple classification rules perform well on most commonly used datasets . . Mach. Learn. , , 1993 . . 11 ( ( 1 ): ): 63 - - 90 . . DOI: 10.1023/A:1022631118932 http://doi.org/10.1023/A:1022631118932 . .

J. Huang , , , C.X. Ling . . Using AUC and accuracy in evaluating learning algorithms . . IEEE Trans. Knowl. Data Eng. , , 2005 . . 17 ( ( 3 ): ): 299 - - 310 . . DOI: 10.1109/TKDE.2005.50 http://doi.org/10.1109/TKDE.2005.50 . .

Y. Jiang , , , J. Lin , , , B. Cukic , , , 等 . . Variance analysis in software fault prediction models . . Int. Symp. on Software Reliability Engineering , , 2009 . . p.99 - - 108 . . DOI: 10.1109/ISSRE.2009.13 http://doi.org/10.1109/ISSRE.2009.13 . .

X. Jing , , , S. Ying , , , Z. Zhang , , , 等 . . Dictionary learning based software defect prediction . . Int. Conf. on Software Engineering , , 2014a . . p.414 - - 423 . . DOI: 10.1145/2568225.2568320 http://doi.org/10.1145/2568225.2568320 . .

X. Jing , , , Z. Zhang , , , S. Ying , , , 等 . . Software defect prediction based on collaborative representation classification . . Companion of Int. Conf. on Software Engineering , , 2014b . . p.632 - - 633 . . DOI: 10.1145/2591062.2591151 http://doi.org/10.1145/2591062.2591151 . .

X. Jing , , , F. Wu , , , X. Dong , , , 等 . . Heterogeneous cross-company defect prediction by unified metric representation and CCA-based transfer learning . . Joint Meeting on Foundations of Software Engineering , , 2015 . . p.496 - - 507 . . DOI: 10.1145/2786805.2786813 http://doi.org/10.1145/2786805.2786813 . .

A.G. Karegowda , , , A.S. Manjunath , , , M.A. Jayaram . . Comparative study of attribute selection using gain ratio and correlation based feature selection . . Int. J. Inform. Technol. Knowl. Manag. , , 2010 . . 2 ( ( 2 ): ): 271 - - 277 . . . .

T.M. Khoshgoftaar , , , K. Gao , , , A. Napolitano , , , 等 . . A comparative study of iterative and non-iterative feature selection techniques for software defect prediction . . Inform. Syst. Front. , , 2014 . . 16 ( ( 5 ): ): 801 - - 822 . . DOI: 10.1007/s10796-013-9430-0 http://doi.org/10.1007/s10796-013-9430-0 . .

K. Kira , , , L.A. Rendell . . A practical approach to feature selection . . Int. Workshop on Machine Learning , , 1992 . . p.2249 - - 256 . . . .

I. Kononenko . . Estimating attributes: analysis and extensions of RELIEF . . European Conf. on Machine Learning , , 1994 . . p.171 - - 182 . . DOI: 10.1007/3-540-57868-4_57 http://doi.org/10.1007/3-540-57868-4_57 . .

I.H. Laradji , , , M. Alshayeb , , , L. Ghouti . . Software defect prediction using ensemble learning on selected features . . Inform. Softw. Technol. , , 2015 . . 58 388 - - 402 . . DOI: 10.1016/j.infsof.2014.07.005 http://doi.org/10.1016/j.infsof.2014.07.005 . .

H. Liu , , , L. Yu . . Toward integrating feature selection algorithms for classification and clustering . . IEEE Trans. Knowl. Data Eng. , , 2005 . . 17 ( ( 4 ): ): 491 - - 502 . . DOI: 10.1109/TKDE.2005.66 http://doi.org/10.1109/TKDE.2005.66 . .

H. Liu , , , J. Sun , , , L. Liu , , , 等 . . Feature selection with dynamic mutual information . . Patt. Recogn. , , 2009 . . 42 ( ( 7 ): ): 1330 - - 1339 . . DOI: 10.1016/j.patcog.2008.10.028 http://doi.org/10.1016/j.patcog.2008.10.028 . .

H. Liu , , , H. Motoda , , , R. Setiono , , , 等 . . Feature selection: an ever evolving frontier in data mining . . Int. Workshop on Feature Selection in Data Mining , , 2010 . . 4 - - 13 . . . .

S. Liu , , , X. Chen , , , W. Liu , , , 等 . . FECAR: a feature selection framework for software defect prediction . . Annual Computer Software and Applications Conf. , , 2014 . . 426 - - 435 . . DOI: 10.1109/COMPSAC.2014.66 http://doi.org/10.1109/COMPSAC.2014.66 . .

T.J. McCabe . . A complexity measure . . IEEE Trans. Softw. Eng , , 1976 . . SE-2 ( ( 4 ): ): 308 - - 320 . . DOI: 10.1109/TSE.1976.233837 http://doi.org/10.1109/TSE.1976.233837 . .

L. Miao , , , M. Liu , , , D. Zhang . . Cost-sensitive feature selection with application in software defect prediction . . Int. Conf. on Pattern Recognition , , 2012 . . p.967 - - 970 . . . .

J. Nam , , , S. Kim . . CLAMI: defect prediction on unlabeled datasets . . Int. Conf. on Automated Software Engineering , , 2015a . . p.452 - - 463 . . DOI: 10.1109/ASE.2015.56 http://doi.org/10.1109/ASE.2015.56 . .

J. Nam , , , S. Kim . . Heterogeneous defect prediction . . Joint Meeting on Foundations of Software Engineering , , 2015b . . p.508 - - 519 . . DOI: 10.1145/2786805.2786814 http://doi.org/10.1145/2786805.2786814 . .

M. Shepperd , , , Q. Song , , , Z. Sun , , , 等 . . Data quality: some comments on the NASA software defect datasets . . IEEE Trans. Softw. Eng. , , 2013 . . 39 ( ( 9 ): ): 1208 - - 1215 . . DOI: 10.1109/TSE.2013.11 http://doi.org/10.1109/TSE.2013.11 . .

C. Tantithamthavorn , , , S. McIntosh , , , A.E. Hassan , , , 等 . . Automated parameter optimization of classification techniques for defect prediction models . . Int. Conf. on Software Engineering , , 2016 . . p.321 - - 332 . . DOI: 10.1145/2884781.2884857 http://doi.org/10.1145/2884781.2884857 . .

A.K. Uysal , , , S. Gunal . . A novel probabilistic feature selection method for text classification . . Knowl. Based Syst. , , 2012 . . 36 226 - - 235 . . DOI: 10.1016/j.knosys.2012.06.005 http://doi.org/10.1016/j.knosys.2012.06.005 . .

H. Wang , , , T.M. Khoshgoftaar , , , N. Seliya . . On the stability of feature selection methods in software quality prediction: an empirical investigation . . Int. J. Softw. Eng. Know. Eng. , , 2015 . . 25 1467 - - 1490 . . DOI: 10.1142/S0218194015400288 http://doi.org/10.1142/S0218194015400288 . .

Z. Wang , , , M. Li , , , J. Li . . A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure . . Inform. Sci. , , 2015 . . 307 73 - - 88 . . DOI: 10.1016/j.ins.2015.02.031 http://doi.org/10.1016/j.ins.2015.02.031 . .

F. Wilcoxon . . Individual comparisons by ranking methods . . Biometr. Bull. , , 1945 . . 1 ( ( 6 ): ): 80 - - 83 . . DOI: 10.2307/3001968 http://doi.org/10.2307/3001968 . .

J. Xu , , , Y. Zhou , , , L. Chen , , , 等 . . An unsupervised feature selection approach based on mutual information . . J. Comput. Res. Dev. , , 2012 . . 49 ( ( 2 ): ): 372 - - 382 . . . .

B. Xue , , , M. Zhang , , , W.N. Browne . . Particle swarm optimization for feature selection in classification: a multi-objective approach . . IEEE Trans. Cybern. , , 2013 . . 43 ( ( 6 ): ): 1656 - - 1671 . . DOI: 10.1109/TSMCB.2012.2227469 http://doi.org/10.1109/TSMCB.2012.2227469 . .

S. Yang , , , J. Gu . . Feature selection based on mutual information and redundancy-synergy coefficient . . J. Zhejiang Univ.-Sci. , , 2004 . . 5 ( ( 11 ): ): 1382 - - 1391 . . DOI: 10.1631/jzus.2004.1382 http://doi.org/10.1631/jzus.2004.1382 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

Feature selection techniques for microarray datasets: a comprehensive review, taxonomy, and future directions

A software defect prediction method with metric compensation based on feature selection and transfer learning

Unsupervised feature selection via joint local learning and group sparse regression

FAAD: an unsupervised fast and accurate anomaly detection method for a multi-dimensional sequence over data stream

A new feature selection method for handling redundant information in text classification