A feature selection approach based on a similarity measure for software defect prediction

Qiao YU; Shu-juan JIANG; Rong-cun WANG; Hong-yang WANG

doi:10.1631/FITEE.1601322

Your Location：

Home >

Browse articles >

A feature selection approach based on a similarity measure for software defect prediction

Regular Papers | Updated：2022-05-19

- A feature selection approach based on a similarity measure for software defect prediction
- 一种面向软件缺陷预测的相似性度量特征选择方法
- Frontiers of Information Technology & Electronic Engineering Vol. 18, Issue 11, Pages: 1744-1753(2017)
- Affiliations：
  
  School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China
  Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, China
- Author bio：
  
  [ "Qiao YU, E-mail: yuqiao@cumt.edu.cn" ]
  Shu-juan JIANG, E-mail: shjjiang@cumt.edu.cn
- Funds：
- DOI：10.1631/FITEE.1601322
  CLC： TP311
- Received：11 June 2016，
  
  Revised：2017-11-26，
  
  Published：2017-11
- Accepted：
Scan QR Code
Qiao YU, Shu-juan JIANG, Rong-cun WANG, et al. A feature selection approach based on a similarity measure for software defect prediction[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1744-1753.
DOI：

Qiao YU, Shu-juan JIANG, Rong-cun WANG, et al. A feature selection approach based on a similarity measure for software defect prediction[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(11): 1744-1753. DOI： 10.1631/FITEE.1601322.

摘要

软件缺陷预测旨在通过历史数据和能反映软件模块特性的软件特征来发现潜在缺陷。然而，有的特征可能与类别（有缺陷或无缺陷）的相关性较高，有的特征可能是冗余的或无关的。针对软件缺陷预测中不同特征与类别的相关性差异，本文提出一种基于相似性度量（similarity measure

SM）的特征选择方法。首先，根据不同类样本间的相似性来更新特征权重；然后，按照特征权重值降序排列生成特征排序列表，并依次选取特征排序列表中的所有特征子集；最后，在KNN（

-nearest neighbor）模型上验证所有特征子集的分类性能，并采用AUC（areaunder curve）指标进行度量。在11个美国航空航天局（NASA）数据集上进行实验验证，结果表明，与其它四种特征选择方法相比，本文方法具有与之相当甚至更高的分类性能。

Abstract

Software defect prediction is aimed to find potential defects based on historical data and software features. Software features can reflect the characteristics of software modules. However

some of these features may be more relevant to the class (defective or non-defective)

but others may be redundant or irrelevant. To fully measure the correlation between different features and the class

we present a feature selection approach based on a similarity measure (SM) for software defect prediction. First

the feature weights are updated according to the similarity of samples in different classes. Second

a feature ranking list is generated by sorting the feature weights in descending order

and all feature subsets are selected from the feature ranking list in sequence. Finally

all feature subsets are evaluated on a

-nearest neighbor (KNN) model and measured by an area under curve (AUC) metric for classification performance. The experiments are conducted on 11 National Aeronautics and Space Administration (NASA) datasets

and the results show that our approach performs better than or is comparable to the compared feature selection approaches in terms of classification performance.

关键词

Keywords

references

D.W. Aha , , , D. Kibler , , , M.K. Albert . . Instance-based learning algorithms . . Mach. Learn. , , 1991 . . 6 ( ( 1 ): ): 37 - - 66 . . DOI: 10.1007/BF00153759 http://doi.org/10.1007/BF00153759 . .

C. Catal , , , B. Diri . . Investigating the effect of dataset size, metrics sets, and feature selection techniques on software fault prediction problem . . Inform. Sci. , , 2009 . . 179 ( ( 8 ): ): 1040 - - 1058 . . DOI: 10.1016/j.ins.2008.12.001 http://doi.org/10.1016/j.ins.2008.12.001 . .

W. Duch , , , T. Wieczorek , , , J. Biesiada , , , 等 . . Comparison of feature ranking methods based on information entropy . . Int. Joint Conf. on Neural Networks , , 2004 . . p.1415 - - 1419 . . DOI: 10.1109/IJCNN.2004.1380157 http://doi.org/10.1109/IJCNN.2004.1380157 . .

M. Galar , , , A. Fernández , , , E. Barrenechea , , , 等 . . A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches . . IEEE Trans. Syst. Man Cybern. Part C , , 2012 . . 42 ( ( 4 ): ): 463 - - 484 . . DOI: 10.1109/TSMCC.2011.2161285 http://doi.org/10.1109/TSMCC.2011.2161285 . .

K. Gao , , , T.M. Khoshgoftaar , , , H. Wang , , , 等 . . Choosing software metrics for defect prediction: an investigation on feature selection techniques . . Softw. Pract. Exper. , , 2011 . . 41 ( ( 5 ): ): 579 - - 606 . . DOI: 10.1002/spe.1043 http://doi.org/10.1002/spe.1043 . .

A.S. Ghareb , , , A.A. Bakar , , , A.R. Hamdan . . Hybrid feature selection based on enhanced genetic algorithm for text categorization . . Expert Syst. Appl. , , 2016 . . 49 31 - - 47 . . DOI: 10.1016/j.eswa.2015.12.004 http://doi.org/10.1016/j.eswa.2015.12.004 . .

D. Gray , , , D. Bowes , , , N. Davey , , , 等 . . The misuse of the NASA metrics data program data sets for automated software defect prediction . . Int. Conf. on Evaluation and Assessment in Software Engineering , , 2011 . . p.96 - - 103 . . DOI: 10.1049/ic.2011.0012 http://doi.org/10.1049/ic.2011.0012 . .

I. Guyon , , , A. Elisseeff . . An introduction to variable and feature selection . . J. Mach. Learn. Res. , , 2003 . . 3 1157 - - 1182 . . . .

M.A. Hall . . Correlation-Based Feature Selection for Machine Learning , , : : Hamilton, New Zealand University of Waikato , , 1999 . . .

M.H. Halstead . . Elements of Software Science , , : : New York, USA Elsevier , , 1977 . . .

Y. Han , , , K. Park , , , D. Guan , , , 等 . . Topological similarity-based feature selection for graph classification . . Comput. J. , , 2013 . . 58 ( ( 9 ): ): 1884 - - 1893 . . DOI: 10.1093/comjnl/bxt123 http://doi.org/10.1093/comjnl/bxt123 . .

R.C. Holte . . Very simple classification rules perform well on most commonly used datasets . . Mach. Learn. , , 1993 . . 11 ( ( 1 ): ): 63 - - 90 . . DOI: 10.1023/A:1022631118932 http://doi.org/10.1023/A:1022631118932 . .

J. Huang , , , C.X. Ling . . Using AUC and accuracy in evaluating learning algorithms . . IEEE Trans. Knowl. Data Eng. , , 2005 . . 17 ( ( 3 ): ): 299 - - 310 . . DOI: 10.1109/TKDE.2005.50 http://doi.org/10.1109/TKDE.2005.50 . .

Y. Jiang , , , J. Lin , , , B. Cukic , , , 等 . . Variance analysis in software fault prediction models . . Int. Symp. on Software Reliability Engineering , , 2009 . . p.99 - - 108 . . DOI: 10.1109/ISSRE.2009.13 http://doi.org/10.1109/ISSRE.2009.13 . .

X. Jing , , , S. Ying , , , Z. Zhang , , , 等 . . Dictionary learning based software defect prediction . . Int. Conf. on Software Engineering , , 2014a . . p.414 - - 423 . . DOI: 10.1145/2568225.2568320 http://doi.org/10.1145/2568225.2568320 . .

X. Jing , , , Z. Zhang , , , S. Ying , , , 等 . . Software defect prediction based on collaborative representation classification . . Companion of Int. Conf. on Software Engineering , , 2014b . . p.632 - - 633 . . DOI: 10.1145/2591062.2591151 http://doi.org/10.1145/2591062.2591151 . .

X. Jing , , , F. Wu , , , X. Dong , , , 等 . . Heterogeneous cross-company defect prediction by unified metric representation and CCA-based transfer learning . . Joint Meeting on Foundations of Software Engineering , , 2015 . . p.496 - - 507 . . DOI: 10.1145/2786805.2786813 http://doi.org/10.1145/2786805.2786813 . .

A.G. Karegowda , , , A.S. Manjunath , , , M.A. Jayaram . . Comparative study of attribute selection using gain ratio and correlation based feature selection . . Int. J. Inform. Technol. Knowl. Manag. , , 2010 . . 2 ( ( 2 ): ): 271 - - 277 . . . .

T.M. Khoshgoftaar , , , K. Gao , , , A. Napolitano , , , 等 . . A comparative study of iterative and non-iterative feature selection techniques for software defect prediction . . Inform. Syst. Front. , , 2014 . . 16 ( ( 5 ): ): 801 - - 822 . . DOI: 10.1007/s10796-013-9430-0 http://doi.org/10.1007/s10796-013-9430-0 . .

K. Kira , , , L.A. Rendell . . A practical approach to feature selection . . Int. Workshop on Machine Learning , , 1992 . . p.2249 - - 256 . . . .

I. Kononenko . . Estimating attributes: analysis and extensions of RELIEF . . European Conf. on Machine Learning , , 1994 . . p.171 - - 182 . . DOI: 10.1007/3-540-57868-4_57 http://doi.org/10.1007/3-540-57868-4_57 . .

I.H. Laradji , , , M. Alshayeb , , , L. Ghouti . . Software defect prediction using ensemble learning on selected features . . Inform. Softw. Technol. , , 2015 . . 58 388 - - 402 . . DOI: 10.1016/j.infsof.2014.07.005 http://doi.org/10.1016/j.infsof.2014.07.005 . .

H. Liu , , , L. Yu . . Toward integrating feature selection algorithms for classification and clustering . . IEEE Trans. Knowl. Data Eng. , , 2005 . . 17 ( ( 4 ): ): 491 - - 502 . . DOI: 10.1109/TKDE.2005.66 http://doi.org/10.1109/TKDE.2005.66 . .

H. Liu , , , J. Sun , , , L. Liu , , , 等 . . Feature selection with dynamic mutual information . . Patt. Recogn. , , 2009 . . 42 ( ( 7 ): ): 1330 - - 1339 . . DOI: 10.1016/j.patcog.2008.10.028 http://doi.org/10.1016/j.patcog.2008.10.028 . .

H. Liu , , , H. Motoda , , , R. Setiono , , , 等 . . Feature selection: an ever evolving frontier in data mining . . Int. Workshop on Feature Selection in Data Mining , , 2010 . . 4 - - 13 . . . .

S. Liu , , , X. Chen , , , W. Liu , , , 等 . . FECAR: a feature selection framework for software defect prediction . . Annual Computer Software and Applications Conf. , , 2014 . . 426 - - 435 . . DOI: 10.1109/COMPSAC.2014.66 http://doi.org/10.1109/COMPSAC.2014.66 . .

T.J. McCabe . . A complexity measure . . IEEE Trans. Softw. Eng , , 1976 . . SE-2 ( ( 4 ): ): 308 - - 320 . . DOI: 10.1109/TSE.1976.233837 http://doi.org/10.1109/TSE.1976.233837 . .

L. Miao , , , M. Liu , , , D. Zhang . . Cost-sensitive feature selection with application in software defect prediction . . Int. Conf. on Pattern Recognition , , 2012 . . p.967 - - 970 . . . .

J. Nam , , , S. Kim . . CLAMI: defect prediction on unlabeled datasets . . Int. Conf. on Automated Software Engineering , , 2015a . . p.452 - - 463 . . DOI: 10.1109/ASE.2015.56 http://doi.org/10.1109/ASE.2015.56 . .

J. Nam , , , S. Kim . . Heterogeneous defect prediction . . Joint Meeting on Foundations of Software Engineering , , 2015b . . p.508 - - 519 . . DOI: 10.1145/2786805.2786814 http://doi.org/10.1145/2786805.2786814 . .

M. Shepperd , , , Q. Song , , , Z. Sun , , , 等 . . Data quality: some comments on the NASA software defect datasets . . IEEE Trans. Softw. Eng. , , 2013 . . 39 ( ( 9 ): ): 1208 - - 1215 . . DOI: 10.1109/TSE.2013.11 http://doi.org/10.1109/TSE.2013.11 . .

C. Tantithamthavorn , , , S. McIntosh , , , A.E. Hassan , , , 等 . . Automated parameter optimization of classification techniques for defect prediction models . . Int. Conf. on Software Engineering , , 2016 . . p.321 - - 332 . . DOI: 10.1145/2884781.2884857 http://doi.org/10.1145/2884781.2884857 . .

A.K. Uysal , , , S. Gunal . . A novel probabilistic feature selection method for text classification . . Knowl. Based Syst. , , 2012 . . 36 226 - - 235 . . DOI: 10.1016/j.knosys.2012.06.005 http://doi.org/10.1016/j.knosys.2012.06.005 . .

H. Wang , , , T.M. Khoshgoftaar , , , N. Seliya . . On the stability of feature selection methods in software quality prediction: an empirical investigation . . Int. J. Softw. Eng. Know. Eng. , , 2015 . . 25 1467 - - 1490 . . DOI: 10.1142/S0218194015400288 http://doi.org/10.1142/S0218194015400288 . .

Z. Wang , , , M. Li , , , J. Li . . A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure . . Inform. Sci. , , 2015 . . 307 73 - - 88 . . DOI: 10.1016/j.ins.2015.02.031 http://doi.org/10.1016/j.ins.2015.02.031 . .

F. Wilcoxon . . Individual comparisons by ranking methods . . Biometr. Bull. , , 1945 . . 1 ( ( 6 ): ): 80 - - 83 . . DOI: 10.2307/3001968 http://doi.org/10.2307/3001968 . .

J. Xu , , , Y. Zhou , , , L. Chen , , , 等 . . An unsupervised feature selection approach based on mutual information . . J. Comput. Res. Dev. , , 2012 . . 49 ( ( 2 ): ): 372 - - 382 . . . .

B. Xue , , , M. Zhang , , , W.N. Browne . . Particle swarm optimization for feature selection in classification: a multi-objective approach . . IEEE Trans. Cybern. , , 2013 . . 43 ( ( 6 ): ): 1656 - - 1671 . . DOI: 10.1109/TSMCB.2012.2227469 http://doi.org/10.1109/TSMCB.2012.2227469 . .

S. Yang , , , J. Gu . . Feature selection based on mutual information and redundancy-synergy coefficient . . J. Zhejiang Univ.-Sci. , , 2004 . . 5 ( ( 11 ): ): 1382 - - 1391 . . DOI: 10.1631/jzus.2004.1382 http://doi.org/10.1631/jzus.2004.1382 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Feature selection techniques for microarray datasets: a comprehensive review, taxonomy, and future directions

A software defect prediction method with metric compensation based on feature selection and transfer learning

Unsupervised feature selection via joint local learning and group sparse regression

FAAD: an unsupervised fast and accurate anomaly detection method for a multi-dimensional sequence over data stream

A new feature selection method for handling redundant information in text classification

Related Author

Ramasamy DHANALAKSHMI

Kulanthaivel BALAKRISHNAN

Jinfu CHEN

Haibo CHEN

Jingyi CHEN

Jiaping XU

Saihua CAI

Xiaoli WANG

Related Institution

Department of Computer Science and Engineering, Indian Institute of Information Technology

School of Computer Science and Communication Engineering, Jiangsu University

Jiangsu Key Laboratory of Security Technology for Industrial Cyberspace, Jiangsu University

Zhejiang Provincial Key Laboratory of Service Robot, College of Computer Science and Technology, Zhejiang University

Alibaba-Zhejiang University Joint Institute of Frontier Technologies

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰