A learning-to-rank approach to software defect prediction

Research output: Contribution to journalArticlepeer-review


Colleges, School and Institutes

External organisations

  • University of Science and Technology of China
  • USTC-Birmingham Joint Research Institute in Intelligent Computation and Its Applications (UBRI)


Software defect prediction can help to allocate testing resources efficiently through ranking software modules according to their defects. Existing software defect prediction models that are optimized to predict explicitly the number of defects in a software module might fail to give an accurate order because it is very difficult to predict the exact number of defects in a software module due to noisy data. This paper introduces a learning-to-rank approach to construct software defect prediction models by directly optimizing the ranking performance. In this paper, we build on our previous work, and further study whether the idea of directly optimizing the model performance measure can benefit software defect prediction model construction. The work includes two aspects: one is a novel application of the learning-to-rank approach to real-world data sets for software defect prediction, and the other is a comprehensive evaluation and comparison of the learning-to-rank method against other algorithms that have been used for predicting the order of software modules according to the predicted number of defects. Our empirical studies demonstrate the effectiveness of directly optimizing the model performance measure for the learning-to-rank approach to construct defect prediction models for the ranking task.


Original languageEnglish
Article number6996020
Pages (from-to)234-246
Number of pages13
JournalIEEE Transactions on Reliability
Issue number1
Publication statusPublished - 1 Mar 2015


  • count models, learning-to-rank, metric selection, Software defect prediction, software metrics