Data mining techniques for software effort estimation: a comparative study
Faculty of Applied Economics
New York, N.Y.
IEEE transactions on software engineering. - New York, N.Y.
, p. 375-397
University of Antwerp
A predictive model is required to be accurate and comprehensible in order to inspire confidence in a business setting. Both aspects have been assessed in a software effort estimation setting by previous studies. However, no univocal conclusion to which technique is the most suited has been reached. This study addresses this issue by reporting on the results of a large scale benchmarking study. Different types of techniques are under consideration including techniques inducing tree/rule based models like M5 and CART, linear models such as various types of linear regression, non-linear models (MARS, multi layered perceptron neural networks, radial basis function networks and least squares support vector machines), and estimation techniques that not explicitly induce a model (e.g. a case based reasoning approach). Furthermore, the aspect of feature subset selection by using a generic backward input selection wrapper is investigated. The results are subjected to rigorous statistical testing and indicate that ordinary least squares regression in combination with a logarithmic transformation performs best. Another key finding is that by selecting a subset of highly predictive attributes such as project size, development, and environment related attributes, typically a significant increase in estimation accuracy can be obtained.