Skip to main content
Article thumbnail
Location of Repository

Empir Software Eng DOI 10.1007/s10664-011-9193-5 EDITORIAL Special issue on repeatable results in software

By Engineering Prediction, Tim Menzies and T. Menzies (b

Abstract

in multiple situations. Sadly, there are all too few examples of stable conclusions in software engineering (SE). In fact, the typical result is conclusion instability where what is true for project one, does not hold for project two. We can find numerous studies of the following form: there is as much evidence for as against the argument that some aspect X adds value to a software project. Below are four examples of this type of problem which we believe to be endemic within SE. – Jørgensen (2004) reviewed15studiescomparingmodel-basedtoexpert-based estimation. Five of those studies found in favor of expert-based methods, five found no difference, and five found in favor of model-based estimation. – Mair and Shepperd (2005) compared regression to analogy methods for effort estimation and similarly found conflicting evidence. From a total of 20 empirical studies, seven favored regression, four were indifferent and nine favored analogy. – Kitchenham et al. (2007) reviewed empirical studies that checked, if data imported from other organizations were as useful as local data (for the purposes of building effort models). From a total of seven studies, three found that models from other organizations were not significantly worse than those based on local data, while four found that they were significantly different (and worse)

Year: 2013
OAI identifier: oai:CiteSeerX.psu:10.1.1.352.9060
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://menzies.us/pdf/12stabil... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.