Skip to main content
Article thumbnail
Location of Repository

Measuring fidelity to extreme programming: a psychometric approach

By George Michaelides, Chris Thomson and Stephen Wood


This is the author's final draft of the paper published as Empirical Software Engineering, 2010, 15 (6), pp. 599-617. The original publication is available at Doi: 10.1007/s10664-010-9130-zThis study assesses the Shodan survey as an instrument for measuring an individual’s or a team’s adherence to the extreme programming (XP) methodology. Specifically, we hypothesize that the adherence to the XP methodology is not a uni-dimensional construct as presented by the Shodan survey but a multidimensional one reflecting dimensions that are theoretically grounded in the XP literature. Using data from software engineers in the University of Sheffield’s Software Engineering Observatory, two different models were thus tested and compared using confirmatory factor analysis: a uni-dimensional model and a four-dimensional model. We also present an exploratory analysis of how these four dimensions affect students’ grades. The results indicate that the four-dimensional model fits the data better than the uni-dimensional one. Nevertheless, the analysis also uncovered flaws with the Shodan survey in terms of the reliability of the different dimensions. The exploratory analysis revealed that some of the XP dimensions had linear or curvilinear relationship with grades. Through validating the four-dimensional model of the Shodan survey this study highlights how psychometric techniques can be used to develop software engineering metrics of fidelity to agile or other software engineering methods

Publisher: Springer Verlag
Year: 2010
DOI identifier: 10.1007/s10664-010-9130-z
OAI identifier:

Suggested articles


  1. (2004). An ethnographic study of XP practice. doi
  2. (2005). Empirical study on extreme programming. Unpublished PhD thesis,
  3. (2003). Experiences in learning XP practices: A qualitative study. doi
  4. Extreme programming evaluation framework for object-oriented languages – version 1.3.
  5. (2004). Extreme programming evaluation framework for object-oriented languages – version 1.4.
  6. (2003). Extreme programming refactored: The case against XP. APress, doi
  7. (2005). Personality characteristics in an XP team: A repertory grid study. doi
  8. (2009). The Sheffield software engineering observatory archive: Six years of empirical data collected from 73 complete projects.
  9. (2005). The social side of technical practices. Extreme Programming and Agile doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.