In this paper, we explore the issues around diagnostic testing of first year students in mathematics and give an example of the use of such a test in a large first year subject. We compare the scores on the diagnostic test with the end of semester results for 2005. Opinions and insights from students and staff were also collected using open-ended surveys