Panel 20 The Merits of Three Qualitative Research Methods

There has been growing interest in qualitative research methods and their application to information systems in recent years. Since 1990 panels and/or workshops on qualitative research methods have become a regular feature of ICIS. Prominent among the variety of research strategies which have been suggested in the research literature are case studies, grounded theory, ethnography (Harvey and Myers 1995; Wynn 1991), phenomenology, semiotics (Klein and Truex 1995), hermeneutics, critical hermeneutics (Myers 1994) and critical theory approaches

Use of programme budgeting and marginal analysis to set priorities for local NHS dental services: learning from the north east of England

Background - Priority setting is necessary where competing demands exceed the finite resources available. The aim of the study was to develop and test a prioritization framework based upon programme budgeting and marginal analysis (PBMA) as a tool to assist National Health Service (NHS) commissioners in their management of resources for local NHS dental services. Methods - Twenty-seven stakeholders (5 dentists, 8 commissioners and 14 patients) participated in a case-study based in a former NHS commissioning organization in the north of England. Stakeholders modified local decision-making criteria and applied them to a number of different scenarios. Results - The majority of financial resources for NHS dental services in the commissioning organization studied were allocated to primary care dental practitioners’ contracts in perpetuity, potentially constraining commissioners’ abilities to shift resources. Compiling the programme budget was successful, but organizational flux and difficulties engaging local NHS commissioners significantly impacted upon the marginal analysis phase. Conclusions - NHS dental practitioners’ contracts resemble budget-silos which do not facilitate local resource reallocation. ‘Context-specific’ factors significantly challenged the successful implementation and impact of PBMA. A local PBMA champion embedded within commissioning organizations should be considered. Participants found visual depiction of the cost-value ratio helpful during their initial priority setting deliberations

The assessment of science: the relative merits of post- publication review, the impact factor, and the number of citations

The assessment of scientific publications is an integral part of the scientific process. Here we investigate three methods of assessing the merit of a scientific paper: subjective post-publication peer review, the number of citations gained by a paper, and the impact factor of the journal in which the article was published. We investigate these methods using two datasets in which subjective post-publication assessments of scientific publications have been made by experts. We find that there are moderate, but statistically significant, correlations between assessor scores, when two assessors have rated the same paper, and between assessor score and the number of citations a paper accrues. However, we show that assessor score depends strongly on the journal in which the paper is published, and that assessors tend to over-rate papers published in journals with high impact factors. If we control for this bias, we find that the correlation between assessor scores and between assessor score and the number of citations is weak, suggesting that scientists have little ability to judge either the intrinsic merit of a paper or its likely impact. We also show that the number of citations a paper receives is an extremely error-prone measure of scientific merit. Finally, we argue that the impact factor is likely to be a poor measure of merit, since it depends on subjective assessment. We conclude that the three measures of scientific merit considered here are poor; in particular subjective assessments are an error-prone, biased, and expensive method by which to assess merit. We argue that the impact factor may be the most satisfactory of the methods we have considered, since it is a form of pre-publication review. However, we emphasise that it is likely to be a very error-prone measure of merit that is qualitative, not quantitative

Editorial: Supporting children and young people in a changing world.

The editorial describes how the papers in the special issue engage with the views and experiences of children, as well as adults, to analyse the impact of social protection and social mobility through education and employment on their well-being. It takes a slightly critical approach to concepts such as well-being and agency—acknowledging that these frequently embrace their opposites—and highlights the value of mixed methods in exploring themes such as ‘voice and visibility’, schooling and work, and child poverty and outcomes. Finally, it draws out common conclusions and discusses their implications for policy and programme design

UK Data Archive Resources for Studying Older People and Ageing

There is a growing collection of data available on older people and ageing at the UK Data Archive. Collections include “On the Edge of Later Life”, a study that investigated the experiences of people in their 50’s, and “Older Men: Their Social Worlds and Healthy Lifestyles”, a study that investigated masculinity and ageing, with a focus on men living alone. Both qualitative and quantitative data are available. The UKDA wants to make data easily useable for research, teaching and policy purposes. To those ends, it provides access to data, additional resources and user support for those interested in using archived data. This paper describes the kinds of data and related materials that are available on ageing and later life and explains how they can be accessed and used

Historical learning in the design of WTO rules: the EC sugar case

The Uruguay Round Agreement made significant changes to the governance of international trade. Trade rules and dispute settlement mechanisms were altered and a series of specific agreements provided for liberalisation across economic sectors. The Agreement on Agriculture, arguably the most difficult and contentious to negotiate, permitted the continued use of trade-distorting instruments, both domestically and at the border. Rule-enforcement in agriculture therefore relies crucially on the clarity of the rules. This paper provides an in-depth study of a unique and critical case for understanding the new rules: the EC sugar regime. This policy was challenged unsuccessfully under the pre-Uruguay Round rules, but successfully under the new rules. This case is particularly valuable in allowing us to isolate the effect of the Uruguay Round on agricultural trade disputes: the policy under challenge was essentially unchanged and the legal actions addressed the same concern – excessive export subsidisation. Drawing on primary and secondary materials and interviews with key policy actors, sugar is used to illustrate how those involved in the multilateral process learned from particular rule weaknesses revealed in earlier cases, revising those rules in the Uruguay Round in such a way that dispute panels can more readily and objectively determine rule breaches

Quality criteria in educational research: is beauty more important than popularity?

Presentation Contents: HISTORICAL CONTEXT: The poor quality of educational research THE DISCUSSION FRAMEWORK: Assessing Quality in Educational Research CRITIQUES: Is assessing the quality of educational research possible or necessary? During the past decade, as national governments more particularly in the USA and the UK have scrutinised more closely the cost effectiveness and impact of research funding within higher education, they have become critical of the overall quality of educational research, in terms of its scientific rigour, its utility for practitioners and the manner in which it is assessed. This paper addresses the reasons why the quality of educational research was questioned and then examines the discussion framework for assessing quality which emerged. Following from this, the merits of possible internal and external criteria for the worth of educational research are considered. The links between these criterial sets and the function and purpose of qualitative and quantitative approaches to educational research are considered. Finally the question of whether educational research is an art or a science is addressed. RESEARCH: into education – are medical and economic models appropriate? EDUCATION: Is it an art or a science (or what)

Transition to adult services for children and young people with palliative care needs : a systematic review

Objective: To evaluate the evidence on the transition process from child to adult services for young people with palliative care needs. Design: Systematic review Setting: Child and adult services and interface between healthcare providers. Patients: Young people aged 13 to 24 years with palliative care conditions in the process of transition. Main outcome measures: Young people and their families’ experiences of transition, the process of transition between services and its impact on continuity of care, and models of good practice. Results: 92 studies included. Papers on transition services were of variable quality when applied to palliative care contexts. Most focused on common life threatening and life limiting conditions. No standardised transition programme identified and most guidelines used to develop transition services were not evidence based. Most studies on transition programmes were predominantly condition-specific (e.g. cystic fibrosis, cancer) services. Cystic fibrosis services offered high quality transition with the most robust empirical evaluation. There were differing condition-dependent viewpoints on when transition should occur but agreement on major principles guiding transition planning and probable barriers. There was evidence of poor continuity between child and adult providers with most originating from within child settings. Conclusions: Palliative care was not, in itself, a useful concept for locating transition-related evidence. It is not possible to evaluate the merits of the various transition models for palliative care contexts, or their effects on continuity of care, as there are no long-term outcome data to measure their effectiveness. Use of validated outcome measures would facilitate research and service development