RAMESES publication standards: realist syntheses

PMCID: PMC3558331This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited

Unintended Consequences of Incentive Provision for Behaviour Change and Maintenance around Childbirth

Financial (positive or negative) and non-financial incentives or rewards are increasingly used in attempts to influence health behaviours. While unintended consequences of incentive provision are discussed in the literature, evidence syntheses did not identify any primary research with the aim of investigating unintended consequences of incentive interventions for lifestyle behaviour change. Our objective was to investigate perceived positive and negative unintended consequences of incentive provision for a shortlist of seven promising incentive strategies for smoking cessation in pregnancy and breastfeeding. A multi-disciplinary, mixed-methods approach included involving two service-user mother and baby groups from disadvantaged areas with experience of the target behaviours as study co-investigators. Systematic reviews informed the shortlist of incentive strategies. Qualitative semi-structured interviews and a web-based survey of health professionals asked open questions on positive and negative consequences of incentives. The participants from three UK regions were a diverse sample with and without direct experience of incentive interventions: 88 pregnant women/recent mothers/partners/family members; 53 service providers; 24 experts/decision makers and interactive discussions with 63 conference attendees. Maternity and early years health professionals (n = 497) including doctors, midwives, health visitors, public health and related staff participated in the survey. Qualitative analysis identified ethical, political, cultural, social and psychological implications of incentive delivery at population and individual levels. Four key themes emerged: how incentives can address or create inequalities; enhance or diminish intrinsic motivation and wellbeing; have a positive or negative effect on relationships with others within personal networks or health providers; and can impact on health systems and resources by raising awareness and directing service delivery, but may be detrimental to other health care areas. Financial incentives are controversial and generated emotive and oppositional responses. The planning, design and delivery of future incentive interventions should evaluate unexpected consequences to inform the evidence for effectiveness, cost-effectiveness and future implementation

Living with the h-index? Metric assemblages in the contemporary academy

This paper examines the relationship between metrics, markets and affect in the contemporary UK academy. It argues that the emergence of a particular structure of feeling amongst academics in the last few years has been closely associated with the growth and development of ‘quantified control’. It examines the functioning of a range of metrics: citations; workload models; transparent costing data; research assessments; teaching quality assessments; and commercial university league tables. It argues that these metrics, and others, although still embedded within an audit culture, increasingly function autonomously as a data assemblage able not just to mimic markets but, increasingly, to enact them. It concludes by posing some questions about the possible implications of this for the future of academic practice

The Role of Teachers' Expectations in the Association between Children's SES and Performance in Kindergarten: A Moderated Mediation Analysis

This study examines the role of teachers' expectations in the association between children's socio-economic background and achievement outcomes. Furthermore, the role of children's ethnicity in moderating this mediated relation is investigated. In the present study, 3,948 children from kindergarten are examined. Data are analysed by means of structural equation modeling. First, results show that teachers' expectations mediate the relation between children's SES and their later language and math achievement, after controlling for children's ethnicity, prior achievement and gender. This result indicates that teachers may exacerbate individual differences between children. Second, children's ethnicity moderates the mediation effect of teachers' expectations with respect to math outcomes. The role of teachers' expectations in mediating the relation between SES and math outcomes is stronger for majority children than for minority children

The effect of size on the failure probabilities of SMEs: An empirical study on the US market using discrete hazard model

This paper investigates the extent to which the size affects the SME probabilities of bankruptcy. Using a dataset of (11,117) US non-financial firms, of which (465) filed for insolvency under chapters 7/11 between 1980 and 2013. We forecast the bankruptcy probabilities by developing four discrete-time duration-dependent hazard models for SMEs, Micro, Small, and Medium firms. A comparison of the default prediction models for medium firms and SMEs suggests that an almost identical set of explanatory variables affect the default probabilities leading us to believe that treating each of these groups separately has no material impact on the decision making process. However, comparisons between the micro and small firms with the SMEs firms strongly suggest that these categories need to be considered separately when modelling their credit risk

Describing the impact of health research: a Research Impact Framework

BACKGROUND: Researchers are increasingly required to describe the impact of their work, e.g. in grant proposals, project reports, press releases and research assessment exercises. Specialised impact assessment studies can be difficult to replicate and may require resources and skills not available to individual researchers. Researchers are often hard-pressed to identify and describe research impacts and ad hoc accounts do not facilitate comparison across time or projects. METHODS: The Research Impact Framework was developed by identifying potential areas of health research impact from the research impact assessment literature and based on research assessment criteria, for example, as set out by the UK Research Assessment Exercise panels. A prototype of the framework was used to guide an analysis of the impact of selected research projects at the London School of Hygiene and Tropical Medicine. Additional areas of impact were identified in the process and researchers also provided feedback on which descriptive categories they thought were useful and valid vis-à-vis the nature and impact of their work. RESULTS: We identified four broad areas of impact: I. Research-related impacts; II. Policy impacts; III. Service impacts: health and intersectoral and IV. Societal impacts. Within each of these areas, further descriptive categories were identified. For example, the nature of research impact on policy can be described using the following categorisation, put forward by Weiss: Instrumental use where research findings drive policy-making; Mobilisation of support where research provides support for policy proposals; Conceptual use where research influences the concepts and language of policy deliberations and Redefining/wider influence where research leads to rethinking and changing established practices and beliefs. CONCLUSION: Researchers, while initially sceptical, found that the Research Impact Framework provided prompts and descriptive categories that helped them systematically identify a range of specific and verifiable impacts related to their work (compared to ad hoc approaches they had previously used). The framework could also help researchers think through implementation strategies and identify unintended or harmful effects. The standardised structure of the framework facilitates comparison of research impacts across projects and time, which is useful from analytical, management and assessment perspectives

Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care

Background: The feedback of patient-reported outcome measures (PROMs) data is intended to support the care of individual patients and to act as a quality improvement (QI) strategy. Objectives: To (1) identify the ideas and assumptions underlying how individual and aggregated PROMs data are intended to improve patient care, and (2) review the evidence to examine the circumstances in which and processes through which PROMs feedback improves patient care. Design: Two separate but related realist syntheses: (1) feedback of aggregate PROMs and performance data to improve patient care, and (2) feedback of individual PROMs data to improve patient care. Interventions: Aggregate – feedback and public reporting of PROMs, patient experience data and performance data to hospital providers and primary care organisations. Individual – feedback of PROMs in oncology, palliative care and the care of people with mental health problems in primary and secondary care settings. Main outcome measures: Aggregate – providers’ responses, attitudes and experiences of using PROMs and performance data to improve patient care. Individual – providers’ and patients’ experiences of using PROMs data to raise issues with clinicians, change clinicians’ communication practices, change patient management and improve patient well-being. Data sources: Searches of electronic databases and forwards and backwards citation tracking. Review methods: Realist synthesis to identify, test and refine programme theories about when, how and why PROMs feedback leads to improvements in patient care. Results: Providers were more likely to take steps to improve patient care in response to the feedback and public reporting of aggregate PROMs and performance data if they perceived that these data were credible, were aimed at improving patient care, and were timely and provided a clear indication of the source of the problem. However, implementing substantial and sustainable improvement to patient care required system-wide approaches. In the care of individual patients, PROMs function more as a tool to support patients in raising issues with clinicians than they do in substantially changing clinicians’ communication practices with patients. Patients valued both standardised and individualised PROMs as a tool to raise issues, but thought is required as to which patients may benefit and which may not. In settings such as palliative care and psychotherapy, clinicians viewed individualised PROMs as useful to build rapport and support the therapeutic process. PROMs feedback did not substantially shift clinicians’ communication practices or focus discussion on psychosocial issues; this required a shift in clinicians’ perceptions of their remit. Strengths and limitations: There was a paucity of research examining the feedback of aggregate PROMs data to providers, and we drew on evidence from interventions with similar programme theories (other forms of performance data) to test our theories. Conclusions: PROMs data act as ‘tin openers’ rather than ‘dials’. Providers need more support and guidance on how to collect their own internal data, how to rule out alternative explanations for their outlier status and how to explore the possible causes of their outlier status. There is also tension between PROMs as a QI strategy versus their use in the care of individual patients; PROMs that clinicians find useful in assessing patients, such as individualised measures, are not useful as indicators of service quality. Future work: Future research should (1) explore how differently performing providers have responded to aggregate PROMs feedback, and how organisations have collected PROMs data both for individual patient care and to improve service quality; and (2) explore whether or not and how incorporating PROMs into patients’ electronic records allows multiple different clinicians to receive PROMs feedback, discuss it with patients and act on the data to improve patient care

Front-line practitioners versus received theories of crime and terrorism

This paper provides an analytical summary of the findings of a research project into the activities, the causes of, and responses to, organized crime and terrorism. Based on the views of front-line practitioners such as social workers, teachers, law enforcers and other experts, the paper examines their needs, interpretations, uncertainties and perspectives. It then compares these views with those emerging from previous analyses and research, highlighting the assonances and dissonances that typically crowd these areas of investigation