Energy, climate and water in the 21st century – Texas and Florida share a strong connection with future challenges in the Earth sciences

Bureau of Economic Geolog

Rapid evaluation of service innovations in health and social care: key considerations

Background: The Children and Young People’s Mental Health Trailblazer programme is funding the creation of new mental health support teams to work in schools and further education colleges. Mental health support teams directly support children and young people with ‘mild to moderate’ mental health problems and work with school and college staff to promote well-being for all. A new workforce of education mental health practitioners is being trained for the teams. / Objective(s): The National Institute for Health and Care Research Birmingham, RAND and Cambridge Evaluation Rapid Evaluation Centre and Policy Innovation and Evaluation Research Unit undertook an early evaluation of the Trailblazer programme to examine the development, implementation and early progress of mental health support teams in the programme’s first 25 ‘Trailblazer’ sites. / Design: A mixed-methods evaluation, comprising three work packages: 1. Establishing the baseline and understanding the development and early impacts of the Trailblazer sites, including two rounds of surveys with key informants and participating education settings in all 25 sites. 2. More detailed research in five purposively selected Trailblazer sites, including interviews with a range of stakeholders and focus groups with children and young people. 3. Scoping and developing options for a longer-term assessment of the programme’s outcomes and impacts. Fieldwork was undertaken between November 2020 and February 2022. The University of Birmingham Institute for Mental Health Youth Advisory Group was involved throughout the study, including co-producing the focus groups with children and young people. / Results: Substantial progress had been made implementing the programme, in challenging circumstances, and there was optimism about what it had the potential to achieve. The education mental health practitioner role had proven popular, but sites reported challenges in retaining education mental health practitioners, and turnover left mental health support teams short-staffed and needing to re-recruit. Education settings welcomed additional mental health support and reported positive early outcomes, including staff feeling more confident and having faster access to advice about mental health issues. At the same time, there were concerns about children who had mental health problems that were more serious than ‘mild to moderate’ but not serious enough to be accepted for specialist help, and that the interventions offered were not working well for some young people. Mental health support teams were generally spending more time supporting children with mental health problems than working with education settings to develop ‘whole school’ approaches to mental health and well-being, and service models in some sites appeared to be more clinically oriented, with a strong focus on mental health support teams’ therapeutic functions. / Limitations: Despite efforts to maximise participation, survey response rates were relatively low and some groups were less well represented than others. We were not able to gather sufficiently detailed data to develop a typology of Trailblazer sites, as was planned. / Conclusions: Key lessons for future programme implementation include: – Whether mental health support teams should expand support to children and young people with more complex and serious mental health problems. – How to keep the twin aims of prevention and early intervention in balance. – How to retain education mental health practitioners once trained. / Future work: The findings have important implications for the design of a longer-term impact evaluation of the programme, which is due to commence in summer 2023. / Study registration: Ethical approval from the University of Birmingham (ERN_19-1400 – RG_19-190) and London School of Hygiene and Tropical Medicine (Ref: 18040) and Health Research Authority approval (IRAS 270760). / Funding: The Birmingham, RAND and Cambridge Evaluation Rapid Evaluation Centre is funded by the National Institute for Health and Care Research Health Services and Delivery Research programme (HSDR 16/138/31). The Policy Innovation and Evaluation Research Unit is funded by the NIHR Policy Research Programme (PR-PRU-1217-20602)

The implementation of remote home monitoring models during the COVID-19 pandemic in England.

BACKGROUND: There is a paucity of evidence for the implementation of remote home monitoring for COVID-19 infection. The aims of this study were to identify the key characteristics of remote home monitoring models for COVID-19 infection, explore the experiences of staff implementing these models, understand the use of data for monitoring progress against outcomes, and document variability in staffing and resource allocation. METHODS: This was a multi-site mixed methods study conducted between July and August 2020 that combined qualitative and quantitative approaches to analyse the implementation and impact of remote home monitoring models developed during the first wave of the COVID-19 pandemic in England. The study combined interviews (n = 22) with staff delivering these models across eight sites in England with the collection and analysis of data on staffing models and resource allocation. FINDINGS: The models varied in relation to the healthcare settings and mechanisms used for patient triage, monitoring and escalation. Implementation was embedded in existing staff workloads and budgets. Good communication within clinical teams, culturally-appropriate information for patients/carers and the combination of multiple approaches for patient monitoring (app and paper-based) were considered facilitators in implementation. The mean cost per monitored patient varied from £400 to £553, depending on the model. INTERPRETATION: It is necessary to provide the means for evaluating the effectiveness of these models, for example, by establishing comparator data. Future research should also focus on the sustainability of the models and patient experience (considering the extent to which some of the models exacerbate existing inequalities in access to care)

Undertaking rapid evaluations during the COVID-19 pandemic: Lessons from evaluating COVID-19 remote home monitoring services in England

Introduction: Rapid evaluations can offer evidence on innovations in health and social care that can be used to inform fast-moving policy and practise, and support their scale-up according to previous research. However, there are few comprehensive accounts of how to plan and conduct large-scale rapid evaluations, ensure scientific rigour, and achieve stakeholder engagement within compressed timeframes. / Methods: Using a case study of a national mixed-methods rapid evaluation of COVID-19 remote home monitoring services in England, conducted during the COVID-19 pandemic, this manuscript examines the process of conducting a large-scale rapid evaluation from design to dissemination and impact, and reflects on the key lessons for conducting future large-scale rapid evaluations. In this manuscript, we describe each stage of the rapid evaluation: convening the team (study team and external collaborators), design and planning (scoping, designing protocols, study set up), data collection and analysis, and dissemination. / Results: We reflect on why certain decisions were made and highlight facilitators and challenges. The manuscript concludes with 12 key lessons for conducting large-scale mixed-methods rapid evaluations of healthcare services. We propose that rapid study teams need to: (1) find ways of quickly building trust with external stakeholders, including evidence-users; (2) consider the needs of the rapid evaluation and resources needed; (3) use scoping to ensure the study is highly focused; (4) carefully consider what cannot be completed within a designated timeframe; (5) use structured processes to ensure consistency and rigour; (6) be flexible and responsive to changing needs and circumstances; (7) consider the risks associated with new data collection approaches of quantitative data (and their usability); (8) consider whether it is possible to use aggregated quantitative data, and what that would mean when presenting results, (9) consider using structured processes & layered analysis approaches to rapidly synthesise qualitative findings, (10) consider the balance between speed and the size and skills of the team, (11) ensure all team members know roles and responsibilities and can communicate quickly and clearly; and (12) consider how best to share findings, in discussion with evidence-users, for rapid understanding and use. / Conclusion: These 12 lessons can be used to inform the development and conduct of future rapid evaluations in a range of contexts and settings

Staff experiences of training and delivery of remote home monitoring services for patients diagnosed with COVID-19 in England: A mixed-methods study

OBJECTIVES: Remote home monitoring services for patients at risk of rapid deterioration introduced during the COVID-19 pandemic had important implications for the health workforce. This study explored the nature of 'work' that health care staff in England undertook to manage patients with COVID-19 remotely, how they were supported to deliver these new services, and the factors that influenced delivery of COVID-19 remote home monitoring services for staff. METHODS: We conducted a rapid mixed-methods evaluation of COVID-19 remote home monitoring services during November 2020 to July 2021 using a cross-sectional survey of a purposive sample of staff involved in delivering the service (clinical leads, frontline delivery staff and those involved in data collection and management) from 28 sites across England. We also conducted interviews with 58 staff in a subsample of 17 sites. Data collection and analysis were carried out in parallel. We used thematic analysis to analyse qualitative data while quantitative survey data were analysed using descriptive statistics. RESULTS: A total of 292 staff responded to the surveys (39% response rate). We found that prior experience of remote monitoring had some, albeit limited benefit for delivering similar services for patients diagnosed with COVID-19. Staff received a range of locally specific training and clinical oversight along with bespoke materials and resources. Staff reported feeling uncertain about using their own judgement and being reliant on seeking clinical oversight. The experience of transitioning from face-to-face to remote service delivery led some frontline delivery staff to reconsider their professional role, as well as their beliefs around their own capabilities. There was a general perception of staff being able to adapt, acquire new skills and knowledge and they demonstrated a commitment to continuity of care for patients, although there were reports of struggling with the increased accountability and responsibility attached to their adapted roles at times. CONCLUSIONS: Remote home monitoring models can play an important role in managing a large number of patients for COVID-19 and possibly a range of other conditions. Successful delivery of such service models depends on staff competency and the nature of training received to facilitate effective care and patient engagement

Pre‐service teacher training and special educational needs in England 1970–2008: is government learning the lessons of the past or is it experiencing a groundhog day?

The paper outlines the findings from a literature review of the English government’s response to the issue of training pre‐service teachers in the delivery of effective special educational needs support. The review’s findings detail that although educational practice in mainstream classrooms has changed considerably since the 1970s the training of pre‐service teachers with regards to special educational needs has seemingly changed very little. The paper argues that the government needs to re‐think radically its policy of inclusion to ensure that a coherent plan is formulated which enables higher education institutions’ initial teacher training programmes to train students who are competent and confident in their abilities to work with children with special educational needs and/or disabilities

Active Children Through Individual Vouchers Evaluation: A Mixed-Method RCT

Introduction Physical activity declines in adolescence, especially among those in deprived areas. Research suggests this may result from accessibility barriers (e.g., cost and locality). The Active Children Through Individual Vouchers Evaluation RCT aimed to improve the fitness and heart health of teenagers in Wales with the help of teenagers who co-produced the study. Study design This study was a mixed-method RCT. Setting/participants Before data collection, which took place at baseline, 6 months, and 12 months for both arms, 7 schools were randomized by an external statistician (4 intervention schools, n=524; 3 control schools, n=385). Intervention The Active Children Through Individual Vouchers Evaluation intervention included provision of activity vouchers (£20 per month), a peer mentoring scheme, and support worker engagement for 12 months between January and December 2017. Data analysis occurred February–April 2018. Main outcome measures Data included measures of cardiovascular fitness, cardiovascular health (blood pressure and pulse wave analysis), motivation, and focus groups. Results The intervention showed a trend to improve the distance ran (primary outcome) and was significant in improving the likelihood of intervention teenagers being fit (OR=1.21, 95% CI=1.07, 1.38, p=0.002). There was a reduction in teenagers classified as having high blood pressure (secondary outcome) in the intervention group (baseline, 5.3% [28/524]; 12 months, 2.7% [14/524]). Data on where teenagers used vouchers and evidence from focus groups showed that teenagers wanted to access more unstructured, informal, and social activities in their local areas. Conclusions Active Children Through Individual Vouchers Evaluation identified methods that may have a positive impact on cardiovascular fitness, cardiovascular health, and perspectives of activity. Consulting with teenagers, empowering them, and providing more local opportunities for them to take part in activities that are fun, unstructured, and social could positively impact teenage physical activity