How do older adults self-manage distress and what role does the internet have? A qualitative study

Although anxiety and depression are common in older adults, the medical terms may not be acceptable to them. Older people are more likely to perceive themselves as experiencing distress, and may also feel responsible for managing their own mood problems. To self-manage distress, older people could potentially engage with the internet to access health information or social support. This study aims to explore how older adults self-manage distress, with a particular focus on the role of the internet. This study is underpinned by social constructionism and takes a qualitative approach towards data collection and analysis. Eighteen older adults (11 females, aged 65 – 91 years) who self-identified as experiencing distress were recruited from community groups in North Staffordshire, England. To generate data, 'think-aloud' methods (including storyboards and an extract from an online forum) were embedded within semi-structured interviews. Data were analysed thematically utilising constant comparison methods. A public and patient involvement and engagement group contributed to development of the research questions and methods, offered their perspectives on the findings and helped to create a dissemination plan. Findings focus on participants’ experiences of distress and actions taken, which included: pursuing independent activities, seeking social support and attending community groups and church. Five participants consulted a GP when distressed but reported being offered a lack of acceptable treatments. The internet was not considered a source of information about distress or mood problems and participants did not use the internet as a means of accessing social support. Implications for older adults, healthcare services and policy makers are discussed. When presented with a distressed older adult, GPs should begin by exploring the older person’s own understanding of their distress and its causes, provide information about different management options and consider directing older people to local third sector services. GPs may also need to take into consideration that sign-posting older people to online support might not be acceptable

Determining the influence of different linking patterns on the stability of students' score adjustments produced using Video-based Examiner Score Comparison and Adjustment (VESCA)

BACKGROUND: Ensuring equivalence of examiners' judgements across different groups of examiners is a priority for large scale performance assessments in clinical education, both to enhance fairness and reassure the public. This study extends insight into an innovation called Video-based Examiner Score Comparison and Adjustment (VESCA) which uses video scoring to link otherwise unlinked groups of examiners. This linkage enables comparison of the influence of different examiner-groups within a common frame of reference and provision of adjusted "fair" scores to students. Whilst this innovation promises substantial benefit to quality assurance of distributed Objective Structured Clinical Exams (OSCEs), questions remain about how the resulting score adjustments might be influenced by the specific parameters used to operationalise VESCA. Research questions, How similar are estimates of students' score adjustments when the model is run with either: fewer comparison videos per participating examiner?; reduced numbers of participating examiners? METHODS: Using secondary analysis of recent research which used VESCA to compare scoring tendencies of different examiner groups, we made numerous copies of the original data then selectively deleted video scores to reduce the number of 1/ linking videos per examiner (4 versus several permutations of 3,2,or 1 videos) or 2/examiner participation rates (all participating examiners (76%) versus several permutations of 70%, 60% or 50% participation). After analysing all resulting datasets with Many Facet Rasch Modelling (MFRM) we calculated students' score adjustments for each dataset and compared these with score adjustments in the original data using Spearman's correlations. RESULTS: Students' score adjustments derived form 3 videos per examiner correlated highly with score adjustments derived from 4 linking videos (median Rho = 0.93,IQR0.90-0.95,p < 0.001), with 2 (median Rho 0.85,IQR0.81-0.87,p < 0.001) and 1 linking videos (median Rho = 0.52(IQR0.46-0.64,p < 0.001) producing progressively smaller correlations. Score adjustments were similar for 76% participating examiners and 70% (median Rho = 0.97,IQR0.95-0.98,p < 0.001), and 60% (median Rho = 0.95,IQR0.94-0.98,p < 0.001) participation, but were lower and more variable for 50% examiner participation (median Rho = 0.78,IQR0.65-0.83, some ns). CONCLUSIONS: Whilst VESCA showed some sensitivity to the examined parameters, modest reductions in examiner participation rates or video numbers produced highly similar results. Employing VESCA in distributed or national exams could enhance quality assurance or exam fairness

Reflecting on activities which support public involvement within an evaluation of public involvement reports from facilities funded by the national institute for health and care research: a co-produced commentary

Although including public contributors as members of research teams is becoming common, there are few reflections on how they have been incorporated, and almost none of these reflections are co-produced with public contributors. This commentary, written by both academics and a public contributor, reflects on Patient and Public Involvement (PPI) activities when undertaking a framework analysis of PPI sections of annual reports from the National Institute for Health and care Research (NIHR) funded research centres. The UK Standards for Public Involvement (inclusive opportunities, working together, support and learning, communications, impact and governance) were used to structure our reflections. Key topics of reflection were: how difficult it is, in practice, to incorporate PPI into all aspects of the research cycle, especially when completing a commissioned research project on a short time-frame, and the complexities of incorporating PPI into qualitative analysis. Although useful when reflecting upon our own PPI practices, ways in which the UK Standards for Public Involvement could be improved were suggested. We hope that the co-produced recommendations can be used by other teams engaging with public contributors

Determining influence, interaction and causality of contrast and sequence effects in objective structured clinical exams

INTRODUCTION: Differential rater function over time (DRIFT) and contrast effects (examiners' scores biased away from the standard of preceding performances) both challenge the fairness of scoring in Objective Structured Clinical Exams (OSCEs). This is important as, under some circumstances, these effects could alter whether some candidates pass or fail assessments. Benefitting from experimental control, this study investigated the causality, operation and interaction of both effects simultaneously for the first time in an OSCE setting. METHODS: We used secondary analysis of data from an OSCE in which examiners scored embedded videos of student performances interspersed between live students. Embedded video position varied between examiners (early vs late) whilst the standard of preceding performances naturally varied (previous high or low). We examined linear relationships suggestive of DRIFT and contrast effects in all within-OSCE data before comparing the influence and interaction of "Early" vs "Late" and "PreviousHigh" vs "PreviousLow" conditions on embedded video scores. RESULTS: Linear relationships data did not support the presence of DRIFT or contrast effects. Embedded videos were scored higher early (19.9(19.4-20.5)) vs late (18.6(18.1-19.1), p<0.001) but scores did not differ between PreviousHigh and PreviousLow conditions. The interaction term was non-significant. CONCLUSIONS: In this instance, the small DRIFT effect we observed on embedded video can be causally attributed to examiner behaviour. Contrast effects appear less ubiquitous than some prior research suggests. Possible mediators of these finding include: OSCE context, detail of task specification, examiners' cognitive load and the distribution of learners' ability. As the operation of these effects appears to vary across contexts, further research is needed to determine the prevalence and mechanisms of contrast and DRIFT effects, so that assessments may be designed in ways which are likely to avoid their occurrence. Quality assurance should monitor for these contextually variable effects in order to ensure OSCE equivalence

Applying the consolidated framework for implementation research to evaluate the community rapid intervention service

Abstract Background Developed in 2019, the Community Rapid Intervention Service (CRIS) is a community intervention service aiming to prevent hospital admissions. CRIS provides a response within two hours to patients with sub-acute medical needs in their usual place of residence. This evaluation aimed to identify challenges and facilitators to implementation of the service, with a view to informing future service development, optimising patient care and disseminating learning to other areas looking to implement similar services. Methods This study used the Consolidated Framework for Implementation Research (CFIR) as an evaluation framework. We conducted semi-structured interviews with local healthcare system leaders, clinicians that worked within the CRIS, and clinicians who interfaced with the CRIS. The CFIR was used to guide data collection and analysis. Two Community of Practice (CoP) meetings were held to gather stakeholders’ perspectives of the evaluation. Results Three key themes were identified from the analysis of 13 interviews: contextual factors influencing implementation, service identity and navigating complexity. Contextual factors such the influence of the Covid 19 pandemic upon health services and the expansion of the CRIS were discussed by participants. The adaptability of the service was deemed both a facilitator and challenge of implementation. Ways to build-on and improve the existing CRIS model were suggested. Conclusion This evaluation has shown that the CRIS may need to be redefined with clarity provided as to how the service interfaces with other urgent and planned care offered in acute, primary, community and social services. Structuring the evaluation around the CFIR was helpful in identifying facilitators and challenges that influenced the implementation of the CRIS

Using the UK standards for public involvement to evaluate the public involvement sections of annual reports from NIHR managed research centres

Abstract Background Within the United Kingdom (UK), the National Institute for Health and Care Research is the largest funder of health and social care research, and additionally funds research centres that support the development and delivery of research. Each year, award-holders of these research centres are required to write a report about their activities, including a summary of Patient and Public Involvement and Engagement (PPIE) activities. This study aimed to evaluate the PPIE sections of annual reports to identify best practice and challenges; this could inform future delivery of PPIE activities. Methods A framework documentary analysis informed by the six UK Standards for Public Involvement (‘Inclusive opportunities’, ‘Working together’, ‘Support and learning’, ‘Communications’, ‘Impact’ and ‘Governance’) was conducted on 112 reports. A quality improvement framework (‘Insights’) was used to evaluate quality as one of: ‘Welcoming’, ‘Listening’, ‘Learning’ and ‘Leading’. Recommendations from this review were co-developed with stakeholders and public contributors. Results Reports documented varying levels of quality in PPIE activities which spanned across all six UK Standards. Award-holders either intended to, or were actively working towards, increasing access and inclusivity of public involvement opportunities. Methods of working with public contributors were varied, including virtual and in-person meetings. Most award-holders offered PPIE support and learning opportunities for both public contributors and staff. Some award-holders invited public contributors to co-produce communication plans relating to study materials and research findings. The impact of public involvement was described in terms of benefits to public contributors themselves, and on an organisation and project level. Many award-holders reported inviting public contributors to share decision-making within and about governance structures. Conclusions This evaluation identified that most annual reports contained evidence of good quality PPIE practice with learning from public contributors. Using the UK Standards and Insights framework enabled exploration of the breadth and quality of PPIE activities. Recommendations include the need for a platform for centres to access and share PPIE best practice and for centres to collaborate with local and national partners to build relationships with the public through inclusive community engagement

A proposal to embed Patient and Public Involvement within qualitative data collection and analysis phases of a Primary Care based implementation study

BackgroundPatient and public involvement (PPI) is increasingly seen as essential to health service research. There are strong moral and ethical arguments for good quality PPI. Despite the development of guidance aimed at addressing the inconsistent reporting of PPI activities within research, little progress has been made in documenting the steps taken to undertake PPI and how it influences the direction of a study. Without this information, there are minimal opportunities to share learnings across projects and strengthen future PPI practices. The aim of this paper is to present details on the processes and activities planned to integrate PPI into the qualitative research component of a mixed-methods, multi-site study evaluating the implementation of a smart template to promote personalised primary care for patients with multiple long-term conditions.MethodsThis proposal describes the processes and activities planned to integrate PPI into the development and piloting of qualitative data collection tools (topic guides for both practice staff and patients) and a tailored data analysis package developed for PPI members incorporating broad concepts and specific methods of qualitative data analysis.DiscussionOutputs relating to PPI activity may include clear, concise and suitably worded topic guides for qualitative interviews. Piloting of the topic guides via mock interviews will further develop researchers’ skills including sensitisation to the experiences of participants being interviewed. Working with PPI members when analysing the qualitative data aims to provide reciprocal learning opportunities and may contribute to improving the overall rigour of the data analysis. The intent of publishing proposed PPI activities within this project is to inform the future delivery of high quality PPI

An evaluation of a public partnership project between academic institutions and young people with Black African, Asian and Caribbean heritage

Background: This project (named Reinvent) aimed to promote Public Involvement (PI) in health research. Academics worked with a community group, the Eloquent Praise & Empowerment Dance Company, to develop a community partnership with young people from Black African, Asian and Caribbean heritage communities. The goal of this paper is to evaluate the Reinvent project for key learnings on how to engage and build partnerships with young people from Black African, Asian and Caribbean heritage communities. Methods: Reinvent developed a steering group which consisted of five young people, one academic, a Race Equality Ambassador and the Director of Eloquent. The steering group co-produced an agenda for two workshops and the evaluation tools used. The content of the workshops included drama exercises, discussions on physical and mental health, nutrition and school-life, short introductions to the concepts of research and PI, and group work to critique and improve a video currently used to promote PI in health research to young people. The evaluation tools included using the ‘Cube’ evaluation framework, video-blogging and collecting anonymous feedback. Findings The responses to the ‘Cube’ evaluation framework were positive across all four domains (agenda, voice, contribute change) in both workshops. A few of the young people described having a better understanding of the meaning and practice of PI in a video-blog. The anonymous feedback suggested that the workshops had increased young people’s confidence in sharing their thoughts and opinions about health and PI. Conclusion: Reinvent has shown that academic institutions and young people from an under-served community can partner to co-design workshops and apply evaluation tools. Working with young people in an environment in which they were comfortable, and by researchers joining in with the activities that the young people enjoyed (such as dance), enabled more informal and open conversations to develop. More work is needed to build upon this project so that young people can feel confident and supported to get involved in PI activities relating to research