The predictive validity of multiple mini interviews (MMIs) in nursing and midwifery programmes: year three findings from a cross-discipline cohort study

Education literature worldwide is replete with studies evaluating the effectiveness of Multiple Mini Interviews (MMIs) in admissions to medicine but <1% of published studies have been conducted in selection to nursing and midwifery programmes. To examine the predictive validity of MMIs using end of programme clinical and academic performance indicators of pre-registration adult, child, and mental health nursing and midwifery students. A cross-sectional cohort study at one university in the United Kingdom. A non-probability consecutive sampling strategy whereby all applicants to the September 2015 pre-registration adult, child, mental health nursing and midwifery programmes were invited to participate. Of the 354 students who commenced year one, 225 (64%) completed their three-year programme and agreed to take part (adult 120, child 32, mental health nursing 30 and midwifery 43). All applicants were interviewed using MMIs with six and seven station, four-minute models deployed in nursing and midwifery student selection respectively. Associations between MMI scores and the cross-discipline programme performance indicators available for each student at this university at the end of year three: clinical practice (assessed by mentors) and academic attainment (dissertation mark) were explored using multiple linear regression adjusting for applicant age, academic entry level, discipline and number of MMI stations. In the adjusted models, students with higher admissions MMI score (at six and seven stations) performed better in clinical practice (p < 0.001) but not in academic attainment (p = 0.122) at the end of their three-year programme. These findings provide the first report of the predictive validity of MMIs for performance in clinical practice using six and seven station models in nursing and midwifery programmes. Further evidence is required from both clinical and academic perspectives from larger, multi-site evaluations. [Abstract copyright: Crown Copyright © 2019. Published by Elsevier Ltd. All rights reserved.

The reliability and validity of multiple mini interviews (MMIs) in values based recruitment to nursing, midwifery and paramedic practice: Findings from an evaluation study

Background: Universities in the United Kingdom (UK) are required to incorporate values based recruitment (VBR) into their healthcare student selection processes. This reflects an international drive to strengthen the quality of healthcare service provision. This paper presents novel findings in relation to the reliability and predictive validity of multiple mini interviews (MMIs); one approach to VBR widely being employed by universities. Objectives: To examine the reliability (internal consistency) and predictive validity of MMIs using end of Year One practice outcomes of under-graduate pre-registration adult, child, mental health nursing, midwifery and paramedic practice students. Design: Cross-discipline evaluation study. Setting: One university in the United Kingdom. Participants: Data were collected in two streams: applicants to A) The September 2014 and 2015 Midwifery Studies programmes; B) September 2015 adult; Child and Mental Health Nursing and Paramedic Practice programmes. Fifty-seven midwifery students commenced their programme in 2014 and 69 in 2015; 47 and 54 agreed to participate and completed Year One respectively. 333 healthcare students commenced their programmes in September 2015. Of these, 281 agreed to participate and completed their first year (180 adult, 33 child and 34 mental health nursing and 34 paramedic practice students). Methods: Stream A featured a seven station four-minute model with one interviewer at each station and in Stream B a six station model was employed. Cronbach’s alpha was used to assess MMI station internal consistency and Pearson’s moment correlation co-efficient to explore associations between participants’ admission MMI score and end of Year one clinical practice outcomes (OSCE and mentor grading). Results: Stream A: Significant correlations are reported between midwifery applicant’s MMI scores and end of Year One practice outcomes. A multivariate linear regression model demonstrated that MMI score significantly predicted end of Year One practice outcomes controlling for age and academic entry level: coefficients 0.195 (p = 0.002) and 0.116 (p = 0.002) for OSCE and mentor grading respectively. In Stream B no significant correlations were found between MMI score and practice outcomes measured by mentor grading. Internal consistency for each MMI station was ‘excellent’ with values ranging from 0.966–0.974 across Streams A and B. Conclusion: This novel, cross-discipline study shows that MMIs are reliable VBR tools which have predictive validity when a seven station model is used. These data are important given the current international use of different MMI models in healthcare student selection processes

Symptom clusters for revising scale membership in the analysis of prostate cancer patient reported outcome measures: a secondary data analysis of the Medical Research Council RT01 trial (ISCRTN47772397).

Purpose To investigate the role of symptom clusters in the analysis and utilisation of patient reported outcome measures (PROMs) for data modelling and clinical practice. To compare symptom clusters with scales, and to explore their value in PROMs interpretation and symptom management.Methods A dataset called RT01 (ISCRTN47772397) of 843 prostate cancer patients was used. PROMs were reported with the University of California, Los Angeles Prostate Cancer Index (UCLA-PCI). Symptom clusters were explored with hierarchical cluster analysis (HCA) and average linkage method (correlation > 0.6). The reliability of the Urinary Function Scale was evaluated with Cronbach's Alpha. The strength of the relationship between the items was investigated with Spearman's correlation. Predictive accuracy of the clusters was compared to the scales by receiver operating characteristic (ROC) analysis. Presence of urinary symptoms at 3 years measured with the late effects on normal tissue: subjective, objective, management tool (LENT/SOM) was an endpoint.Results Two symptom clusters were identified (urinary cluster and sexual cluster). The grouping of symptom clusters was different than UCLA-PCI Scales. Two items of the urinary function scales ("number of pads" and "urinary leak interfering with sex") were excluded from the urinary cluster. The correlation with the other items in the scale ranged from 0.20 to 0.21 and 0.31 to 0.39, respectively. Cronbach's Alpha showed low correlation of those items with the Urinary Function Scale (0.14-0.36 and 0.33-0.44, respectively). All urinary function scale items were subject to a ceiling effect. Clusters had better predictive accuracy, AUC = 0.70 -0.65, while scales AUC = 0.67-0.61.Conclusion This study adds to the knowledge on how cluster analysis can be applied for the interpretation and utilisation of PROMs. We conclude that multiple-item scales should be evaluated and that symptom clusters provide a study-specific approach for modelling and interpretation of PROMs

Determining the feasibility of calculating pancreatic cancer risk scores for people with new-onset diabetes in primary care (DEFEND PRIME): study protocol

Introduction Worldwide, pancreatic cancer has a poor prognosis. Early diagnosis may improve survival by enabling curative treatment. Statistical and machine learning diagnostic prediction models using risk factors such as patient demographics and blood tests are being developed for clinical use to improve early diagnosis. One example is the Enriching New-onset Diabetes for Pancreatic Cancer (ENDPAC) model, which employs patients’ age, blood glucose and weight changes to provide pancreatic cancer risk scores. These values are routinely collected in primary care in the UK. Primary care’s central role in cancer diagnosis makes it an ideal setting to implement ENDPAC but it has yet to be used in clinical settings. This study aims to determine the feasibility of applying ENDPAC to data held by UK primary care practices. Methods and analysis This will be a multicentre observational study with a cohort design, determining the feasibility of applying ENDPAC in UK primary care. We will develop software to search, extract and process anonymised data from 20 primary care providers’ electronic patient record management systems on participants aged 50+ years, with a glycated haemoglobin (HbA1c) test result of ≥48 mmol/mol (6.5%) and no previous abnormal HbA1c results. Software to calculate ENDPAC scores will be developed, and descriptive statistics used to summarise the cohort’s demographics and assess data quality. Findings will inform the development of a future UK clinical trial to test ENDPAC’s effectiveness for the early detection of pancreatic cancer. Ethics and dissemination This project has been reviewed by the University of Surrey University Ethics Committee and received a favourable ethical opinion (FHMS 22-23151 EGA). Study findings will be presented at scientific meetings and published in international peer-reviewed journals. Participating primary care practices, clinical leads and policy makers will be provided with summaries of the findings

BMI and HbA1c are metabolic markers for pancreatic cancer: matched case-control study using a UK primary care database

Background Weight loss, hyperglycaemia and diabetes are known features of pancreatic cancer. We quantified the timing and the amount of changes in body mass index (BMI) and glycated haemoglobin (HbA1c), and their association with pancreatic cancer from five years before diagnosis. Methods A matched case-control study was undertaken within 590 primary care practices in England, United Kingdom. 8,777 patients diagnosed with pancreatic cancer (cases) between 1st January 2007 and 31st August 2020 were matched to 34,979 controls by age, gender and diabetes. Longitudinal trends in BMI and HbA1c were visualised. Odds ratios adjusted for demographic and lifestyle factors (aOR) and 95% confidence intervals (CI) were calculated with conditional logistic regression. Subgroup analyses were undertaken according to the diabetes status. Results Changes in BMI and HbA1c observed for cases on longitudinal plots started one and two years (respectively) before diagnosis. In the year before diagnosis, a 1 kg/m2 decrease in BMI between cases and controls was associated with aOR for pancreatic cancer of 1.05 (95% CI 1.05 to 1.06), and a 1 mmol/mol increase in HbA1c was associated with aOR of 1.06 (1.06 to 1.07). ORs remained statistically significant (p < 0.001) for 2 years before pancreatic cancer diagnosis for BMI and 3 years for HbA1c. Subgroup analysis revealed that the decrease in BMI was associated with a higher pancreatic cancer risk for people with diabetes than for people without (aORs 1.08, 1.06 to 1.09 versus 1.04, 1.03 to 1.05), but the increase in HbA1c was associated with a higher risk for people without diabetes than for people with diabetes (aORs 1.09, 1.07 to 1.11 versus 1.04, 1.03 to 1.04). Conclusions The statistically significant changes in weight and glycaemic control started three years before pancreatic cancer diagnosis but varied according to the diabetes status. The information from this study could be used to detect pancreatic cancer earlier than is currently achieved. However, regular BMI and HbA1c measurements are required to facilitate future research and implementation in clinical practice

Linking CHHiP prostate cancer RCT with GP records: A study proposal to investigate the effect of co-morbidities and medications on long-term symptoms and radiotherapy-related toxicity.

Background Patients receiving cancer treatment often have one or more co-morbid conditions that are treated pharmacologically. Co-morbidities are recorded in clinical trials usually only at baseline. However, co-morbidities evolve and new ones emerge during cancer treatment. The interaction between multi-morbidity and cancer recovery is significant but poorly understood.Purpose To investigate the effect of co-morbidities (e.g. cardiovascular and diabetes) and medications (e.g. statins, antihypertensives, metformin) on radiotherapy-related toxicity and long-term symptoms in order to identify potential risk factors. The possible protective effect of medications such as statins or antihypertensives in reducing radiotherapy-related toxicity will also be explored.Methods Two datasets will be linked. (1) CHHiP (Conventional or Hypofractionated High Dose Intensity Modulated Radiotherapy for Prostate Cancer) randomised control trial. CHHiP contains pelvic symptoms and radiation-related toxicity reported by patients and clinicians. (2) GP (General Practice) data from RCGP RSC (Royal College of General Practitioners Research and Surveillance Centre). The GP records of CHHiP patients will be extracted, including cardiovascular co-morbidities, diabetes and prescription medications. Statistical analysis of the combined dataset will be performed in order to investigate the effect.Conclusions Linking two sources of healthcare data is an exciting area of big healthcare data research. With limited data in clinical trials (not all clinical trials collect information on co-morbidities or medications) and limited lengths of follow-up, linking different sources of information is increasingly needed to investigate long-term outcomes. With increasing pressures to collect detailed information in clinical trials (e.g. co-morbidities, medications), linkage to routinely collected data offers the potential to support efficient conduct of clinical trials

Patient-reported Outcome Measures in Radiotherapy: Clinical Advances and Research Opportunities in Measurement for Survivorship

Patient-reported outcome measures (PROMs) are a useful way of recording patient perceptions of the impact of their cancer and the consequences of treatment. Understanding the impact of radiotherapy longer term requires tools that are sensitive to change but also meaningful for patients. PROMs are useful in defining symptom severity but also the burden of illness for cancer patients. Patient-reported outcomes are increasingly being seen as a way to improve practice by enhancing communication, improving symptom management as well as identifying patient care needs. This paper provides an overview of the use of PROMs in radiotherapy and considerations for tool choice, analysis and the logistics of routine data collection. Consistent assessment is essential to detect patient problems as a result of radiotherapy, but also to address emerging symptoms promptly

Proceedings of Patient Reported Outcome Measure’s (PROMs) Conference Oxford 2017: Advances in Patient Reported Outcomes Research

A33-Effects of Out-of-Pocket (OOP) Payments and Financial Distress on Quality of Life (QoL) of People with Parkinson’s (PwP) and their Carer