The Effect of Embedding Formative Assessment on Pupil Attainment

Evidence suggests that adapting teaching responsively to pupil assessment can be effective in improving students’ learning. However, existing studies tend to be small-scale, leaving unanswered the question of how such formative assessment can operate when embedded as standard practice. In this study, we present the results of a randomized trial conducted in 140 English secondary schools. The intervention uses light-touch training and support, with most of the work done by teacher-led teaching and learning communities within schools. It is, therefore, well-suited to widespread adoption. In our pre-registered primary analysis, we estimate an effect size of 0.09 on general academic attainment in national, externally assessed examinations. Sensitivity analysis, excluding schools participating in a similar program at baseline, and complier analysis both suggest a larger effect size of 0.11. These results are encouraging for this approach to improving the implementation of formative assessment and, hence, academic attainment. Our findings also suggest that the intervention may help to narrow the gap between high and low prior attainment pupils, although not the gap between those from disadvantaged backgrounds and the rest of the cohort

Accuracy of efficient data methods to determine the incidence of hospital-acquired thrombosis and major bleeding in medical and surgical inpatients: a multicentre observational cohort study in four UK hospitals

Objectives We evaluated the accuracy of using routine health service data to identify hospital-acquired thrombosis (HAT) and major bleeding events (MBE) compared with a reference standard of case note review. Design A multicentre observational cohort study. Setting Four acute hospitals in the UK. Participants A consecutive unselective cohort of general medical and surgical patients requiring hospitalisation for a period of >24 hours during the calendar year 2021. We excluded paediatric, obstetric and critical care patients due to differential risk profiles. Interventions We compared preidentified sources of routinely collected information (using hospital coding data and local contractually mandated thrombosis datasets) to data extracted from case notes using a predesigned workflow methodology. Primary and secondary outcome measures We defined HAT as objectively confirmed venous thromboembolism occurring during hospital stay or within 90 days of discharge and MBE as per international consensus. Results We were able to source all necessary routinely collected outcome data for 87% of 2008 case episodes reviewed. The sensitivity of hospital coding data (International Classification of Diseases 10th Revision, ICD-10) for the diagnosis of HAT and MBE was 62% (95% CI, 54 to 69) and 38% (95% CI, 27 to 50), respectively. Sensitivity improved to 81% (95% CI, 75 to 87) when using local thrombosis data sets. Conclusions Using routinely collected data appeared to miss a substantial proportion of outcome events, when compared with case note review. Our study suggests that currently available routine data collection methods in the UK are inadequate to support efficient study designs in venous thromboembolism research

The effect of embedding formative assessment on pupil attainment

Evidence suggests that adapting teaching responsively to pupil assessment can be effective in improving students’ learning. However, existing studies tend to be small-scale, leaving unanswered the question of how such formative assessment can operate when embedded as standard practice. In this study, we present the results of a randomized trial conducted in 140 English secondary schools. The intervention uses light-touch training and support, with most of the work done by teacher-led teaching and learning communities within schools. It is, therefore, well-suited to widespread adoption. In our pre-registered primary analysis, we estimate an effect size of 0.09 on general academic attainment in national, externally assessed examinations. Sensitivity analysis, excluding schools participating in a similar program at baseline, and complier analysis both suggest a larger effect size of 0.11. These results are encouraging for this approach to improving the implementation of formative assessment and, hence, academic attainment. Our findings also suggest that the intervention may help to narrow the gap between high and low prior attainment pupils, although not the gap between those from disadvantaged backgrounds and the rest of the cohort

Protocol for the ORION trial (RadiO fRequency ablatION for haemorrhoids): a randomised controlled trial

Background Haemorrhoids are common and can significantly impact the personal and working lives of individuals. Those with more severe symptoms and those not responding to conservative management may require surgery. Current surgical techniques are associated with a degree of postoperative discomfort which may delay return to normal activity. Recurrence is lower in more radical procedures but resulting pain is higher. Radiofrequency ablation (RFA) is a new technique that is gaining popularity and has several hypothesised benefits, including reduced pain and recurrence. However, available evidence is limited. A recent overview from the National Institute for Health and Clinical Excellence recommended more research, in the form of randomised controlled trials, be carried out before further investment is made by national health services. Our aim is to assess whether RFA is at least as good in terms of recurrence as existing surgical interventions, but superior in terms of pain, for patients with symptomatic grade II and III haemorrhoids. Methods The RadiO fRequency ablatION for haemorrhoids (ORION) trial will be a pragmatic multicentre patient/assessorblind parallel group-controlled trial with economic evaluation. The target sample size is 376 participants (188 per arm) and is based on two co-primary endpoints: (i) a non-inferiority design for recurrence and (ii) superiority design for pain at seven days. Participants with grade II or III haemorrhoids will be recruited in 16 National Health Service hospitals and randomised (1:1) to either RFA or surgeon’s choice of surgery. Conclusions Results will inform future practice for the treatment of grade II–III haemorrhoids and provide evidence for national health services on future investments in RFA

A randomized controlled trial of a proportionate universal parenting program delivery model (E-SEE Steps) to enhance child social-emotional wellbeing

Background Evidence for parenting programs to improve wellbeing in children under three is inconclusive. We investigated the fidelity, impact, and cost-effectiveness of two parenting programs delivered within a longitudinal proportionate delivery model (‘E-SEE Steps’). Methods Eligible parents with a child ≤ 8 weeks were recruited into a parallel two-arm, assessor blinded, randomized controlled, community-based, trial with embedded economic and process evaluations. Post-baseline randomization applied a 5:1 (intervention-to-control) ratio, stratified by primary (child social-emotional wellbeing (ASQ:SE-2)) and key secondary (maternal depression (PHQ-9)) outcome scores, sex, and site. All intervention parents received the Incredible Years® Baby Book (IY-B), and were offered the targeted Infant (IY-I)/Toddler (IY-T) program if eligible, based on ASQ:SE-2/PHQ-9 scores. Control families received usual services. Fidelity data were analysed descriptively. Primary analysis applied intention to treat. Effectiveness analysis fitted a marginal model to outcome scores. Cost-effectiveness analysis involved Incremental Cost-Effectiveness Ratios (ICERs). Results The target sample (N = 606) was not achieved; 341 mothers were randomized (285:56), 322 (94%) were retained to study end. Of those eligible for the IY-I (n = 101), and IY-T (n = 101) programs, 51 and 21 respectively, attended. Eight (of 14) groups met the 80% self-reported fidelity criteria. No significant differences between arms were found for adjusted mean difference scores; ASQ:SE-2 (3.02, 95% CI: -0.03, 6.08, p = 0.052), PHQ-9 (-0.61; 95% CI: -1.34, 0.12, p = 0.1). E-SEE Steps had higher costs, but improved mothers’ Health-related Quality of Life (0.031 Quality Adjusted Life Year (QALY) gain), ICER of £20,062 per QALY compared to control. Serious adverse events (n = 86) were unrelated to the intervention. Conclusions E-SEE Steps was not effective, but was borderline cost-effective. The model was delivered with varying fidelity, with lower-than-expected IY-T uptake. Changes to delivery systems and the individual programs may be needed prior to future evaluation. Trial registration International Standard Randomized Controlled Trial Number: ISRCTN11079129

Acceptance and Commitment Therapy for people living with motor neuron disease: an uncontrolled feasibility study

Background: Motor neuron disease (MND) is a fatal, progressive neurodegenerative disease that causes progressive weakening and wasting of limb, bulbar, thoracic and abdominal muscles. Clear evidence-based guidance on how psychological distress should be managed in people living with MND (plwMND) is lacking. Acceptance and Commitment Therapy (ACT) is a form of psychological therapy that may be particularly suitable for this population. However, to the authors' knowledge, no study to date has evaluated ACT for plwMND. Consequently, the primary aim of this uncontrolled feasibility study was to examine the feasibility and acceptability of ACT for improving the psychological health of plwMND. Methods: PlwMND aged ≥ 18 years were recruited from 10 UK MND Care Centres/Clinics. Participants received up to 8 one-to-one ACT sessions, developed specifically for plwMND, plus usual care. Co-primary feasibility and acceptability outcomes were uptake (≥ 80% of the target sample [N = 28] recruited) and initial engagement with the intervention (≥ 70% completing ≥ 2 sessions). Secondary outcomes included measures of quality of life, anxiety, depression, disease-related functioning, health status and psychological flexibility in plwMND and quality of life and burden in caregivers. Outcomes were assessed at baseline and 6 months. Results: Both a priori indicators of success were met: 29 plwMND (104%) were recruited and 76% (22/29) attended ≥ 2 sessions. Attrition at 6-months was higher than anticipated (8/29, 28%), but only two dropouts were due to lack of acceptability of the intervention. Acceptability was further supported by good satisfaction with therapy and session attendance. Data were possibly suggestive of small improvements in anxiety and psychological quality of life from baseline to 6 months in plwMND, despite a small but expected deterioration in disease-related functioning and health status. Conclusions: There was good evidence of acceptability and feasibility. Limitations included the lack of a control group and small sample size, which complicate interpretation of findings. A fully powered RCT to evaluate the clinical and cost-effectiveness of ACT for plwMND is underway

Cost-utility analysis of LEGO based therapy for school children and young people with autism spectrum disorder: results from a randomised controlled trial.

Objectives: To assess the cost-effectiveness of LEGO-based therapy compared with usual support. Design: Cost-utility analysis alongside randomised control trial. Setting: Mainstream primary and secondary schools in the UK. Participants: 248 children and young people (CYP) with autism spectrum disorder (ASD) aged 7–15 years. Intervention: LEGO-based therapy is a group social skills intervention designed specifically for CYP with ASD. Through play, CYP learn to use the skills such as joint attention, sharing, communication and group problem-solving. CYP randomised to the intervention arm received 12 weekly sessions of LEGO-based therapy and usual support, while CYP allocated to control arm received usual support only. Main outcome measures: Average costs based on National Health Service (NHS) and personal social services perspective and quality-adjusted life years (QALYs) measured by EQ-5D-Y over time horizon of 1 year were collected during the trial. Incremental cost-effectiveness ratio (ICER) was calculated, and non-parametric bootstrapping was conducted. The uncertainty around the ICER estimates was presented using cost-effectiveness acceptability curve (CEAC). A set of sensitivity analyses were conducted to assess the robustness of the primary findings. Results: After adjustment and bootstrapping, on average, CYP in LEGO-based therapy group incurred less costs (incremental cost was −£251 (95% CI −£752 to £268)) and gained marginal improvement in QALYs (QALYs gained 0.009 (95% CI −0.008 to 0.028)). The CEAC shows that the probability of LEGO-based therapy being cost-effective was 94% at the willingness-to-pay threshold of £20 000 per QALY gained. Results of sensitivity analyses were consistent with the primary outcomes. Conclusion: Compared with usual support, LEGO-based therapy produced marginal reduction in costs and improvement in QALYs. Results from both primary and sensitivity analyses suggested that LEGO-based therapy was likely to be cost-effective. Trial registration number: ISRCTN64852382

I-SOCIALISE: Results from a cluster randomised controlled trial investigating the social competence and isolation of children with autism taking part in LEGO® based therapy (‘Play Brick Therapy’) clubs in school environments

Social learning through friendships is important in child development. Autistic children often initiate and engage in social interactions differently than neurotypical peers. LEGO® based therapy is a group intervention which facilitates social interactions with peers using collaborative LEGO® play. A 1:1 cluster randomised controlled trial with autistic children aged 7–15 comparing 12 weeks’ LEGO® based therapy and usual support to usual support alone in 98 mainstream schools (2017–2019) was carried out. The primary outcome was social skills (Social Skills Improvement System) completed by unblinded teachers (not intervention deliverers) at 20 weeks. Analysis used intention-to-treat. Fifty intervention schools (127 participants) and 48 control schools (123 participants) were allocated. Primary analysis included 45 intervention schools (116 participants) and 42 control schools (101 participants). The between-arms difference was 3.74 (p = 0.06, 95% confidence interval: −0.16, 7.63) and 1.68 (p = 0.43, 95% confidence interval: −2.51, 5.87) at 20 and 52 weeks (0.18 and 0.08 standardised effect sizes). Twenty-week outcomes for those receiving per protocol intervention were 4.23 (95% confidence interval 0.27, 8.19) with a standardised effect size of 0.21. Sensitivity estimates were between 3.10 and 4.37 (0.15–0.21 standardised effect sizes). Three unrelated serious adverse events were reported. LEGO® based therapy has a small positive non-significant benefit for social skills at 20 weeks but not 52 weeks. Lay abstract Autism is characterised by keen interests and differences in social interactions and communication. Activities that help autistic children and young people with social skills are commonly used in UK schools. LEGO® based therapy is a new activity that provides interesting and fun social opportunities for children and young people and involves building LEGO® models together. This study looked at LEGO® based therapy for the social skills of autistic children and young people in schools. It was a randomised controlled trial, meaning each school was randomly chosen (like flipping a coin) to either run LEGO® based therapy groups in school over 12 weeks and have usual support from school or other professionals, or only have usual support from school or other professionals. The effect of the LEGO® based therapy groups was measured by asking children and young people, their parents/guardians, and a teacher at school in both arms of the study to complete some questionnaires. The main objective was to see if the teacher’s questionnaire answers about the children and young people’s social skills changed between their first and second completions. The social skills of participants in the LEGO® based therapy groups were found to have improved in a small way when compared to usual support only. The study also found that LEGO® based therapy was not very costly for schools to run and parents/guardians and teachers said they thought it was good for their children and young people. We suggest further research into different potential benefits of LEGO® based therapy

Prognostic accuracy of emergency department triage tools for adults with suspected COVID-19: the PRIEST observational cohort study

Background The WHO and National Institute for Health and Care Excellence recommend various triage tools to assist decision-making for patients with suspected COVID-19. We aimed to compare the accuracy of triage tools for predicting severe illness in adults presenting to the ED with suspected COVID-19. Methods We undertook a mixed prospective and retrospective observational cohort study in 70 EDs across the UK. We collected data from people attending with suspected COVID-19 and used presenting data to determine the results of assessment with the WHO algorithm, National Early Warning Score version 2 (NEWS2), CURB-65, CRB-65, Pandemic Modified Early Warning Score (PMEWS) and the swine flu adult hospital pathway (SFAHP). We used 30-day outcome data (death or receipt of respiratory, cardiovascular or renal support) to determine prognostic accuracy for adverse outcome. Results We analysed data from 20 891 adults, of whom 4611 (22.1%) died or received organ support (primary outcome), with 2058 (9.9%) receiving organ support and 2553 (12.2%) dying without organ support (secondary outcomes). C-statistics for the primary outcome were: CURB-65 0.75; CRB-65 0.70; PMEWS 0.77; NEWS2 (score) 0.77; NEWS2 (rule) 0.69; SFAHP (6-point rule) 0.70; SFAHP (7-point rule) 0.68; WHO algorithm 0.61. All triage tools showed worse prediction for receipt of organ support and better prediction for death without organ support. At the recommended threshold, PMEWS and the WHO criteria showed good sensitivity (0.97 and 0.95, respectively) at the expense of specificity (0.30 and 0.27, respectively). The NEWS2 score showed similar sensitivity (0.96) and specificity (0.28) when a lower threshold than recommended was used. Conclusion CURB-65, PMEWS and the NEWS2 score provide good but not excellent prediction for adverse outcome in suspected COVID-19, and predicted death without organ support better than receipt of organ support. PMEWS, the WHO criteria and NEWS2 (using a lower threshold than usually recommended) provide good sensitivity at the expense of specificity. Trial registration number ISRCTN56149622