An evaluation of a personalised text message reminder compared to a standard text message on postal questionnaire response rates: an embedded randomised controlled trial

Abstract Background: Research outcome data is commonly collected using postal questionnaires; however, poor response can introduce bias and reduce statistical power. Text messaging is simple, cost-effective, and can be customised to the individual. Personalised, reminder text messages may improve response rates. Methods: A two-arm, parallel group ‘Study within a Trial’ (SWAT) was embedded within the Occupational Therapist Intervention Study (OTIS), a randomised controlled trial of a home assessment for falls prevention in older people. OTIS participants who provided a mobile phone number were randomly allocated (1:1) to receive either a personalised text message (Title, Surname, plus York Trials Unit (YTU) text) or the standard YTU text alone, prior to receiving their four-month post-randomisation follow-up postal questionnaire. The primary outcome measure was the proportion of participants who returned the questionnaire. Secondary outcomes were: time to response, completeness of response, requirement of a reminder letter, and cost-effectiveness. Binary data were compared using logistic regression and time to response by Cox Proportional Hazards regression. Results: A total of 403 participants were randomised: 201 to the personalised text and 202 to the standard text. Of the 283 participants included in the final analysis, 278 (98.2%) returned their questionnaire; 136 (97.8%) for the personalised text versus 142 (98.6%) for the standard text (adjusted odds ratio 0.64, 95% CI 0.10 to 3.88, p=0.63). The median time to response was nine days in both groups. In total, 271 (97.5%) participants returned a complete questionnaire; 133 (97.8%) in the personalised text versus 138 (97.2%) for the standard text. In total, 21 reminder letters were sent. The additional cost of personalised text messages was £0.04 per participant retained. Conclusions: Personalised texts were not superior to standard texts in any outcome assessed in our study. Further SWATs are needed to perform a meta-analysis and obtain more evidence. Registration: ISRCTN22202133; SWAT 35 Keywords: SWAT, Randomised Controlled Trial, personalised, SMS text, postal questionnaire, reminde

No difference found in time to publication by statistical significance of trial results: a methodological review

Objective: Time-lag from study completion to publication is a potential source of publication bias in randomised controlled trials. This study sought to update the evidence base by identifying the effect of the statistical significance of research findings on time to publication of trial results.Design: Literature searches were carried out in four general medical journals from June 2013 to June 2014 inclusive (BMJ, JAMA, the Lancet and the New England Journal of Medicine). Setting: Methodological review of four general medical journals. Participants: Original research articles presenting the primary analyses from phase 2, 3 and 4 parallel-group randomised controlled trials were included. Main outcome measures: Time from trial completion to publication.Results: The median time from trial completion to publication was 431 days (n ¼ 208, interquartile range 278–618). A multivariable adjusted Cox model found no statistically significant difference in time to publication for trials reporting positive or negative results (hazard ratio: 0.86, 95% CI 0.64 to 1.16, p ¼ 0.32). Conclusion: In contrast to previous studies, this review did not demonstrate the presence of time-lag bias in time to publication. This may be a result of these articles being published in four high-impact general medical journals that may be more inclined to publish rapidly, whatever the findings. Further research is needed to explore the presence of time-lag bias in lower quality studies and lower impact journals

An embedded randomised controlled retention trial of personalised text messages compared to non-personalised text messages in an orthopaedic setting [version 1; peer review: 1 approved]

Background: Several studies have investigated whether personalising trial documentation can aid recruitment and retention. We did a ‘study within a trial’ (SWAT) evaluating the effectiveness of a personalised text message compared to a non-personalised text message, on the retention rate in a large orthopaedic trial. Methods: The SWAT was embedded in the Knee Replacement Bandaging Study (KReBS) trial. The primary outcome was the proportion of 12-month questionnaires returned. Secondary outcomes were the proportion of questionnaires completed and time to questionnaire return. Binary data were analysed using logistic regression and time to return using Cox proportional hazards regression. Odds ratios (OR) and hazard ratios (HR) are presented, with associated 95% confidence intervals (CI) and p-values. Results: In total, 1465 participants were included in the SWAT. In the personalised group, 644/723 (89.1%) of participants returned a questionnaire, compared to 654/742 (88.1%) in the non-personalised group. The absolute difference in return rate was 0.9% (95% CI: -2.3% to 4.2%; p=0.57). There was no evidence of a difference between the groups in the likelihood of returning a questionnaire (OR 1.09; 95% CI: 0.79 to 1.51; p=0.61), the likelihood of returning a complete questionnaire (OR 1.11; 95% CI: 0.82 to 1.51; p=0.50) nor in time to return (HR 1.05; 95% CI: 0.94 to 1.17; p=0.40). Conclusion: This SWAT adds to the growing evidence base for whether personalised text messages are effective. Registration: ISRCTN87127065 (20/02/2017); SWAT 35 (01/12/2015

Effectiveness of pre-operative anaemia screening and increased Tranexamic acid dose policies on outcomes following unilateral primary, elective total hip or knee replacement : a statistical analysis plan for an interrupted time series and regression discontinuity study

Perioperative blood transfusion is associated with poorer postoperative outcomes following hip and knee replacement surgery. Evidence for the effectiveness of some measures aimed at reducing blood transfusions in this setting are limited and often rely on weak pre-post study designs. Quasi-experimental study designs such as interrupted time series (ITS) and regression discontinuity design (RDD) address many of the weaknesses of the pre-post study design. In addition, a priori publication of statistical analysis plans for such studies increases their transparency and likely validity, as readers are able to distinguish between pre-planned and exploratory analyses. As such, this article, written prospective of any analysis, provides the statistical analysis plan for an ITS and RDD study based on a data set of 20,772 primary elective hip and knee replacement patients in a single English NHS Trust. The primary aim is to evaluate the impact of a preoperative anaemia optimisation service on perioperative blood transfusion (within 7 days of surgery) using both ITS and RDD methods. A secondary aim is to evaluate the impact of a policy of increased tranexamic acid dose given at the time of surgery, using ITS methods

Undertaking a randomised controlled trial in the police setting : methodological and practical challenges

BACKGROUND: There has been an increased drive towards Evidence Based Policing in recent years. Unlike in other public sector services, such as health and education, randomised controlled trials in the police setting are relatively rare. This paper discusses some of the methodological and practical challenges of conducting a randomised controlled trial in the police setting in the UK, based on our experience of the Connect trial. This pragmatic, cluster-randomised controlled trial investigated the effectiveness of a face-to-face training intervention for frontline officers in comparison to routine training. The primary outcome was the number of incidents which resulted in a police response reported to North Yorkshire Police control room in a 1-month period up to 6 months after delivery of training. MAIN TEXT: The methodological and practical challenges that we experienced whilst conducting the Connect trial are discussed under six headings: establishing the unit of randomisation; population of interest and sample size; co-production of evidence; time frame; outcomes; and organisational issues. CONCLUSION: Recommendations on the conduct of future randomised controlled trials in the police setting are made. To understand the context in which research is undertaken, collaboration between police and academia is needed and police officers should be embedded within trial management groups. Engagement with police data analysts to understand what data is available and facilitate obtaining trial data is also recommended. Police forces may wish to review their IT systems and recording practices. Pragmatic trials are encouraged and time frames need to allow for trial set-up and obtaining relevant ethical approvals. TRIAL REGISTRATION: ISRCTN Registry, ID: ISRCTN11685602 . Retrospectively registered on 13 May 2016

Qualitative research to inform hypothesis testing for fidelity-based sub-group analysis in clinical trials : lessons learnt from the process evaluation of a multifaceted podiatry intervention for falls prevention

Background: Ensuring fidelity to complex interventions is a challenge when conducting pragmatic randomised controlled trials. We explore fidelity through a qualitative process evaluation, which was conducted alongside a pragmatic, multicentre, two-arm cohort randomised controlled trial: the REFORM (Reducing Falls with Orthoses and a Multifaceted podiatry intervention) trial. The paper aims, through a qualitative process evaluation, to explore some of the factors that may have affected the delivery of the REFORM intervention and highlight how project-specific fidelity can be assessed using a truly mixed-methods approach when informed by qualitative insights. Design: Semi-structured qualitative interviews carried out as part of a process evaluation. Interviews were analysed thematically. Setting: Seven NHS trusts in the UK and a University podiatry school in Ireland. Interviews were undertaken face-toface or over the telephone. Participants: Twenty-one REFORM trial participants and 14 podiatrists who delivered the REFORM intervention. Results: Factors affecting fidelity included: how similar the intervention was to routine practice; the challenges of delivering a multifaceted intervention to a heterogeneous older population; and practical issues with delivery such as time and training. Trial participants’ views of the intervention, whether falls prevention is a personal priority, their experience of being part of a trial and individual factors such as medical conditions may also have affected intervention fidelity. Conclusions: Our process evaluation highlighted factors that were perceived to have affected the fidelity of the REFORM intervention and in doing so demonstrates the importance of considering fidelity when designing and evaluating pragmatic trials. We propose a number of recommendations of how important project-specific insights from qualitative work can be incorporated into the design of fidelity measurement of future trials, which build on existing conceptual fidelity frameworks. In particular, we encourage adopting a mixed-methods approach whereby qualitative insights can be used to suggest ways to enhance quantitative data collection facilitating integration through hypothesis generation, hypothesis testing and seeking explanation for trial findings. This will provide a framework of enabling measures of fidelity to be incorporated into the understanding of trial results which has been relatively neglected by existing literature. Trial registration: ISRCTN Registry: ISRCTN68240461. Registered on 01/07/2011. Keywords: Process evaluation, Randomised controlled trials, Fidelity, Mixed methods, Falls, Elderly, Ageing, Qualitativ

Implementation of blinded outcome assessment in the Effective Verruca Treatments trial (EverT) – lessons learned

Trials using inadequate levels of blinding may report larger effect sizes than blinded studies. It has been suggested that blinded outcome assessment in open trials may in some cases be undertaken by assessments of photographs. The aim of this paper is to explore the effect of using different methods to assess the primary outcome in the EVerT (Effective Verruca Treatments) trial. It also aims to give an overview of the experiences of using digital photographs within the trial. Methods We undertook a secondary analysis to explore the effect of using three different methods to assess the primary outcome in the EVerT trial: assessment of digital photographs by blinded healthcare professionals; blinded healthcare professional assessment at the recruiting site and patient self-report. The verruca clearance rates were calculated using the three different methods of assessment. A Cohen’s kappa measure of inter-rater agreement was used to assess the agreement between the methods. We also investigated the experiences of healthcare professionals using digital photographs within the trial. Results Digital photographs for 189 out of 240 (79 %) patients in the trial were received for outcome assessment. Of the 189 photographs, 30 (16 %) were uninterpretable. The overall verruca clearance rates were 21 % (43/202,) using the unblinded patient self-reported outcome, 6 % (9/159,) using blinded assessment of digital photographs and 14 % (30/210,) using blinded outcome assessment at the site. Conclusions Despite differences in the clearance rates found using different methods of outcome assessment, this did not change the original conclusion of the trial, that there is no evidence of a difference in effectiveness between cryotherapy and salicylic acid. Future trials using digital photographs should consider individual training needs at sites and have a backup method of assessment agreed a priori

Knee Replacement Bandaging Study (KReBS) Evaluating the effect of a Two-layer Compression Bandage System on Knee Function following Total Knee Arthroplasty: Study Protocol for a Randomised Controlled Trial

Background Data from a feasibility study suggests that the use of an inelastic, short-stretch compression bandage following total knee arthroplasty is a safe technique that may improve patient reported health outcomes, and that it is feasible to recruit to a full-scale study. Methods We will conduct a randomised controlled trial (RCT) of 2600 adult patients, which has 80% power to detect a 1 point difference in the Oxford Knee Score (a patient self-reported assessment of knee pain and function) at 52 weeks. Short stretch compression bandaging will be compared with standard wool and crepe bandaging following total knee arthroplasty. Recruitment will take place in orthopaedic units across the United Kingdom. Secondary outcomes include the EQ-5D-5L and EQ-5D-3L scores, pain, length of hospital stay and complications. Discussion The KReBS trial is a large study which aims to contribute to the evidence-base for informing clinical decisions for the use of compression bandaging following knee arthroplasty. Trial registration The trial is registered with the International Standard Randomised Controlled Trial Register (ISRCTN 87127065). Date of registration was 20/02/2017 (http://www.isrctn.com/ISRCTN87127065). Keywords Knee replacement; arthroplasty; compression bandage; randomised controlled tria

Clinical effectiveness and cost-effectiveness of a multifaceted podiatry intervention for falls prevention in older people : a multicentre cohort randomised controlled trial (the REducing Falls with ORthoses and a Multifaceted podiatry intervention trial)

BACKGROUND: Falls are a serious cause of morbidity and cost to individuals and society. Evidence suggests that foot problems and inappropriate footwear may increase the risk of falling. Podiatric interventions could help reduce falls; however, there is limited evidence regarding their clinical effectiveness and cost-effectiveness. OBJECTIVES: To determine the clinical effectiveness and cost-effectiveness of a multifaceted podiatry intervention for preventing falls in community-dwelling older people at risk of falling, relative to usual care. DESIGN: A pragmatic, multicentred, cohort randomised controlled trial with an economic evaluation and qualitative study. SETTING: Nine NHS trusts in the UK and one site in Ireland. PARTICIPANTS: In total, 1010 participants aged ≥ 65 years were randomised (intervention, n = 493; usual care, n = 517) via a secure, remote service. Blinding was not possible. INTERVENTIONS: All participants received a falls prevention leaflet and routine care from their podiatrist and general practitioner. The intervention also consisted of footwear advice, footwear provision if required, foot orthoses and foot- and ankle-strengthening exercises. MAIN OUTCOME MEASURES: The primary outcome was the incidence rate of falls per participant in the 12 months following randomisation. The secondary outcomes included the proportion of fallers and multiple fallers, time to first fall, fear of falling, fracture rate, health-related quality of life (HRQoL) and cost-effectiveness. RESULTS: The primary analysis consisted of 484 (98.2%) intervention and 507 (98.1%) usual-care participants. There was a non-statistically significant reduction in the incidence rate of falls in the intervention group [adjusted incidence rate ratio 0.88, 95% confidence interval (CI) 0.73 to 1.05; p = 0.16]. The proportion of participants experiencing a fall was lower (50% vs. 55%, adjusted odds ratio 0.78, 95% CI 0.60 to 1.00; p = 0.05). No differences were observed in key secondary outcomes. No serious, unexpected and related adverse events were reported. The intervention costs £252.17 more per participant (95% CI -£69.48 to £589.38) than usual care, was marginally more beneficial in terms of HRQoL measured via the EuroQoL-5 Dimensions [mean quality-adjusted life-year (QALY) difference 0.0129, 95% CI -0.0050 to 0.0314 QALYs] and had a 65% probability of being cost-effective at the National Institute for Health and Care Excellence threshold of £30,000 per QALY gained. The intervention was generally acceptable to podiatrists and trial participants. LIMITATIONS: Owing to the difficulty in calculating a sample size for a count outcome, the sample size was based on detecting a difference in the proportion of participants experiencing at least one fall, and not the primary outcome. We are therefore unable to confirm if the trial was sufficiently powered for the primary outcome. The findings are not generalisable to patients who are not receiving podiatry care. CONCLUSIONS: The intervention was safe and potentially effective. Although the primary outcome measure did not reach significance, a lower fall rate was observed in the intervention group. The reduction in the proportion of older adults who experienced a fall was of borderline statistical significance. The economic evaluation suggests that the intervention could be cost-effective. FUTURE WORK: Further research could examine whether or not the intervention could be delivered in group sessions, by physiotherapists, or in high-risk patients. TRIAL REGISTRATION: Current Controlled Trials ISRCTN68240461. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 24. See the NIHR Journals Library website for further project information