Test evaluation trials present different challenges for trial managers compared to Intervention trials

Introduction Test evaluation trials present different challenges for trial managers compared to intervention trials. There has been very little research on the management of test evaluation trials and how this impacts on trial success, in comparison with intervention trials. Evaluations of medical tests present specific challenges, because they are a pivot point bridging the complexities of pathways prompting testing with treatment decision-making. We systematically explored key differences in the trial design and management of test evaluation trials compared to intervention trials at the different stages of study design and delivery. We identified challenges in test evaluation trials that were more pronounced than in intervention trials, based on experience from 10 test evaluation trials. Methods We formed a focus group of 7 trial managers and a statistician who had been involved in the day-to-day management of both test evaluation trials and intervention trials. We used discussion and content analysis to group challenges from 10 trials into a structured thematic format. The trials covered a range of medical conditions, diagnostic tests, clinical pathways and conditions including chronic kidney disease, chronic pelvic pain, colitis, detrusor over-activity, group B streptococcal colonisation, tuberculosis and colorectal, lung, ovarian and thyroid cancers. Results We identified 10 common themes underlying challenges that are more pronounced in test evaluation compared to intervention trials. We illustrate these themes with examples from 10 trials, including with 31 specific challenges we experienced. The themes were ethics/governance; accessing patient populations; recruitment; patient preference; test processes, clinical pathways and samples storage; uncertainty of diagnostic results; verifying diagnosis (reference standard); follow-up; adverse effects; and diagnostic impact. Conclusion We present 10 common themes, including 31 challenges, in test evaluation trials that will be helpful to others designing and managing future test evaluation trials. Proactive identification of potential challenges at the design and planning stages of test evaluation trials will enable strategies to improve trial design and management that may be different from standard strategies used for intervention trials. Future work could extend this topic to include challenges for other trial stakeholders including participants, clinicians, statisticians and funders

The effect of two speech and language approaches on speech problems in people with Parkinson’s disease: the PD COMM RCT

Background Speech impairments are common with Parkinson’s disease (reported prevalence 68%), increasing conversational demands, reliance on family and social withdrawal. Objective(s) The PD COMM trial compared the clinical and cost-effectiveness of two speech and language therapy approaches: Lee Silverman Voice Treatment LOUD and National Health Service speech and language therapy for the treatment of speech or voice problems in people with Parkinson’s disease to no speech and language therapy (control) and against each other. Design PD COMM is a phase III, multicentre, three-arm, unblinded, randomised controlled trial. Participants were randomised in a 1 : 1 : 1 ratio to control, National Health Service speech and language therapy or Lee Silverman Voice Treatment LOUD via a central computer-generated programme, using a minimisation procedure with a random element, to ensure allocation concealment. Mixed-methods process and health economic evaluations were conducted. Setting United Kingdom outpatient and home settings. Participants People with idiopathic Parkinson’s disease, with self-reported or carer-reported speech or voice problems. We excluded people with dementia, laryngeal pathology and those within 24 months of previous speech and language therapy. Interventions The Lee Silverman Voice Treatment LOUD intervention included maximum effort drills and high-effort speech production tasks delivered over four 50-minute therapist-led personalised sessions per week, for 4 weeks with prescribed daily home practice. National Health Service speech and language therapy content and dosage reflected local non-Lee Silverman Voice Treatment speech and language therapy practices, usually 1 hour, once weekly, for 6 weeks. Trained, experienced speech and language therapists or assistants provided interventions. The control was no speech and language therapy until the trial was completed. Main outcome measures Primary outcome: Voice Handicap Index total score at 3 months. Secondary outcomes: Voice Handicap Index subscales, Parkinson’s Disease Questionnaire-39; Questionnaire on Acquired Speech Disorders; EuroQol-5D-5L; ICEpop Capabilities Measure for Older Adults; Parkinson’s Disease Questionnaire – Carers; resource utilisation; and adverse events. Assessments were completed pre-randomisation and at 3, 6 and 12 months post randomisation. Results Three hundred and eighty-eight participants were randomised to Lee Silverman Voice Treatment LOUD (n = 130), National Health Service speech and language therapy (n = 129) and control (n = 129). The impact of voice problems at 3 months after randomisation was lower for Lee Silverman Voice Treatment LOUD participants than control [−8.0 (99% confidence interval: −13.3, −2.6); p = 0.001]. There was no evidence of improvement for those with access to National Health Service speech and language therapy when compared to control [1.7 (99% confidence interval: −3.8, 7.1); p = 0.4]. Participants randomised to Lee Silverman Voice Treatment LOUD reported a lower impact of their voice problems than participants randomised to National Health Service speech and language therapy [99% confidence interval: −9.6 (−14.9, −4.4); p < 0.0001]. There were no reports of serious adverse events. Staff were confident with the trial interventions; a range of patient and therapist enablers of implementing Lee Silverman Voice Treatment LOUD were identified. The economic evaluation results suggested Lee Silverman Voice Treatment LOUD was more expensive and more effective than control or National Health Service speech and language therapy but was not cost-effective with incremental cost-effectiveness ratios of £197,772 per quality-adjusted life-year gained and £77,017 per quality-adjusted life-year gained, respectively. Limitations The number of participants recruited to the trial did not meet the pre-specified power. Conclusions People that had access to Lee Silverman Voice Treatment LOUD described a significantly greater reduction in the impact of their Parkinson’s disease-related speech problems 3 months after randomisation compared to people that had no speech and language therapy. There was no evidence of a difference between National Health Service speech and language therapy and those that received no speech and language therapy. Lee Silverman Voice Treatment LOUD resulted in a significantly lower impact of voice problems compared to National Health Service speech and language therapy 3 months after randomisation which was still present after 12 months; however, Lee Silverman Voice Treatment LOUD was not found to be cost-effective. Future work Implementing Lee Silverman Voice Treatment LOUD in the National Health Service and identifying alternatives to Lee Silverman Voice Treatment LOUD for those who cannot tolerate it. Investigation of less costly alternative options for Lee Silverman Voice Treatment delivery require investigation, with economic evaluation using a preference-based outcome measure that captures improvement in communication

11β-Hydroxysteroid dehydrogenase type 1 inhibition in idiopathic intracranial hypertension: a double-blind randomized controlled trial

Treatment options for idiopathic intracranial hypertension are limited. The enzyme 11β-hydroxysteroid dehydrogenase type 1 has been implicated in regulating cerebrospinal fluid secretion, and its activity is associated with alterations in intracranial pressure in idiopathic intracranial hypertension. We assessed therapeutic efficacy, safety and tolerability and investigated indicators of in vivo efficacy of the 11β-hydroxysteroid dehydrogenase type 1 inhibitor AZD4017 compared with placebo in idiopathic intracranial hypertension. A multicenter, UK, 16-week phase II randomized, double-blind, placebo-controlled trial of 12-week treatment with AZD4017 or placebo was conducted. Women aged 18–55 years with active idiopathic intracranial hypertension (>25 cmH2O lumbar puncture opening pressure and active papilledema) were included. Participants received 400 mg of oral AZD4017 twice daily compared with matching placebo over 12 weeks. The outcome measures were initial efficacy, safety and tolerability. The primary clinical outcome was lumbar puncture opening pressure at 12 weeks analysed by intention-to-treat. Secondary clinical outcomes were symptoms, visual function, papilledema, headache and anthropometric measures. In vivo efficacy was evaluated in the central nervous system and systemically. A total of 31 subjects [mean age 31.2 (SD = 6.9) years and body mass index 39.2 (SD = 12.6) kg/m2] were randomized to AZD4017 (n = 17) or placebo (n = 14). At 12 weeks, lumbar puncture pressure was lower in the AZD4017 group (29.7 cmH2O) compared with placebo (31.3 cmH2O), but the difference between groups was not statistically significant (mean difference: −2.8, 95% confidence interval: −7.1 to 1.5; P = 0.2). An exploratory analysis assessing mean change in lumbar puncture pressure within each group found a significant decrease in the AZD4017 group [mean change: −4.3 cmH2O (SD = 5.7); P = 0.009] but not in the placebo group [mean change: −0.3 cmH2O (SD = 5.9); P = 0.8]. AZD4017 was safe, with no withdrawals related to adverse effects. Nine transient drug-related adverse events were reported. One serious adverse event occurred in the placebo group (deterioration requiring shunt surgery). In vivo biomarkers of 11β-hydroxysteroid dehydrogenase type 1 activity (urinary glucocorticoid metabolites, hepatic prednisolone generation, serum and cerebrospinal fluid cortisol:cortisone ratios) demonstrated significant enzyme inhibition with the reduction in serum cortisol:cortisone ratio correlating significantly with reduction in lumbar puncture pressure (P = 0.005, R = 0.70). This is the first phase II randomized controlled trial in idiopathic intracranial hypertension evaluating a novel therapeutic target. AZD4017 was safe and well tolerated and inhibited 11β-hydroxysteroid dehydrogenase type 1 activity in vivo. Reduction in serum cortisol:cortisone correlated with decreased intracranial pressure. Possible clinical benefits were noted in this small cohort. A longer, larger study would now be of interest

Methods Used in Economic Evaluations of Chronic Kidney Disease Testing — A Systematic Review

Background: The prevalence of chronic kidney disease (CKD) is high in general populations around the world. Targeted testing and screening for CKD are often conducted to help identify individuals that may benefit from treatment to ameliorate or prevent their disease progression. Aims: This systematic review examines the methods used in economic evaluations of testing and screening in CKD, with a particular focus on whether test accuracy has been considered, and how analysis has incorporated issues that may be important to the patient, such as the impact of testing on quality of life and the costs they incur. Methods: Articles that described model-based economic evaluations of patient testing interventions focused on CKD were identified through the searching of electronic databases and the hand searching of the bibliographies of the included studies. Results: The initial electronic searches identified 2,671 papers of which 21 were included in the final review. Eighteen studies focused on proteinuria, three evaluated glomerular filtration rate testing and one included both tests. The full impact of inaccurate test results was frequently not considered in economic evaluations in this setting as a societal perspective was rarely adopted. The impact of false positive tests on patients in terms of the costs incurred in re-attending for repeat testing, and the anxiety associated with a positive test was almost always overlooked. In one study where the impact of a false positive test on patient quality of life was examined in sensitivity analysis, it had a significant impact on the conclusions drawn from the model. Conclusion: Future economic evaluations of kidney function testing should examine testing and monitoring pathways from the perspective of patients, to ensure that issues that are important to patients, such as the possibility of inaccurate test results, are properly considered in the analysis

Antidepressants for the prevention of depression following first-episode psychosis (ADEPP): study protocol for a multi-centre, double-blind, randomised controlled trial

Background: Depressive episodes are common after first-episode psychosis (FEP), affecting more than 40% of people, adding to individual burden, poor outcomes, and healthcare costs. If the risks of developing depression were lower, this could have a beneficial effect on morbidity and mortality, as well as improving outcomes. Sertraline is a selective serotonin reuptake inhibitor and a common first-line medication for the treatment of depression in adults. It has been shown to be safe when co-prescribed with antipsychotic medication, and there is evidence that it is an effective treatment for depression in established schizophrenia. We present a protocol for a multi-centre, double-blind, randomised, placebo-controlled clinical trial called ADEPP that aims to investigate the efficacy and cost-effectiveness of sertraline in preventing depression after FEP. Methods: The recruitment target is 452 participants between the ages of 18 and 65 years who are within 12 months of treatment initiation for FEP. Having provided informed consent, participants will be randomised to receive either 50 mg of sertraline daily or matched placebo for 6 months, in addition to treatment as usual. The primary outcome measure will be a comparison of the number of new cases of depression between the treatment and placebo arms over the 6-month intervention phase. Secondary outcomes include suicidal behaviour, anxiety, rates of relapse, functional outcome, quality of life, and resource use. Discussion: The ADEPP trial will test whether the addition of sertraline following FEP is a clinically useful, acceptable, and cost-effective way of improving outcomes following FEP. Trial registration: ISRCTN12682719 registration date 24/11/2020

Accuracy of glomerular filtration rate estimation using creatinine and cystatin C for identifying and monitoring moderate chronic kidney disease: the eGFR-C study

Background Estimation of glomerular filtration rate using equations based on creatinine is widely used to manage chronic kidney disease. In the UK, the Chronic Kidney Disease Epidemiology Collaboration creatinine equation is recommended. Other published equations using cystatin C, an alternative marker of kidney function, have not gained widespread clinical acceptance. Given higher cost of cystatin C, its clinical utility should be validated before widespread introduction into the NHS. Objectives Primary objectives were to: (1) compare accuracy of glomerular filtration rate equations at baseline and longitudinally in people with stage 3 chronic kidney disease, and test whether accuracy is affected by ethnicity, diabetes, albuminuria and other characteristics; (2) establish the reference change value for significant glomerular filtration rate changes; (3) model disease progression; and (4) explore comparative cost-effectiveness of kidney disease monitoring strategies. Design A longitudinal, prospective study was designed to: (1) assess accuracy of glomerular filtration rate equations at baseline (n = 1167) and their ability to detect change over 3 years (n = 875); (2) model disease progression predictors in 278 individuals who received additional measurements; (3) quantify glomerular filtration rate variability components (n = 20); and (4) develop a measurement model analysis to compare different monitoring strategy costs (n = 875). Setting Primary, secondary and tertiary care. Participants Adults (≥ 18 years) with stage 3 chronic kidney disease. Interventions Estimated glomerular filtration rate using the Chronic Kidney Disease Epidemiology Collaboration and Modification of Diet in Renal Disease equations. Main outcome measures Measured glomerular filtration rate was the reference against which estimating equations were compared with accuracy being expressed as P30 (percentage of values within 30% of reference) and progression (variously defined) studied as sensitivity/specificity. A regression model of disease progression was developed and differences for risk factors estimated. Biological variation components were measured and the reference change value calculated. Comparative costs of monitoring with different estimating equations modelled over 10 years were calculated. Results Accuracy (P30) of all equations was ≥ 89.5%: the combined creatinine–cystatin equation (94.9%) was superior (p &lt; 0.001) to other equations. Within each equation, no differences in P30 were seen across categories of age, gender, diabetes, albuminuria, body mass index, kidney function level and ethnicity. All equations showed poor (&lt; 63%) sensitivity for detecting patients showing kidney function decline crossing clinically significant thresholds (e.g. a 25% decline in function). Consequently, the additional cost of monitoring kidney function annually using a cystatin C-based equation could not be justified (incremental cost per patient over 10 years = £43.32). Modelling data showed association between higher albuminuria and faster decline in measured and creatinine-estimated glomerular filtration rate. Reference change values for measured glomerular filtration rate (%, positive/negative) were 21.5/−17.7, with lower reference change values for estimated glomerular filtration rate. Limitations Recruitment of people from South Asian and African-Caribbean backgrounds was below the study target. Future work Prospective studies of the value of cystatin C as a risk marker in chronic kidney disease should be undertaken. Conclusions Inclusion of cystatin C in glomerular filtration rate-estimating equations marginally improved accuracy but not detection of disease progression. Our data do not support cystatin C use for monitoring of glomerular filtration rate in stage 3 chronic kidney disease

Intracranial pressure directly predicts headache morbidity in idiopathic intracranial hypertension

OBJECTIVE Headache is the predominant disabler in idiopathic intracranial hypertension (IIH). The aim was to characterise headache and investigate the association with intracranial pressure. METHODS IIH:WT was a randomised controlled parallel group multicentre trial in the United Kingdom investigating weight management methods in IIH. Participants with active IIH (evidenced by papilloedema) and a body mass index (BMI) ≥35 kg/m were recruited. At baseline, 12 months and 24 months headache characteristics and quality of life outcome measures were collected and lumbar puncture measurements were performed. RESULTS Sixty-six women with active IIH were included with a mean age of 32.0 years (SD ± 7.8), and mean body mass index of 43.9 ± 7.0 kg/m. The headache phenotype was migraine-like in 90%. Headache severity correlated with ICP at baseline (r = 0.285; p = 0.024); change in headache severity and monthly headache days correlated with change in ICP at 12 months (r = 0.454, p = 0.001 and r = 0.419, p = 0.002 respectively). Cutaneous allodynia was significantly correlated with ICP at 12 months. (r = 0.479, p < 0.001). Boot strap analysis noted a positive association between ICP at 12 and 24 months and enabled prediction of both change in headache severity and monthly headache days. ICP was associated with significant improvements in quality of life (SF-36). CONCLUSIONS We demonstrate a positive relationship between ICP and headache and cutaneous allodynia, which has not been previously reported in IIH. Those with the greatest reduction in ICP over 12 months had the greatest reduction in headache frequency and severity; this was associated with improvement of quality of life measures. TRIAL REGISTRATION This work provides Class IIa evidence of the association of raised intracranial pressure and headache. ClinicalTrials.gov number, NCT02124486

The eGFR-C study: accuracy of glomerular filtration rate (GFR) estimation using creatinine and cystatin C and albuminuria for monitoring disease progression in patients with stage 3 chronic kidney disease - prospective longitudinal study in a multiethnic population

Background: Uncertainty exists regarding the optimal method to estimate glomerular filtration rate (GFR) for disease detection and monitoring. Widely used GFR estimates have not been validated in British ethnic minority populations. Methods: Iohexol measured GFR will be the reference against which each estimating equation will be compared. The estimating equations will be based upon serum creatinine and/or cystatin C. The eGFR-C study has 5 components:1)A prospective longitudinal cohort study of 1300 adults with stage 3 chronic kidney disease followed for 3 years with reference (measured) GFR and test (estimated GFR [eGFR] and urinary albumin-to-creatinine ratio) measurements at baseline and 3 years. Test measurements will also be undertaken every 6 months. The study population will include a representative sample of south-Asians and African-Caribbeans. People with diabetes and proteinuria (ACR >=30 mg/mmol) will comprise 20-30% of the study cohort. 2)A sub-study of patterns of disease progression of 375 people (125 each of Caucasian, Asian and African-Caribbean origin; in each case containing subjects at high and low risk of renal progression). Additional reference GFR measurements will be undertaken after 1 and 2 years to enable a model of disease progression and error to be built. 3)A biological variability study to establish reference change values for reference and test measures. 4)A modelling study of the performance of monitoring strategies on detecting progression, utilising estimates of accuracy, patterns of disease progression and estimates of measurement error from studies 1), 2) and 3). 5)A comprehensive cost database for each diagnostic approach will be developed to enable cost-effectiveness modelling of the optimal strategy. The performance of the estimating equations will be evaluated by assessing bias, precision and accuracy. Data will be modelled as a linear function of time utilising all available (maximum 7) time points compared with the difference between baseline and final reference values. The percentage of participants demonstrating large error with the respective estimating equations will be compared. Predictive value of GFR estimates and albumin-to-creatinine ratio will be compared amongst subjects that do or do not show progressive kidney function decline. Discussion: The eGFR-C study will provide evidence to inform the optimal GFR estimate to be used in clinical practice

Cost-effectiveness of bariatric surgery versus community weight management to treat obesity-related idiopathic intracranial hypertension: evidence from a single-payer healthcare system.

BACKGROUND Idiopathic intracranial hypertension (IIH) is associated with significant morbidity, predominantly affecting women of childbearing age living with obesity. Weight loss has demonstrated successful disease-modifying effects; however, the long-term cost-effectiveness of weight loss interventions for the treatment of IIH has not yet been established. OBJECTIVES To estimate the cost-effectiveness of weight-loss treatments for IIH. SETTING Single-payer healthcare system (National Health Service, England). METHODS A Markov model was developed comparing bariatric surgery with a community weight management intervention over 5-, 10-, and 20-year time horizons. Transition probabilities, utilities, and resource use were informed by the IIH Weight Trial (IIH:WT), alongside the published literature. A probabilistic sensitivity analysis was conducted to characterize uncertainty within the model. RESULTS In the base case analysis, over a 20-year time horizon, bariatric surgery was "dominant," led to cost savings of £49,500, and generated an additional 1.16 quality-adjusted life years in comparison to the community weight management intervention. The probabilistic sensitivity analysis indicated a probability of 98% that bariatric surgery is the dominant option in terms of cost-effectiveness. CONCLUSION This economic modeling study has shown that when compared to community weight management, bariatric surgery is a highly cost-effective treatment option for IIH in women living with obesity. The model shows that surgery leads to long-term cost savings and health benefits, but that these do not occur until after 5 years post surgery, and then gradually increase over time