Statistical issues in trials of preexposure prophylaxis

Purpose of review We discuss selected statistical issues in the design and analysis of preexposure prophylaxis (PrEP) trials. The general principles may inform thinking for other interventions in HIV prevention. Recent findings To date, four different designs have been used to determine the effectiveness of PrEP: randomized, doubleblind, placebo-controlled; randomized, open-label, immediate or delayed access; nonrandomized comparison of HIV incidence according to the level of drug detected; comparison of the observed HIV incidence to the expected rate using historical control data. Open-label trials of PrEP, which assess public health effectiveness, complement the placebo-controlled trials which established the biological efficacy of TDF/ FTC. Future trials of PrEP will be highly challenging to design since a no PrEP group is difficult to justify and the natural control regimen, TDF/FTC, is highly efficacious. Summary Standard statistical paradigms for noninferiority trials should be reconsidered for evaluating alternative PrEP regimens

A Bayesian averted infection framework for PrEP trials with low numbers of HIV infections: application to the results of the DISCOVER trial

Trials of candidate agents for HIV pre-exposure prophylaxis (PrEP) might randomly assign participants to be given a new PrEP agent or oral coformulated tenofovir disoproxil fumarate plus emtricitabine. This design presents unique challenges in interpretation. First, with two active arms, HIV incidence might be low. Second, the effectiveness of tenofovir disoproxil fumarate plus emtricitabine varies across populations; thus, similar HIV incidence between groups could be consistent with a wide range of effectiveness for the new PrEP. We propose a two-part approach to trial results. First, we use Bayesian methods to incorporate assumptions about the background incidence of HIV in the trial in the absence of PrEP, possibly augmented by external data. On the basis of the estimated background incidence, we estimate and compare the number of averted (or prevented) HIV infections in each of the two trial groups, calculating the averted infections ratio. We apply these methods to a completed trial of tenofovir alafenamide plus emtricitabine for PrEP. Our framework shows that leveraging external information to estimate averted infections and the averted infections ratio enhances the efficiency and interpretation of active-controlled PrEP trials

Confidence limits for the averted infections ratio estimated via the counterfactual placebo incidence rate

Objectives The averted infections ratio (AIR) is a novel measure for quantifying the preservation-of-effect in active-control non-inferiority clinical trials with a time-to-event outcome. In the main formulation, the AIR requires an estimate of the counterfactual placebo incidence rate. We describe two approaches for calculating confidence limits for the AIR given a point estimate of this parameter, a closed-form solution based on a Taylor series expansion (delta method) and an iterative method based on the profile-likelihood. Methods For each approach, exact coverage probabilities for the lower and upper confidence limits were computed over a grid of values of (1) the true value of the AIR (2) the expected number of counterfactual events (3) the effectiveness of the active-control treatment. Results Focussing on the lower confidence limit, which determines whether non-inferiority can be declared, the coverage achieved by the delta method is either less than or greater than the nominal coverage, depending on the true value of the AIR. In contrast, the coverage achieved by the profile-likelihood method is consistently accurate. Conclusions The profile-likelihood method is preferred because of better coverage properties, but the simpler delta method is valid when the experimental treatment is no less effective than the control treatment. A complementary Bayesian approach, which can be applied when the counterfactual incidence rate can be represented as a prior distribution, is also outlined

Mosaic effectiveness: measuring the impact of novel PrEP methods

Various ongoing trials seek to evaluate long-acting pre-exposure prophylaxis (PrEP) agents by showing that they are non-inferior to daily oral tenofovir disoproxil fumarate and emtricitabine. Trials comparing oral PrEP to new methods examine effectiveness in a setting where only one or the other is provided; however, a new product will probably be delivered in a context where oral PrEP is also available. The effectiveness of a new PrEP product is best measured by its potential effect in a context that also includes oral tenofovir disoproxil fumarate and emtricitabine as an option. We offer an alternative standard for long-acting products—a measure of the effectiveness of the new product in addition to oral tenofovir disoproxil fumarate and emtricitabine as compared with oral PrEP alone. We term this measure mosaic effectiveness. We illustrate scenarios where a novel product can fail to show non-inferiority but show substantial mosaic effectiveness, thus implying the public health value of the novel product even if it is less effective than oral PrEP. Regulatory standards should consider mosaic effectiveness, not just comparative effectiveness. We assert that measurements that combine rigor with public health relevance can accelerate progress against the HIV epidemic

The Connection between the Averted Infections Ratio and the Rate Ratio in Active-control Trials of Pre-exposure Prophylaxis Agents

The design and analysis of active-control trials to evaluate experimental HIV pre-exposure prophylaxis (PrEP) agents pose serious statistical challenges. We recently proposed a new outcome measure, the averted infections ratio (AIR) – the proportion of infections that would be averted by using the experimental agent rather than the control agent (compared to no intervention). The main aim of the current paper is to examine the mathematical connection between AIR and the HIV incidence rate ratio, the standard outcome measure. We also consider the sample size implications of the choice of primary outcome measure and explore the connection between effectiveness and efficacy under a simplified model of adherence

The averted infections ratio: a novel measure of effectiveness of experimental HIV pre-exposure prophylaxis agents

Tenofovir disoproxil fumarate combined with emtricitabine is a highly effective oral pre-exposure prophylaxis (PrEP) agent for preventing the acquisition of HIV. This effectiveness has consequences for the design and analysis of trials assessing experimental PrEP regimens, which now generally include an active-control tenofovir disoproxil fumarate plus emtricitabine group, rather than a placebo group, as a comparator. Herein, we describe major problems in the interpretation of the primary measure of effectiveness proposed for these trials, namely the ratio of HIV incidence in the experimental agent group to that in the active-control group. We argue that valid interpretation requires an assumption about one of two parameters: either the incidence among trial participants had they not received PrEP or the effectiveness of tenofovir disoproxil fumarate plus emtricitabine within the trial. However, neither parameter is directly observed because of the absence of a no-treatment group, thus requiring the use of external evidence or subjective judgment. We propose an alternative measure of effectiveness based on the concept of averted infections, which incorporates one of these parameters. The measure is simple to interpret, has clinical and public health relevance, and is a natural preservation-of-effect criterion for assessing statistical non-inferiority. Its adoption could also allow the use of smaller sample sizes, currently a major barrier to the assessment of experimental PrEP regimen

HIV prevention trial design in an era of effective pre-exposure prophylaxis

Pre-exposure prophylaxis (PrEP) has demonstrated remarkable effectiveness protecting at-risk individuals from HIV-1 infection. Despite this record of effectiveness, concerns persist about the diminished protective effect observed in women compared with men and the influence of adherence and risk behaviors on effectiveness in targeted subpopulations. Furthermore, the high prophylactic efficacy of the first PrEP agent, tenofovir disoproxil fumarate/emtricitabine (TDF/FTC), presents challenges for demonstrating the efficacy of new candidates. Trials of new agents would typically require use of non-inferiority (NI) designs in which acceptable efficacy for an experimental agent is determined using pre-defined margins based on the efficacy of the proven active comparator (i.e. TDF/FTC) in placebo-controlled trials. Setting NI margins is a critical step in designing registrational studies. Under- or over-estimation of the margin can call into question the utility of the study in the registration package. The dependence on previous placebo-controlled trials introduces the same issues as external/historical controls. These issues will need to be addressed using trial design features such as re-estimated NI margins, enrichment strategies, run-in periods, crossover between study arms, and adaptive re-estimation of sample sizes. These measures and other innovations can help to ensure that new PrEP agents are made available to the public using stringent standards of evidence

Cyberbullying and eating disorder symptoms in US early adolescents

Objective: The objective of this study was to determine the association between cyberbullying and eating disorder symptoms in a national sample of 10–14-year-old early adolescents. / Method: We analyzed cross-sectional data from the Adolescent Brain Cognitive Development (ABCD) Study (Year 2, 2018–2020, N = 10,258/11,875, 49% female, 46% non-White). Data were collected using multi-stage probability sampling. Modified Poisson regression analyses examined the association between cyberbullying and self-reported eating disorder symptoms based on the Kiddie Schedule for Affective Disorders and Schizophrenia (KSADS-5). / Results: Cyberbullying victimization was associated with worry about weight gain (prevalence ratio [PR] 2.41, 95% confidence interval [CI] 1.48–3.91), self-worth tied to weight (PR 2.08, 95% CI 1.33–3.26), inappropriate compensatory behavior to prevent weight gain (PR 1.95, 95% CI 1.57–2.42), binge eating (PR 1.95, 95% CI 1.59–2.39), and distress with binge eating (PR 2.64, 95% CI 1.94–3.59), in models adjusting for potential confounders. Cyberbullying perpetration was associated with worry about weight gain (PR 3.52, 95% CI 1.19–10.37), self-worth tied to weight (PR 5.59, 95% CI 2.56–12.20), binge eating (PR 2.36, 95% CI 1.44–3.87), and distress with binge eating (PR 2.84, 95% CI 1.47–5.49). / Discussion: Cyberbullying victimization and perpetration in early adolescence are associated with eating disorder symptoms. Clinicians may consider assessing for cyberbullying and eating disorder symptoms in early adolescence and provide anticipatory guidance. / Public Significance Statement: Eating disorders often onset in adolescence and have among the highest mortality rates of any psychiatric disorder. In addition, cyberbullying has increased in prevalence among adolescents and significantly impacts mental health. In a national study of early adolescents, we found that cyberbullying victimization and perpetration are associated with eating disorder symptoms. Screening for and providing anticipatory guidance on cyberbullying and eating disorder symptoms in early adolescents may be warranted

Crude incidence in two-phase designs in the presence of competing risks.

BackgroundIn many studies, some information might not be available for the whole cohort, some covariates, or even the outcome, might be ascertained in selected subsamples. These studies are part of a broad category termed two-phase studies. Common examples include the nested case-control and the case-cohort designs. For two-phase studies, appropriate weighted survival estimates have been derived; however, no estimator of cumulative incidence accounting for competing events has been proposed. This is relevant in the presence of multiple types of events, where estimation of event type specific quantities are needed for evaluating outcome.MethodsWe develop a non parametric estimator of the cumulative incidence function of events accounting for possible competing events. It handles a general sampling design by weights derived from the sampling probabilities. The variance is derived from the influence function of the subdistribution hazard.ResultsThe proposed method shows good performance in simulations. It is applied to estimate the crude incidence of relapse in childhood acute lymphoblastic leukemia in groups defined by a genotype not available for everyone in a cohort of nearly 2000 patients, where death due to toxicity acted as a competing event. In a second example the aim was to estimate engagement in care of a cohort of HIV patients in resource limited setting, where for some patients the outcome itself was missing due to lost to follow-up. A sampling based approach was used to identify outcome in a subsample of lost patients and to obtain a valid estimate of connection to care.ConclusionsA valid estimator for cumulative incidence of events accounting for competing risks under a general sampling design from an infinite target population is derived

Behavioral and molecular genetics of reading-related AM and FM detection thresholds

Auditory detection thresholds for certain frequencies of both amplitude modulated (AM) and frequency modulated (FM) dynamic auditory stimuli are associated with reading in typically developing and dyslexic readers. We present the first behavioral and molecular genetic characterization of these two auditory traits. Two extant extended family datasets were given reading tasks and psychoacoustic tasks to determine FM 2 Hz and AM 20 Hz sensitivity thresholds. Univariate heritabilities were significant for both AM (h2 = 0.20) and FM (h2 = 0.29). Bayesian posterior probability of linkage (PPL) analysis found loci for AM (12q, PPL = 81 %) and FM (10p, PPL = 32 %; 20q, PPL = 65 %). Bivariate heritability analyses revealed that FM is genetically correlated with reading, while AM was not. Bivariate PPL analysis indicates that FM loci (10p, 20q) are not also associated with reading