Reproducing Statistics Performed in Published Randomized Controlled Trials

INTRODUCTION: Randomized controlled trials (RCT) represent evidence at the lowest potential risk for bias. Clinicians in all specialties depend upon RCTs to guide patient care. Issues such as statistical discordance, or reporting statistical results that cannot be reproduced, should be uncommon. Our aim was to confirm the statistical reproducibility of published RCTs. METHODS: PubMed was searched using randomized controlled trial. Studies were selected using a random number generator. Studies were included if the primary outcome could be reproduced using the data and statistical test reported in the manuscript. The reproduced p-value from our analysis and the published p-value were compared. Primary outcome was the number of studies that reported p-values that differed in statistical significance (crossed p-value=0.05) from the reproduction analysis. Assuming an alpha of 0.05, a beta of 0.80, an estimated rate of statistical discordance of 5% for RCTs, a total of at least 568 studies were required. RESULTS: Overall, 572 RCTs were selected involving six specialties. Of these, 45% were positive (p CONCLUSION: Less than 5% of published RCTs reported a discordant p-value that crossed the p=0.05 threshold. Although the occurrence is uncommon, the existence of even one RCT publishing nonreproducible results is concerning. Future studies should seek to identify why some RCTs report discordant statistics and how to prevent this from occurring

Hernia Prevention Using Biologic Mesh and/or Small Bites: A Multispecialty 2 × 2 Factorial Randomized Controlled Trial

BACKGROUND: Ventral incisional hernias are the most common complication after abdominal operation. Randomized trials have shown efficacy of prophylactic synthetic mesh and small bites. Adoption of these practices has been limited due to concerns with placement of synthetic mesh in contaminated cases and small bites in an overweight population. We sought to assess the efficacy of prophylactic biologic mesh and small bites to prevent postoperative major complications: ventral incisional hernias, surgical site infection, reoperation, and death. STUDY DESIGN: High-risk patients (overweight/obese, current smoker) undergoing abdominal operation with a midline incision (5 cm or greater) were randomized (2 × 2 factorial trial) to receive either sublay biologic mesh or no mesh and either small bites (0.5 × 0. 5cm) or large bites (1 × 1 cm) fascial closure. The primary outcome measure was major complications at 1 year postoperative. CONSORT guidelines were followed, and this study was registered on clinicaltrials.gov (NCT03148496). Assuming α = 0.05, β = 0.20, and Δ = 20%, it was estimated that 105 patients were needed. Primary outcome was assessed using Fisher\u27s exact test. RESULTS: A total of 107 patients were randomized: 52 (49%) to mesh, 55 (51%) to no mesh, 55 (51%) to small bites, and 52 (49%) to large bites. Of the patients, 16% were smokers, 31% were overweight, and 55% were obese. At 1 year postoperative, there were no differences in major complications between groups (mesh vs no mesh 21% vs 16%, p = 0.62; small vs large bites 18% vs 19%, p = 1.00). CONCLUSIONS: In this trial, biologic mesh and small bites appear to have no benefit. Further randomized trials are needed among high-risk patients before widespread adoption of prophylactic biologic mesh or small bites

Robotic Versus Laparoscopic Ventral Hernia Repair: Two-Year Results From a Prospective, Multicenter, Blinded Randomized Clinical Trial

OBJECTIVE: Report the 2-year outcomes of a multicenter randomized controlled trial comparing robotic versus laparoscopic intraperitoneal onlay mesh ventral hernia repair. BACKGROUND: Ventral hernia repair is one of the most common operations performed by general surgeons. To our knowledge, no studies have been published to date comparing long-term outcomes of laparoscopic versus robotic ventral hernia repair. METHODS: The trial was registered at clinicaltrials.gov (NCT03490266). Clinical outcomes included surgical site infection, surgical site occurrence, hernia occurrence, readmission, reoperation, and mortality. RESULTS: A total of 175 consecutive patients were approached that were deemed eligible for elective minimally invasive ventral hernia repair. In all, 124 were randomized and 101 completed follow-up at 2 years. Two-year follow-up was completed in 54 patients (83%) in the robotic arm and 47 patients (80%) in the laparoscopic arm. No differences were seen in surgical site infection or surgical site occurrence. Hernia recurrence occurred in 2 patients (4%) receiving robotic repair versus in 6 patients (13%) receiving laparoscopic repair (relative risk: 0.3, 95% CI: 0.06-1.39; P =0.12). No patients (0%) required reoperation in the robotic arm whereas 5 patients (11%) underwent reoperation in the laparoscopic arm ( P =0.019, relative risk not calculatable due to null outcome). CONCLUSIONS: Robotic ventral hernia repair demonstrated at least similar if not improved outcomes at 2 years compared with laparoscopy. There is potential benefit with robotic repair; however, additional multi-center trials and longer follow-up are needed to validate the hypothesis-generating findings of this study

Trends in donation after circulatory determination of death donor utilization: Lessons from Houston

Background: Modern advancements have made organ transplantation an increasingly viable option for patients with organ failure. The resulting increases in patients awaiting transplant has resulted in significant morbidity and mortality due to increasing waiting time for transplant. The use of Donation after Circulatory Determination of Death (DCD) organ donors has been the most successful avenue to address the increased need for organ allografts. This review provides a brief history of DCD organ donation in the United States as represented by the experience of the Houston-based LifeGift Organ Procurement Organization (OPO). Methods: Organ donation data from the Scientific Registry of Transplant Recipients (SRTR) and OPO specific data to include all available DCD donors for LifeGift were obtained for analysis. Trends in DCD donation were analyzed in the context of United Network for Organ Sharing policy. Results: By the end of 2021 20% of organs donated in the United States were from DCD donors, in a steadily increasing trend since the mid-1990′s. Metrics utilized by UNOS to monitor organ donation rates and OPO performance do not clearly capture potential DCD donors. Individual OPOs have varying success in utilization of DCD donors, with OPOs like LifeGift focusing on increased DCD utilization. Conclusion: DCD utilization remains the most successful avenue for increasing the deceased donor organ pool in the United States. Increased utilization of DCD organs by transplant centers and focused efforts by OPOs to promote DCD donation can improve the organ shortage nationally. Improved clarity in UNOS metrics can further facilitate OPO performance evaluation and promote further DCD donation in the United States

Perception of Treatment Success and Impact on Function with Antibiotics or Appendectomy for Appendicitis: A Randomized Clinical Trial with an Observational Cohort.

OBJECTIVE: To compare secondary patient reported outcomes of perceptions of treatment success and function for patients treated for appendicitis with appendectomy vs. antibiotics at 30 days. SUMMARY BACKGROUND DATA: The Comparison of Outcomes of antibiotic Drugs and Appendectomy trial found antibiotics noninferior to appendectomy based on 30-day health status. To address questions about outcomes among participants with lower socioeconomic status, we explored the relationship of sociodemographic and clinical factors and outcomes. METHODS: We focused on 4 patient reported outcomes at 30 days: high decisional regret, dissatisfaction with treatment, problems performing usual activities, and missing \u3e10 days of work. The randomized (RCT) and observational cohorts were pooled for exploration of baseline factors. The RCT cohort alone was used for comparison of treatments. Logistic regression was used to assess associations. RESULTS: The pooled cohort contained 2062 participants; 1552 from the RCT. Overall, regret and dissatisfaction were low whereas problems with usual activities and prolonged missed work occurred more frequently. In the RCT, those assigned to antibiotics had more regret (Odd ratios (OR) 2.97, 95% Confidence intervals (CI) 2.05-4.31) and dissatisfaction (OR 1.98, 95%CI 1.25-3.12), and reported less missed work (OR 0.39, 95%CI 0.27-0.56). Factors associated with function outcomes included sociodemographic and clinical variables for both treatment arms. Fewer factors were associated with dissatisfaction and regret. CONCLUSIONS: Overall, participants reported high satisfaction, low regret, and were frequently able to resume usual activities and return to work. When comparing treatments for appendicitis, no single measure defines success or failure for all people. The reported data may inform discussions regarding the most appropriate treatment for individuals. TRIAL REGISTRATION: Clinicaltrials.gov Identifier: NCT02800785

Perception of Treatment Success and Impact on Function with Antibiotics or Appendectomy for Appendicitis

ObjectiveTo compare secondary patient reported outcomes of perceptions of treatment success and function for patients treated for appendicitis with appendectomy vs. antibiotics at 30 days.Summary background dataThe Comparison of Outcomes of antibiotic Drugs and Appendectomy trial found antibiotics noninferior to appendectomy based on 30-day health status. To address questions about outcomes among participants with lower socioeconomic status, we explored the relationship of sociodemographic and clinical factors and outcomes.MethodsWe focused on 4 patient reported outcomes at 30 days: high decisional regret, dissatisfaction with treatment, problems performing usual activities, and missing >10 days of work. The randomized (RCT) and observational cohorts were pooled for exploration of baseline factors. The RCT cohort alone was used for comparison of treatments. Logistic regression was used to assess associations.ResultsThe pooled cohort contained 2062 participants; 1552 from the RCT. Overall, regret and dissatisfaction were low whereas problems with usual activities and prolonged missed work occurred more frequently. In the RCT, those assigned to antibiotics had more regret (Odd ratios (OR) 2.97, 95% Confidence intervals (CI) 2.05-4.31) and dissatisfaction (OR 1.98, 95%CI 1.25-3.12), and reported less missed work (OR 0.39, 95%CI 0.27-0.56). Factors associated with function outcomes included sociodemographic and clinical variables for both treatment arms. Fewer factors were associated with dissatisfaction and regret.ConclusionsOverall, participants reported high satisfaction, low regret, and were frequently able to resume usual activities and return to work. When comparing treatments for appendicitis, no single measure defines success or failure for all people. The reported data may inform discussions regarding the most appropriate treatment for individuals.Trial registrationClinicaltrials.gov Identifier: NCT02800785