Reproducibility of hospital rankings based on centers for Medicare & Medicaid Services Hospital Compare measures as a function of measure reliability

Importance: Unreliable performance measures can mask poor-quality care and distort financial incentives in value-based purchasing. Objective: To examine the association between test-retest reliability and the reproducibility of hospital rankings. Design, Setting, and Participants: In a cross-sectional design, Centers for Medicare & Medicaid Services Hospital Compare data were analyzed for the 2017 (based on 2014-2017 data) and 2018 (based on 2015-2018 data) reporting periods. The study was conducted from December 13, 2020, to September 30, 2021. This analysis was based on 28 measures, including mortality (acute myocardial infarction, congestive heart failure, pneumonia, and coronary artery bypass grafting), readmissions (acute myocardial infarction, congestive heart failure, pneumonia, and coronary artery bypass grafting), and surgical complications (postoperative acute kidney failure, postoperative respiratory failure, postoperative sepsis, and failure to rescue). Exposures: Measure reliability based on test-retest reliability testing. Main Outcomes and Measures: The reproducibility of hospital rankings was quantified by calculating the reclassification rate across the 2017 and 2018 reporting periods after categorizing the hospitals into terciles, quartiles, deciles, and statistical outliers. Linear regression analysis was used to examine the association between the reclassification rate and the intraclass correlation coefficient for each of the classification systems. Results: The analytic cohort consisted of 28 measures from 4452 hospitals with a median of 2927 (IQR, 2378-3160) hospitals contributing data for each measure. The hospitals participating in the Inpatient Prospective Payment System (n = 3195) had a median bed size of 141 (IQR, 69-261), average daily census of 70 (IQR, 24-155) patients, and a median disproportionate share hospital percentage of 38.2% (IQR, 18.7%-36.6%). The median intraclass correlation coefficient was 0.78 (IQR, 0.72-0.81), ranging between 0.50 and 0.85. The median reclassification rate was 70% (IQR, 62%-71%) when hospitals were ranked by deciles, 43% (IQR, 39%-45%) when ranked by quartiles, 34% (IQR, 31%-36%) when ranked by terciles, and 3.8% (IQR, 2.0%-6.2%) when ranked by outlier status. Increases in measure reliability were not associated with decreases in the reclassification rate. Each 0.1-point increase in the intraclass correlation coefficient was associated with a 6.80 (95% CI, 2.28-11.30; P = .005) percentage-point increase in the reclassification rate when hospitals were ranked into performance deciles, 4.15 (95% CI, 1.16-7.14; P = .008) when ranked into performance quartiles, 1.47 (95% CI, 1.84, 4.77; P = .37) when ranked into performance terciles, and 3.70 (95% CI, 1.30-6.09; P = .004) when ranked by outlier status. Conclusions and Relevance: In this study, more reliable measures were not associated with lower rates of reclassifying hospitals using test-retest reliability testing. These findings suggest that measure reliability should not be assessed with test-retest reliability testing

The COVID-19 pandemic and associated inequities in acute myocardial infarction treatment and outcomes

IMPORTANCE: The COVID-19 pandemic disrupted usual care for emergent conditions, such as acute myocardial infarction (AMI). Understanding whether Black and Hispanic individuals experiencing AMI had greater increases in poor outcomes compared with White individuals during the pandemic has important equity implications. OBJECTIVE: To investigate whether the COVID-19 pandemic was associated with increased disparities in treatment and outcomes among Medicare patients hospitalized with AMI. DESIGN, SETTING, AND PARTICIPANTS: This cross-sectional study used Medicare data for patients hospitalized with AMI between January 2016 and November 2020. Patients were categorized as Hispanic, non-Hispanic Black, and non-Hispanic White. The association between race and ethnicity and outcomes as a function of the proportion of hospitalized patients with COVID-19 was evaluated using interrupted time series. Data were analyzed from October 2022 to June 2023. EXPOSURE: The main exposure was a hospital\u27s proportion of hospitalized patients with COVID-19 on a weekly basis as a proxy for care disruption during the pandemic. MAIN OUTCOMES AND MEASURES: Revascularization, 30-day mortality, 30-day readmission, and nonhome discharges. RESULTS: A total of 1 319 273 admissions for AMI (579 817 females [44.0%]; 122 972 Black [9.3%], 117 668 Hispanic [8.9%], and 1 078 633 White [81.8%]; mean [SD] age, 77 [8.4] years) were included. For patients with non-ST segment elevation MI (NSTEMI) overall, the adjusted odds of mortality and nonhome discharges increased by 51% (adjusted odds ratio [aOR], 1.51; 95% CI, 1.29-1.76; P \u3c .001) and 32% (aOR, 1.32; 95% CI, 1.15-1.52; P \u3c .001), respectively, and the odds of revascularization decreased by 27% (aOR, 0.73; 95% CI, 0.64-0.83; P \u3c .001) among patients hospitalized during weeks with a high hospital COVID-19 burden (\u3e30%) vs patients hospitalized prior to the pandemic. Black individuals with NSTEMI experienced a clinically insignificant 7% greater increase in the odds of mortality (aOR, 1.07; 95% CI, 1.00-1.15; P = .04) for each 10% increase in the COVID-19 hospital burden but no increases in readmissions or nonhome discharges or reductions in revascularization rates compared with White individuals. There were no differential increases in adverse outcomes among Hispanic compared with White patients with NSTEMI based on hospital COVID-19 burden. Increases in hospital COVID-19 burden were not associated with changes in outcomes or the use of revascularization in STEMI overall or by racial or ethnic group. CONCLUSIONS AND RELEVANCE: This study found that while hospital COVID-19 burden was associated with worse treatment and outcomes for NSTEMI, race and ethnicity-associated inequities did not increase significantly during the pandemic. These findings suggest the need for additional efforts to mitigate outcomes associated with the COVID-19 pandemic for patients admitted with AMI when the hospital COVID-19 burden is substantially increased

Was COVID-19 associated with worsening inequities in stroke treatment and outcomes?

Background COVID-19 stressed hospitals and may have disproportionately affected the stroke outcomes and treatment of Black and Hispanic individuals. Methods and Results This retrospective study used 100% Medicare Provider Analysis and Review file data from between 2016 and 2020. We used interrupted time series analyses to examine whether the COVID-19 pandemic exacerbated disparities in stroke outcomes and reperfusion therapy. Among 1 142 560 hospitalizations for acute ischemic strokes, 90 912 (8.0%) were Hispanic individuals; 162 752 (14.2%) were non-Hispanic Black individuals; and 888 896 (77.8%) were non-Hispanic White individuals. The adjusted odds of mortality increased by 51% (adjusted odds ratio [aOR], 1.51 [95% CI, 1.34-1.69]

Hospital strain during the COVID-19 pandemic and outcomes in older racial and ethnic minority adults

IMPORTANCE: Marginalized populations have been disproportionately affected by the COVID-19 pandemic. Critically ill patients belonging to racial and ethnic minority populations treated in hospitals operating under crisis or near-crisis conditions may have experienced worse outcomes than White individuals. OBJECTIVE: To examine whether hospital strain was associated with worse outcomes for older patients hospitalized with sepsis and whether these increases in poor outcomes were greater for members of racial and ethnic minority groups compared with White individuals. DESIGN, SETTING, AND PARTICIPANTS: In this cross-sectional study, multivariable regression analysis was conducted to assess differential changes in all-cause 30-day mortality and major morbidity among older racial and ethnic minoritized individuals hospitalized with sepsis compared with White individuals and changes in hospital strain using Medicare claims data. Data were obtained on patients hospitalized between January 1, 2016, and December 31, 2021, and analyzed between December 16, 2023, and July 11, 2024. EXPOSURE: Time-varying weekly hospital percentage of inpatients with COVID-19. MAIN OUTCOMES AND MEASURES: Composite of all-cause 30-day mortality and major morbidity. RESULTS: Among the 5 899 869 hospitalizations for sepsis (51.5% women; mean [SD] age, 78.2 [8.8] years), there were 177 864 (3.0%) Asian, 664 648 (11.3%) Black, 522 964 (8.9%) Hispanic, and 4 534 393 (76.9%) White individuals. During weeks when the hospital COVID-19 burden was greater than 40%, the risk of death or major morbidity increased nearly 2-fold (adjusted odds ratio [AOR], 1.90; 95% CI, 1.80-2.00; P \u3c .001) for White individuals compared with before the pandemic. Asian, Black, and Hispanic individuals experienced 44% (AOR, 1.44; 95% CI, 1.28-1.61; P \u3c .001), 21% (AOR, 1.21; 95% CI, 1.11-1.33; P \u3c .001), and 45% (AOR, 1.45; 95% CI, 1.32-1.59; P \u3c .001) higher risk of death or morbidity, respectively, compared with White individuals when the hospital weekly COVID-19 burden was greater than 40%. CONCLUSION AND RELEVANCE: In this cross-sectional study, older adults hospitalized with sepsis were more likely to die or experience major morbidity as the hospital COVID-19 burden increased. These increases in adverse outcomes were greater in magnitude among members of minority populations than for White individuals

COVID-19 pandemic and racial and ethnic disparities in long-term nursing home stay or death following hospital discharge

IMPORTANCE: Long-term nursing home stay or death (long-term NH stay or death), defined as new long-term residence in a nursing home or death following hospital discharge, is an important patient-centered outcome. OBJECTIVE: To examine whether the COVID-19 pandemic was associated with changes in long-term NH stay or death among older adults with sepsis, and whether these changes were greater in individuals from racial and ethnic minoritized groups. DESIGN, SETTING, AND PARTICIPANTS: This cross-sectional study used patient-level data from the Medicare Provider Analysis and Review File, the Master Beneficiary Summary File, and the Minimum Data Set. Community-dwelling individuals aged at least 65 years hospitalized with sepsis between January 2016 and June 2021 were included. Data were analyzed from May to November 2024. EXPOSURE: Race and ethnicity and the COVID-19 pandemic. MAIN OUTCOMES AND MEASURES: Patients discharged alive experienced long-term NH stay or death if they resided in a nursing home more than 100 days after hospital discharge and had no period at home greater than 30 days, or died more than 30 days following hospital discharge. Interrupted time series analysis was used to evaluate the association between long-term NH stay or death and the pandemic and race and ethnicity. RESULTS: A total of 2 964 517 hospitalizations for sepsis of community-dwelling patients discharged alive (1 468 754 [49.5%] female; 19 549 [0.7%] American Indian or Alaska Native, 95 308 [3.2%] Asian or Pacific Islander, 282 646 [9.5%] Black, 279 011 [9.4%] Hispanic, 2 288 003 [71.2%] White individuals; mean [SD] age, 76 [8.3] years) were included. Compared with non-Hispanic White individuals, Black individuals were more likely to experience long-term NH stay or death (adjusted odds ratio [aOR], 1.33; 95% CI, 1.30-1.37; P \u3c .001), while Asian or Pacific Islander (aOR, 0.79; 95% CI, 0.75-0.83; P \u3c .001), Hispanic (aOR, 0.72; 95% CI, 0.70-0.74; P \u3c .001), and American Indian or Alaska Native (aOR, 0.79; 95% CI, 0.72-0.87; P \u3c .001) individuals were less likely to experience long-term NH stay or death. Long-term NH stay or death declined from 13.5% in the first quarter of 2016 to 6.9% in the first quarter of 2020. After adjustment, long-term NH stay or death decreased each quarter (aOR, 0.958; 95% CI, 0.957-0.959; P \u3c .001) before the pandemic. The pandemic was associated with increased risk of long-term NH stay or death over time (aOR, 1.03; 95% CI, 1.02-1.04; P \u3c .001 [each quarter]) compared with before the pandemic for non-Hispanic White individuals. The pandemic was not associated with differential changes in long-term NH stay or death for minoritized individuals compared with non-Hispanic White individuals. CONCLUSIONS AND RELEVANCE: In this cross-sectional study, older adults hospitalized with sepsis experienced an approximately 50% reduction in long-term NH stay or death over a 5-year period before the pandemic. These results suggest that during the pandemic, all individuals, regardless of race and ethnicity, experienced increased long-term NH stay or death compared with before the pandemic

Association between the COVID-19 pandemic and insurance-based disparities in mortality after major surgery among US adults

Importance: The COVID-19 pandemic caused significant disruptions in surgical care. Whether these disruptions disproportionately impacted economically disadvantaged individuals is unknown. Objective: To evaluate the association between the COVID-19 pandemic and mortality after major surgery among patients with Medicaid insurance or without insurance compared with patients with commercial insurance. Design, Setting, and Participants: This cross-sectional study used data from the Vizient Clinical Database for patients who underwent major surgery at hospitals in the US between January 1, 2018, and May 31, 2020. Exposures: The hospital proportion of patients with COVID-19 during the first wave of COVID-19 cases between March 1 and May 31, 2020, stratified as low (≤5.0%), medium (5.1%-10.0%), high (10.1%-25.0%), and very high (\u3e25.0%). Main Outcomes and Measures: The main outcome was inpatient mortality. The association between mortality after surgery and payer status as a function of the proportion of hospitalized patients with COVID-19 was evaluated with a quasi-experimental triple-difference approach using logistic regression. Results: Among 2 950 147 adults undergoing inpatient surgery (1 550 752 female [52.6%]) at 677 hospitals, the primary payer was Medicare (1 427 791 [48.4%]), followed by commercial insurance (1 000 068 [33.9%]), Medicaid (321 600 [10.9%]), other payer (140 959 [4.8%]), and no insurance (59 729 [2.0%]). Mortality rates increased more for patients undergoing surgery during the first wave of the pandemic in hospitals with a high COVID-19 burden (adjusted odds ratio [AOR], 1.13; 95% CI, 1.03-1.24; P = .01) and a very high COVID-19 burden (AOR, 1.38; 95% CI, 1.24-1.53; P \u3c .001) compared with patients in hospitals with a low COVID-19 burden. Overall, patients with Medicaid had 29% higher odds of death (AOR, 1.29; 95% CI, 1.22-1.36; P \u3c .001) and patients without insurance had 75% higher odds of death (AOR, 1.75; 95% CI, 1.55-1.98; P \u3c .001) compared with patients with commercial insurance. However, mortality rates for surgical patients with Medicaid insurance (AOR, 1.03; 95% CI, 0.82-1.30; P = .79) or without insurance (AOR, 0.85; 95% CI, 0.47-1.54; P = .60) did not increase more than for patients with commercial insurance in hospitals with a high COVID-19 burden compared with hospitals with a low COVID-19 burden. These findings were similar in hospitals with very high COVID-19 burdens. Conclusions and Relevance: In this cross-sectional study, the first wave of the COVID-19 pandemic was associated with a higher risk of mortality after surgery in hospitals with more than 25.0% of patients with COVID-19. However, the pandemic was not associated with greater increases in mortality among patients with no insurance or patients with Medicaid compared with patients with commercial insurance in hospitals with a very high COVID-19 burden

Racial and ethnic disparities in access to minimally invasive mitral valve surgery

IMPORTANCE: Whether people from racial and ethnic minority groups experience disparities in access to minimally invasive mitral valve surgery (MIMVS) is not known. OBJECTIVE: To investigate racial and ethnic disparities in the utilization of MIMVS. DESIGN, SETTING, AND PARTICIPANTS: This cross-sectional study used data from the Society of Thoracic Surgeons Database for patients who underwent mitral valve surgery between 2014 and 2019. Statistical analysis was performed from January 24 to August 11, 2022. EXPOSURES: Patients were categorized as non-Hispanic White, non-Hispanic Black, and Hispanic individuals. MAIN OUTCOMES AND MEASURES: The association between MIMVS (vs full sternotomy) and race and ethnicity were evaluated using logistic regression. RESULTS: Among the 103 753 patients undergoing mitral valve surgery (mean [SD] age, 62 [13] years; 47 886 female individuals [46.2%]), 10 404 (10.0%) were non-Hispanic Black individuals, 89 013 (85.8%) were non-Hispanic White individuals, and 4336 (4.2%) were Hispanic individuals. Non-Hispanic Black individuals were more likely to have Medicaid insurance (odds ratio [OR], 2.21; 95% CI, 1.64-2.98; P \u3c .001) and to receive care from a low-volume surgeon (OR, 4.45; 95% CI, 4.01-4.93; P \u3c .001) compared with non-Hispanic White individuals. Non-Hispanic Black individuals were less likely to undergo MIMVS (OR, 0.65; 95% CI, 0.58-0.73; P \u3c .001), whereas Hispanic individuals were not less likely to undergo MIMVS compared with non-Hispanic White individuals (OR, 1.08; 95% CI, 0.67-1.75; P = .74). Patients with commercial insurance had 2.35-fold higher odds of undergoing MIMVS (OR, 2.35; 95% CI, 2.06-2.68; P \u3c .001) than those with Medicaid insurance. Patients operated by very-high volume surgeons (300 or more cases) had 20.7-fold higher odds (OR, 20.70; 95% CI, 12.7-33.9; P \u3c .001) of undergoing MIMVS compared with patients treated by low-volume surgeons (less than 20 cases). After adjusting for patient risk, non-Hispanic Black individuals were still less likely to undergo MIMVS (adjusted OR [aOR], 0.88; 95% CI, 0.78-0.99; P = .04) and were more likely to die or experience a major complication (aOR, 1.25; 95% CI, 1.16-1.35; P \u3c .001) compared with non-Hispanic White individuals. CONCLUSIONS AND RELEVANCE: In this cross-sectional study, non-Hispanic Black patients were less likely to undergo MIMVS and more likely to die or experience a major complication than non-Hispanic White patients. These findings suggest that efforts to reduce inequity in cardiovascular medicine may need to include increasing access to private insurance and high-volume surgeons

Postoperative delirium in older adults undergoing noncardiac surgery

IMPORTANCE: Understanding the association of postoperative delirium with adverse outcomes and the hospital-level variation of postoperative delirium is important for efforts to improve perioperative brain health. OBJECTIVE: To examine (1) the association of postoperative delirium with 30-day mortality and complications and (2) hospital-level variation in postoperative delirium. DESIGN, SETTING, AND PARTICIPANTS: This retrospective cohort study examined hospitalizations among patients aged 65 years and older who underwent noncardiac surgery in US hospitals between January 1, 2017, and December 31, 2020. Data were analyzed between August 28, 2024, and April 10, 2025. EXPOSURE: Postoperative delirium. MAIN OUTCOMES AND MEASURES: The association of the composite of death and major complications with postoperative delirium was examined using multivariable logistic regression. Variability in the hospital incidence of postoperative delirium was evaluated using multilevel logistic regression analysis. RESULTS: Among 5 530 054 inpatient admissions for major noncardiac surgery in 3169 hospitals, the mean (SD) patient age was 74.7 (7.0) years, and 3 161 054 admissions (57.2%) were of female patients. The incidence of postoperative delirium was 3.6% (197 921 admissions). Compared with patients without postoperative delirium, patients with postoperative delirium were more likely to experience death or major complications (adjusted OR [aOR], 3.47; 95% CI, 3.41-3.53; P \u3c  .001), 30-day mortality (aOR, 2.77; 95% CI, 2.71-2.83; P \u3c  .001), and nonhome discharges (aOR, 3.96; 95% CI, 3.88-4.04; P \u3c  .001). Controlling for patient characteristics, the odds of postoperative delirium were higher for patients undergoing surgery in hospitals with a higher rate of postoperative delirium compared with hospitals with lower rates of postoperative delirium (median OR, 1.53; 95% CI, 1.50-1.56). CONCLUSIONS AND RELEVANCE: In this national retrospective cohort study of more than 5.5 million hospitalizations, older individuals undergoing major noncardiac surgery who experienced postoperative delirium had 3.5-fold higher odds of death or major complications, 2.8-fold higher odds of death, and 4.0-fold higher odds of nonhome discharge. There was substantial variation in the hospital rate of postoperative delirium after accounting for patient risk, which suggests that this complication may be an appropriate target for hospital efforts to improve perioperative brain health, provided that delirium screening and coding accuracy are improved