Analyses of adverse events (AEs) are an important aspect of the evaluation of
experimental therapies. The SAVVY (Survival analysis for AdVerse events with
Varying follow-up times) project aims to improve the analyses of AE data in
clinical trials through the use of survival techniques appropriately dealing
with varying follow-up times, censoring, and competing events (CE). In an
empirical study including seventeen randomized clinical trials the effect of
varying follow-up times, censoring, and competing events on comparisons of two
treatment arms with respect to AE risks is investigated. The comparisons of
relative risks (RR) of standard probability-based estimators to the
gold-standard Aalen-Johansen estimator or hazard-based estimators to an
estimated hazard ratio (HR) from Cox regression are done descriptively, with
graphical displays, and using a random effects meta-analysis on AE level. The
influence of different factors on the size of the bias is investigated in a
meta-regression. We find that for both, avoiding bias and categorization of
evidence with respect to treatment effect on AE risk into categories, the
choice of the estimator is key and more important than features of the
underlying data such as percentage of censoring, CEs, amount of follow-up, or
value of the gold-standard RR. There is an urgent need to improve the
guidelines of reporting AEs so that incidence proportions are finally replaced
by the Aalen-Johansen estimator - rather than by Kaplan-Meier - with
appropriate definition of CEs. For RRs based on hazards, the HR based on Cox
regression has better properties than the ratio of incidence densities