Real-world data from the health decision maker perspective. What are we talking about?

Healthcare decision-makers are increasingly developing policies that seek information on “real-world” data providing “evidence” to support and monitor changes in clinical practice or policy decisions. Many strategies may be evaluated in experimental circumstances, but this does rarely reflect clinical practice. Due to the current focus on information and computer technology to provide safer and more efficient healthcare delivery, the amount of electronic medical records and other electronic healthcare data is increasing exponentially, and these real-world data can be used for evidence generation. This review describes why and how healthcare/policy decision making could benefit from real-world data, it introduces methods to investigate real-world clinical practice, lists potentialities of routinely collected real-world data, reviews their availability in the word, and outlines future challenges in this field

Should methods of correction for multiple comparisons be applied in pharmacovigilance?

Purpose. In pharmacovigilance, spontaneous reporting databases are devoted to the early detection of adverse event ‘signals’ of marketed drugs. A common limitation of these systems is the wide number of concurrently investigated associations, implying a high probability of generating positive signals simply by chance. However it is not clear if the application of methods aimed to adjust for the multiple testing problems are needed when at least some of the drug-outcome relationship under study are known. To this aim we applied a robust estimation method for the FDR (rFDR) particularly suitable in the pharmacovigilance context. Methods. We exploited the data available for the SAFEGUARD project to apply the rFDR estimation methods to detect potential false positive signals of adverse reactions attributable to the use of non-insulin blood glucose lowering drugs. Specifically, the number of signals generated from the conventional disproportionality measures and after the application of the rFDR adjustment method was compared. Results. Among the 311 evaluable pairs (i.e., drug-event pairs with at least one adverse event report), 106 (34%) signals were considered as significant from the conventional analysis. Among them 1 resulted in false positive signals according to rFDR method. Conclusions. The results of this study seem to suggest that when a restricted number of drug-outcome pairs is considered and warnings about some of them are known, multiple comparisons methods for recognizing false positive signals are not so useful as suggested by theoretical considerations

Intussusception following rotavirus vaccination in the Valencia Region, Spain

Studies have shown high intussusception rates in Spain. We performed a hospital-based retrospective observational study of the intussusception risk following rotavirus vaccinations among infants in Valencia, a region of Spain with an annual birth cohort of approximately 48,000 children, during 2007–2011, using a self-controlled case series design. We performed medical record review of all cases using Brighton Collaboration´s case definition and assessed the positive predictive value (PPV) of the intussusception diagnosis code. Among 151 hospitalized cases discharged as intussusception, we confirmed 136 as Brighton Collaboration's Levels 1 or 2, resulting in a PPV of 93% (95% CI: 87%–96%). Three confirmed cases occurred within days 1–7 following the first rotavirus vaccination. The incidence rate ratio was 9.0 (95% CI: 0.9–86.5) (crude) and 4.7 (95% CI:0.3–74.1)(age adjusted). In this first study in Europe, the intussusception risk point estimate was comparable to other studies, although results were not statistically significant, maybe due to limited power. The high PPV found will facilitate implementation of a larger study without requiring medical record review. Our finding of very few vaccinated cases despite a thorough 5-year investigation in a country that, according to previous studies, may have a large background rate of intussusception is reassuring and should contribute to deliberations about the need to include rotavirus vaccines in the official Spanish calendars

Pandemic influenza vaccine & narcolepsy: Simulations on the potential impact of bias

Several studies have identified an association between PandemrixTM, an AS03 adjuvanted pandemic influenza A(H1N1) vaccine, and narcolepsy, a rare and under-diagnosed sleep disorder with a median onset-to-diagnosis interval of ten years. This paper reviews potential sources of bias in published studies and aims to provide, through simulation, methodological recommendations for assessment of vaccine safety signals. Our simulation study showed that in the absence of an association between the vaccine and the outcome, presence of detection bias and differential exposure misclassification could account for elevated risk estimates. These may play a major role, particularly in alert situations when observation times are limited and the disease has a long latency period. Estimates from the case-control design were less inflated than those from the cohort design when these biases were present. Overall, these simulations provide useful insights for the design and interpretation of future studies

CodeMapper: semiautomatic coding of case definitions. A contribution from the ADVANCE project

Abstract Background: Assessment of drug and vaccine effects by combining information from different healthcare databases in the European Union requires extensive efforts in the harmonization of codes as different vocabularies are being used across countries. In this paper, we present a web application called CodeMapper, which assists in the mapping of case definitions to codes from different vocabularies, while keeping a transparent record of the complete mapping process. Methods: CodeMapper builds upon coding vocabularies contained in the Metathesaurus of the Unified Medical Language System. The mapping approach consists of three phases. First, medical concepts are automatically identified in a free‐text case definition. Second, the user revises the set of medical concepts by adding or removing concepts, or expanding them to related concepts that are more general or more specific. Finally, the selected concepts are projected to codes from the targeted coding vocabularies. We evaluated the application by comparing codes that were automatically generated from case definitions by applying CodeMapper's concept identification and successive concept expansion, with reference codes that were manually created in a previous epidemiological study. Results: Automated concept identification alone had a sensitivity of 0.246 and positive predictive value (PPV) of 0.420 for reproducing the reference codes. Three successive steps of concept expansion increased sensitivity to 0.953 and PPV to 0.616. Conclusions: Automatic concept identification in the case definition alone was insufficient to reproduce the reference codes, but CodeMapper's operations for concept expansion provide an effective, efficient, and transparent way for reproducing the reference codes

Guillain-Barré syndrome and adjuvanted pandemic influenza A (H1N1) 2009 vaccines: A multinational self-controlled case series in Europe

BACKGROUND: The risk of Guillain-Barré syndrome (GBS) following the United States' 1976 swine flu vaccination campaign in the USA led to enhanced active surveillance during the pandemic influenza (A(H1N1)pdm09) immunization campaign. This study aimed to estimate the risk of GBS following influenza A(H1N1)pdm09 vaccination. METHODS: A self-controlled case series (SCCS) analysis was performed in Denmark, Finland, France, Netherlands, Norway, Sweden, and the United Kingdom. Information was collected according to a common protocol and standardised procedures. Cases classified at levels 1-4a of the Brighton Collaboration case definition were included. The risk window was 42 days starting the day after vaccination. Conditional Poisson regression and pooled random effects models estimated adjusted relative incidences (RI). Pseudo likelihood and vaccinated-only methods addressed the potential contraindication for vaccination following GBS. RESULTS: Three hundred and three (303) GBS and Miller Fisher syndrome cases were included. Ninety-nine (99) were exposed to A(H1N1)pdm09 vaccination, which was most frequently adjuvanted (Pandemrix and Focetria). The unadjusted pooled RI for A(H1N1)pdm09 vaccination and GBS was 3.5 (95% Confidence Interval (CI): 2.2-5.5), based on all countries. This lowered to 2.0 (95% CI: 1.2-3.1) after adjustment for calendartime and to 1.9 (95% CI: 1.1-3.2) when we accounted for contra-indications. In a subset (Netherlands, Norway, and United Kingdom) we further adjusted for other confounders and there the RI decreased from 1.7 (adjusted for calendar month) to 1.4 (95% CI: 0.7-2.8), which is the main finding. CONCLUSION: This study illustrates the potential of conducting European collaborative vaccine safety studies. The main, fully adjusted analysis, showed that the RI of GBS was not significantly elevated after influenza A(H1N1)pdm09 vaccination (RI = 1.4 (95% CI: 0.7-2.8). Based on the upper limits of the pooled estimate we can rule out with 95% certainty that the number of excess GBS cases after influenza A(H1N1)pdm09 vaccination would be more than 3 per million vaccinated

Guillain-Barré syndrome and adjuvanted pandemic influenza A (H1N1) 2009 vaccines: A multinational self-controlled case series in Europe

Background: The risk of Guillain-Barré syndrome (GBS) following the United States' 1976 swine flu vaccination campaign in the USA led to enhanced active surveillance during the pandemic influenza (A(H1N1)pdm09) immunization campaign. This study aimed to estimate the risk

Population-based analysis of non-steroidal anti-inflammatory drug use among children in four European countries in the SOS project: What size of data platforms and which study designs do we need to assess safety issues?

Background: Data on utilization patterns and safety of non-steroidal anti-inflammatory drugs (NSAIDs) in children are scarce. The purpose of this study was to investigate the utilization of NSAIDs among children in four European countries as part of the Safety Of non-Steroidal anti-inflammatory drugs (SOS) project.Methods: We used longitudinal patient data from seven databases (GePaRD, IPCI, OSSIFF, Pedianet, PHARMO, SISR, and THIN) to calculate prevalence rates of NSAID use among children (0-18 years of age) from Germany, Italy, Netherlands, and United Kingdom. All databases contained a representative population sample and recorded demographics, diagnoses, and drug prescriptions. Prevalence rates of NSAID use were stratified by age, sex, and calendar time. The person-time of NSAID exposure was calculated by using the duration of the prescription supply. We calculated incidence rates for serious adverse events of interest. For these adverse events of interest, sample size calculations were conducted (alpha = 0.05; 1-beta = 0.8) to determine the amount of NSAID exposure time that would be required for safety studies in children.Results: The source population comprised 7.7 million children with a total of 29.6 million person-years of observation. Of those, 1.3 million children were exposed to at least one of 45 NSAIDs during observation time. Overall prevalence rates of NSAID use in children differed across countries, ranging from 4.4 (Italy) to 197 (Germany) per 1000 person-years in 2007. For Germany, United Kingdom, and Italian pediatricians, we observed high rates of NSAID use among children aged one to four years. For all four countries, NSAID use increased with older age categories for children older than 11. In this analysis, only for ibuprofen (the most frequently used NSAID), enough exposure was available to detect a weak association (relative risk of 2) between exposure and asthma exacerbation (the most common serious adverse event of interest).Conclusions: Patterns of NSAID use in children were heterogeneous across four European countries. The SOS project platform captures data on more than 1.3 million children who were exposed to NSAIDs. Even larger data platforms and the use of advanced versions of case-only study designs may be needed to conclusively assess the safety of these drugs in children

Enhancing global vaccine pharmacovigilance: Proof-of-concept study on aseptic meningitis and immune thrombocytopenic purpura following measles-mumps containing vaccination

New vaccines designed to prevent diseases endemic in low and middle-income countries (LMICs) are now being introduced without prior record of utilization in countries with robust pharmacovigilance systems. To address this deficit, our objective was to demonstrate feasibility of an international hospital-based network for the assessment of potential epidemiological associations between serious and rare adverse events and vaccines in any setting. This was done through a proof-of-concept evaluation of the risk of immune thrombocytopenic purpura (ITP) and aseptic meningitis (AM) following administration of the first dose of measles-mumps-containing vaccines using the self-controlled risk interval method in the primary analysis. The World Health Organization (WHO) selected 26 sentinel sites (49 hospitals) distributed in 16 countries of the six WHO regions. Incidence rate ratios (IRR) of 5.0 (95% CI: 2.5-9.7) for ITP following first dose of measles-containing vaccinations, and of 10.9 (95% CI: 4.2-27.8) for AM following mumps-containing vaccinations were found. The strain-specific analyses showed significantly elevated ITP risk for measles vaccines containing Schwarz (IRR: 20.7; 95% CI: 2.7-157.6), Edmonston-Zagreb (IRR: 11.1; 95% CI: 1.4-90.3), and Enders'Edmonston (IRR: 8.5; 95% CI: 1.9-38.1) strains. A significantly elevated AM risk for vaccines containing the Leningrad-Zagreb mumps strain (IRR: 10.8; 95% CI: 1.3-87.4) was also found. This proof-of-concept study has shown, for the first time, that an international hospital-based network for the investigation of rare vaccine adverse events, using common standardized procedures and with high participation of LMICs, is feasible, can produce reliable results, and has the potential to characterize differences in risk between vaccine strains. The completion of this network by adding large reference hospitals, particularly from tropical countries, and the systematic WHO-led implementation of this approach, should permit the rapid post-marketing evaluation of safety signals for serious and rare adverse events for new and existing vaccines in all settings, including LMICs