Approaches for combining primary care electronic health record data from multiple sources: a systematic review of observational studies

OBJECTIVE: To identify observational studies which used data from more than one primary care electronic health record (EHR) database, and summarise key characteristics including: objective and rationale for using multiple data sources; methods used to manage, analyse and (where applicable) combine data; and approaches used to assess and report heterogeneity between data sources. DESIGN: A systematic review of published studies. DATA SOURCES: Pubmed and Embase databases were searched using list of named primary care EHR databases; supplementary hand searches of reference list of studies were retained after initial screening. STUDY SELECTION: Observational studies published between January 2000 and May 2018 were selected, which included at least two different primary care EHR databases. RESULTS: 6054 studies were identified from database and hand searches, and 109 were included in the final review, the majority published between 2014 and 2018. Included studies used 38 different primary care EHR data sources. Forty-seven studies (44%) were descriptive or methodological. Of 62 analytical studies, 22 (36%) presented separate results from each database, with no attempt to combine them; 29 (48%) combined individual patient data in a one-stage meta-analysis and 21 (34%) combined estimates from each database using two-stage meta-analysis. Discussion and exploration of heterogeneity was inconsistent across studies. CONCLUSIONS: Comparing patterns and trends in different populations, or in different primary care EHR databases from the same populations, is important and a common objective for multi-database studies. When combining results from several databases using meta-analysis, provision of separate results from each database is helpful for interpretation. We found that these were often missing, particularly for studies using one-stage approaches, which also often lacked details of any statistical adjustment for heterogeneity and/or clustering. For two-stage meta-analysis, a clear rationale should be provided for choice of fixed effect and/or random effects or other models

Detecting Signals of Disproportionate Reporting from Singapore's Spontaneous Adverse Event Reporting System: An Application of the Sequential Probability Ratio Test.

The ability to detect safety concerns from spontaneous adverse drug reaction reports in a timely and efficient manner remains important in public health. This paper explores the behaviour of the Sequential Probability Ratio Test (SPRT) and ability to detect signals of disproportionate reporting (SDRs) in the Singapore context. We used SPRT with a combination of two hypothesised relative risks (hRRs) of 2 and 4.1 to detect signals of both common and rare adverse events in our small database. We compared SPRT with other methods in terms of number of signals detected and whether labelled adverse drug reactions were detected or the reaction terms were considered serious. The other methods used were reporting odds ratio (ROR), Bayesian Confidence Propagation Neural Network (BCPNN) and Gamma Poisson Shrinker (GPS). The SPRT produced 2187 signals in common with all methods, 268 unique signals, and 70 signals in common with at least one other method, and did not produce signals in 178 cases where two other methods detected them, and there were 403 signals unique to one of the other methods. In terms of sensitivity, ROR performed better than other methods, but the SPRT method found more new signals. The performances of the methods were similar for negative predictive value and specificity. Using a combination of hRRs for SPRT could be a useful screening tool for regulatory agencies, and more detailed investigation of the medical utility of the system is merited

Comparison of algorithms that detect drug side effects using electronic healthcare databases

The electronic healthcare databases are starting to become more readily available and are thought to have excellent potential for generating adverse drug reaction signals. The Health Improvement Network (THIN) database is an electronic healthcare database containing medical information on over 11 million patients that has excellent potential for detecting ADRs. In this paper we apply four existing electronic healthcare database signal detecting algorithms (MUTARA, HUNT, Temporal Pattern Discovery and modified ROR) on the THIN database for a selection of drugs from six chosen drug families. This is the first comparison of ADR signalling algorithms that includes MUTARA and HUNT and enabled us to set a benchmark for the adverse drug reaction signalling ability of the THIN database. The drugs were selectively chosen to enable a comparison with previous work and for variety. It was found that no algorithm was generally superior and the algorithms’ natural thresholds act at variable stringencies. Furthermore, none of the algorithms perform well at detecting rare ADRs

Risk of COVID-19-related death among patients with chronic obstructive pulmonary disease or asthma prescribed inhaled corticosteroids: an observational cohort study using the OpenSAFELY platform

BACKGROUND: Early descriptions of patients admitted to hospital during the COVID-19 pandemic showed a lower prevalence of asthma and chronic obstructive pulmonary disease (COPD) than would be expected for an acute respiratory disease like COVID-19, leading to speculation that inhaled corticosteroids (ICSs) might protect against infection with severe acute respiratory syndrome coronavirus 2 or the development of serious sequelae. We assessed the association between ICS and COVID-19-related death among people with COPD or asthma using linked electronic health records (EHRs) in England, UK. METHODS: In this observational study, we analysed patient-level data for people with COPD or asthma from primary care EHRs linked with death data from the Office of National Statistics using the OpenSAFELY platform. The index date (start of follow-up) for both cohorts was March 1, 2020; follow-up lasted until May 6, 2020. For the COPD cohort, individuals were eligible if they were aged 35 years or older, had COPD, were a current or former smoker, and were prescribed an ICS or long-acting β agonist plus long-acting muscarinic antagonist (LABA-LAMA) as combination therapy within the 4 months before the index date. For the asthma cohort, individuals were eligible if they were aged 18 years or older, had been diagnosed with asthma within 3 years of the index date, and were prescribed an ICS or short-acting β agonist (SABA) only within the 4 months before the index date. We compared the outcome of COVID-19-related death between people prescribed an ICS and those prescribed alternative respiratory medications: ICSs versus LABA-LAMA for the COPD cohort, and low-dose or medium-dose and high-dose ICSs versus SABAs only in the asthma cohort. We used Cox regression models to estimate hazard ratios (HRs) and 95% CIs for the association between exposure categories and the outcome in each population, adjusted for age, sex, and all other prespecified covariates. We calculated e-values to quantify the effect of unmeasured confounding on our results. FINDINGS: We identified 148 557 people with COPD and 818 490 people with asthma who were given relevant respiratory medications in the 4 months before the index date. People with COPD who were prescribed ICSs were at increased risk of COVID-19-related death compared with those prescribed LABA-LAMA combinations (adjusted HR 1·39 [95% CI 1·10-1·76]). Compared with those prescribed SABAs only, people with asthma who were prescribed high-dose ICS were at an increased risk of death (1·55 [1·10-2·18]), whereas those given a low or medium dose were not (1·14 [0·85-1·54]). Sensitivity analyses showed that the apparent harmful association we observed could be explained by relatively small health differences between people prescribed ICS and those not prescribed ICS that were not recorded in the database (e value lower 95% CI 1·43). INTERPRETATION: Our results do not support a major role for regular ICS use in protecting against COVID-19-related death among people with asthma or COPD. Observed increased risks of COVID-19-related death can be plausibly explained by unmeasured confounding due to disease severity. FUNDING: UK Medical Research Council

Ethnic differences in SARS-CoV-2 infection and COVID-19-related hospitalisation, intensive care unit admission, and death in 17 million adults in England: an observational cohort study using the OpenSAFELY platform.

BACKGROUND: COVID-19 has disproportionately affected minority ethnic populations in the UK. Our aim was to quantify ethnic differences in SARS-CoV-2 infection and COVID-19 outcomes during the first and second waves of the COVID-19 pandemic in England. METHODS: We conducted an observational cohort study of adults (aged ≥18 years) registered with primary care practices in England for whom electronic health records were available through the OpenSAFELY platform, and who had at least 1 year of continuous registration at the start of each study period (Feb 1 to Aug 3, 2020 [wave 1], and Sept 1 to Dec 31, 2020 [wave 2]). Individual-level primary care data were linked to data from other sources on the outcomes of interest: SARS-CoV-2 testing and positive test results and COVID-19-related hospital admissions, intensive care unit (ICU) admissions, and death. The exposure was self-reported ethnicity as captured on the primary care record, grouped into five high-level census categories (White, South Asian, Black, other, and mixed) and 16 subcategories across these five categories, as well as an unknown ethnicity category. We used multivariable Cox regression to examine ethnic differences in the outcomes of interest. Models were adjusted for age, sex, deprivation, clinical factors and comorbidities, and household size, with stratification by geographical region. FINDINGS: Of 17 288 532 adults included in the study (excluding care home residents), 10 877 978 (62·9%) were White, 1 025 319 (5·9%) were South Asian, 340 912 (2·0%) were Black, 170 484 (1·0%) were of mixed ethnicity, 320 788 (1·9%) were of other ethnicity, and 4 553 051 (26·3%) were of unknown ethnicity. In wave 1, the likelihood of being tested for SARS-CoV-2 infection was slightly higher in the South Asian group (adjusted hazard ratio 1·08 [95% CI 1·07-1·09]), Black group (1·08 [1·06-1·09]), and mixed ethnicity group (1·04 [1·02-1·05]) and was decreased in the other ethnicity group (0·77 [0·76-0·78]) relative to the White group. The risk of testing positive for SARS-CoV-2 infection was higher in the South Asian group (1·99 [1·94-2·04]), Black group (1·69 [1·62-1·77]), mixed ethnicity group (1·49 [1·39-1·59]), and other ethnicity group (1·20 [1·14-1·28]). Compared with the White group, the four remaining high-level ethnic groups had an increased risk of COVID-19-related hospitalisation (South Asian group 1·48 [1·41-1·55], Black group 1·78 [1·67-1·90], mixed ethnicity group 1·63 [1·45-1·83], other ethnicity group 1·54 [1·41-1·69]), COVID-19-related ICU admission (2·18 [1·92-2·48], 3·12 [2·65-3·67], 2·96 [2·26-3·87], 3·18 [2·58-3·93]), and death (1·26 [1·15-1·37], 1·51 [1·31-1·71], 1·41 [1·11-1·81], 1·22 [1·00-1·48]). In wave 2, the risks of hospitalisation, ICU admission, and death relative to the White group were increased in the South Asian group but attenuated for the Black group compared with these risks in wave 1. Disaggregation into 16 ethnicity groups showed important heterogeneity within the five broader categories. INTERPRETATION: Some minority ethnic populations in England have excess risks of testing positive for SARS-CoV-2 and of adverse COVID-19 outcomes compared with the White population, even after accounting for differences in sociodemographic, clinical, and household characteristics. Causes are likely to be multifactorial, and delineating the exact mechanisms is crucial. Tackling ethnic inequalities will require action across many fronts, including reducing structural inequalities, addressing barriers to equitable care, and improving uptake of testing and vaccination. FUNDING: Medical Research Council

Estimating time-to-onset of adverse drug reactions from spontaneous reporting databases.

International audienceBACKGROUND: Analyzing time-to-onset of adverse drug reactions from treatment exposure contributes to meeting pharmacovigilance objectives, i.e. identification and prevention. Post-marketing data are available from reporting systems. Times-to-onset from such databases are right-truncated because some patients who were exposed to the drug and who will eventually develop the adverse drug reaction may do it after the time of analysis and thus are not included in the data. Acknowledgment of the developments adapted to right-truncated data is not widespread and these methods have never been used in pharmacovigilance. We assess the use of appropriate methods as well as the consequences of not taking right truncation into account (naïve approach) on parametric maximum likelihood estimation of time-to-onset distribution. METHODS: Both approaches, naïve or taking right truncation into account, were compared with a simulation study. We used twelve scenarios for the exponential distribution and twenty-four for the Weibull and log-logistic distributions. These scenarios are defined by a set of parameters: the parameters of the time-to-onset distribution, the probability of this distribution falling within an observable values interval and the sample size. An application to reported lymphoma after anti TNF-¿ treatment from the French pharmacovigilance is presented. RESULTS: The simulation study shows that the bias and the mean squared error might in some instances be unacceptably large when right truncation is not considered while the truncation-based estimator shows always better and often satisfactory performances and the gap may be large. For the real dataset, the estimated expected time-to-onset leads to a minimum difference of 58 weeks between both approaches, which is not negligible. This difference is obtained for the Weibull model, under which the estimated probability of this distribution falling within an observable values interval is not far from 1. CONCLUSIONS: It is necessary to take right truncation into account for estimating time-to-onset of adverse drug reactions from spontaneous reporting databases