Identifying Patterns of Clinical Interest in Clinicians' Treatment Preferences: Hypothesis-free Data Science Approach to Prioritizing Prescribing Outliers for Clinical Review.

BACKGROUND: Data analysis is used to identify signals suggestive of variation in treatment choice or clinical outcome. Analyses to date have generally focused on a hypothesis-driven approach. OBJECTIVE: This study aimed to develop a hypothesis-free approach to identify unusual prescribing behavior in primary care data. We aimed to apply this methodology to a national data set in a cross-sectional study to identify chemicals with significant variation in use across Clinical Commissioning Groups (CCGs) for further clinical review, thereby demonstrating proof of concept for prioritization approaches. METHODS: Here we report a new data-driven approach to identify unusual prescribing behaviour in primary care data. This approach first applies a set of filtering steps to identify chemicals with prescribing rate distributions likely to contain outliers, then applies two ranking approaches to identify the most extreme outliers amongst those candidates. This methodology has been applied to three months of national prescribing data (June-August 2017). RESULTS: Our methodology provides rankings for all chemicals by administrative region. We provide illustrative results for 2 antipsychotic drugs of particular clinical interest: promazine hydrochloride and pericyazine, which rank highly by outlier metrics. Specifically, our method identifies that, while promazine hydrochloride and pericyazine are barely used by most clinicians (with national prescribing rates of 11.1 and 6.2 per 1000 antipsychotic prescriptions, respectively), they make up a substantial proportion of antipsychotic prescribing in 2 small geographic regions in England during the study period (with maximum regional prescribing rates of 298.7 and 241.1 per 1000 antipsychotic prescriptions, respectively). CONCLUSIONS: Our hypothesis-free approach is able to identify candidates for audit and review in clinical practice. To illustrate this, we provide 2 examples of 2 very unusual antipsychotics used disproportionately in 2 small geographic areas of England

Data-Driven Identification of Unusual Prescribing Behavior: Analysis and Use of an Interactive Data Tool Using 6 Months of Primary Care Data From 6500 Practices in England.

BACKGROUND: Approaches to addressing unwarranted variation in health care service delivery have traditionally relied on the prospective identification of activities and outcomes, based on a hypothesis, with subsequent reporting against defined measures. Practice-level prescribing data in England are made publicly available by the National Health Service (NHS) Business Services Authority for all general practices. There is an opportunity to adopt a more data-driven approach to capture variability and identify outliers by applying hypothesis-free, data-driven algorithms to national data sets. OBJECTIVE: This study aimed to develop and apply a hypothesis-free algorithm to identify unusual prescribing behavior in primary care data at multiple administrative levels in the NHS in England and to visualize these results using organization-specific interactive dashboards, thereby demonstrating proof of concept for prioritization approaches. METHODS: Here we report a new data-driven approach to quantify how "unusual" the prescribing rates of a particular chemical within an organization are as compared to peer organizations, over a period of 6 months (June-December 2021). This is followed by a ranking to identify which chemicals are the most notable outliers in each organization. These outlying chemicals are calculated for all practices, primary care networks, clinical commissioning groups, and sustainability and transformation partnerships in England. Our results are presented via organization-specific interactive dashboards, the iterative development of which has been informed by user feedback. RESULTS: We developed interactive dashboards for every practice (n=6476) in England, highlighting the unusual prescribing of 2369 chemicals (dashboards are also provided for 42 sustainability and transformation partnerships, 106 clinical commissioning groups, and 1257 primary care networks). User feedback and internal review of case studies demonstrate that our methodology identifies prescribing behavior that sometimes warrants further investigation or is a known issue. CONCLUSIONS: Data-driven approaches have the potential to overcome existing biases with regard to the planning and execution of audits, interventions, and policy making within NHS organizations, potentially revealing new targets for improved health care service delivery. We present our dashboards as a proof of concept for generating candidate lists to aid expert users in their interpretation of prescribing data and prioritize further investigations and qualitative research in terms of potential targets for improved performance

The impact of lidocaine plaster prescribing reduction strategies: A comparison of two national health services in Europe

AIMS: In 2017, two distinct interventions were implemented in Ireland and England to reduce prescribing of lidocaine medicated plasters. In Ireland, restrictions on reimbursement were introduced through implementation of an application system for reimbursement. In England, updated guidance on items which should not be routinely prescribed in primary care, including lidocaine plasters, was published. This study aims to compare how the interventions impacted prescribing of lidocaine plasters in these countries. METHODS: We conducted an interrupted time-series study using general practice data. For Ireland, monthly dispensing data (2015-2019) from the means-tested General Medical Services (GMS) scheme was used. For England, data covered all patients. Outcomes were the rate of dispensings, quantity and costs of lidocaine plasters, and we modelled level and trend changes from the first full month of the policy/guidance change. RESULTS: Ireland had higher rates of lidocaine dispensings compared to England throughout the study period; this was 15.22/1000 population immediately pre-intervention, and there was equivalent to a 97.2% immediate reduction following the intervention. In England, the immediate pre-intervention dispensing rate was 0.36/1000, with an immediate reduction of 0.0251/1000 (a 5.8% decrease), followed by a small but significant decrease in the monthly trend relative to the pre-intervention trend of 0.0057 per month. CONCLUSIONS: Among two different interventions aiming to decrease low-value lidocaine plaster prescribing, there was a substantially larger impact in Ireland of reimbursement restriction compared to issuing guidance in England. However, this is in the context of much higher baseline rates of use in Ireland compared to England

Impact of COVID-19 on broad-spectrum antibiotic prescribing for common infections in primary care in England: a time-series analyses using OpenSAFELY and effects of predictors including deprivation.

BACKGROUND: The COVID-19 pandemic impacted the healthcare systems, adding extra pressure to reduce antimicrobial resistance. Therefore, we aimed to evaluate changes in antibiotic prescription patterns after COVID-19 started. METHODS: With the approval of NHS England, we used the OpenSAFELY platform to access the TPP SystmOne electronic health record (EHR) system in primary care and selected patients prescribed antibiotics from 2019 to 2021. To evaluate the impact of COVID-19 on broad-spectrum antibiotic prescribing, we evaluated prescribing rates and its predictors and used interrupted time series analysis by fitting binomial logistic regression models. FINDINGS: Over 32 million antibiotic prescriptions were extracted over the study period; 8.7% were broad-spectrum. The study showed increases in broad-spectrum antibiotic prescribing (odds ratio [OR] 1.37; 95% confidence interval [CI] 1.36-1.38) as an immediate impact of the pandemic, followed by a gradual recovery with a 1.1-1.2% decrease in odds of broad-spectrum prescription per month. The same pattern was found within subgroups defined by age, sex, region, ethnicity, and socioeconomic deprivation quintiles. More deprived patients were more likely to receive broad-spectrum antibiotics, which differences remained stable over time. The most significant increase in broad-spectrum prescribing was observed for lower respiratory tract infection (OR 2.33; 95% CI 2.1-2.50) and otitis media (OR 1.96; 95% CI 1.80-2.13). INTERPRETATION: An immediate reduction in antibiotic prescribing and an increase in the proportion of broad-spectrum antibiotic prescribing in primary care was observed. The trends recovered to pre-pandemic levels, but the consequence of the COVID-19 pandemic on AMR needs further investigation. FUNDING: This work was supported by Health Data Research UK and by National Institute for Health Research

The impact of COVID-19 on antibiotic prescribing in primary care in England: Evaluation and risk prediction of appropriateness of type and repeat prescribing.

BACKGROUND: This study aimed to predict risks of potentially inappropriate antibiotic type and repeat prescribing and assess changes during COVID-19. METHODS: With the approval of NHS England, we used OpenSAFELY platform to access the TPP SystmOne electronic health record (EHR) system and selected patients prescribed antibiotics from 2019 to 2021. Multinomial logistic regression models predicted patient's probability of receiving inappropriate antibiotic type or repeat antibiotic course for each common infection. RESULTS: The population included 9.1 million patients with 29.2 million antibiotic prescriptions. 29.1% of prescriptions were identified as repeat prescribing. Those with same day incident infection coded in the EHR had considerably lower rates of repeat prescribing (18.0%) and 8.6% had potentially inappropriate type. No major changes in the rates of repeat antibiotic prescribing during COVID-19 were found. In the 10 risk prediction models, good levels of calibration and moderate levels of discrimination were found. CONCLUSIONS: Our study found no evidence of changes in level of inappropriate or repeat antibiotic prescribing after the start of COVID-19. Repeat antibiotic prescribing was frequent and varied according to regional and patient characteristics. There is a need for treatment guidelines to be developed around antibiotic failure and clinicians provided with individualised patient information

Comparative effectiveness of BNT162b2 versus mRNA-1273 covid-19 vaccine boosting in England: matched cohort study in OpenSAFELY-TPP.

OBJECTIVE: To compare the effectiveness of the BNT162b2 mRNA (Pfizer-BioNTech) and mRNA-1273 (Moderna) covid-19 vaccines during the booster programme in England. DESIGN: Matched cohort study, emulating a comparative effectiveness trial. SETTING: Linked primary care, hospital, and covid-19 surveillance records available within the OpenSAFELY-TPP research platform, covering a period when the SARS-CoV-2 delta and omicron variants were dominant. PARTICIPANTS: 3 237 918 adults who received a booster dose of either vaccine between 29 October 2021 and 25 February 2022 as part of the national booster programme in England and who received a primary course of BNT162b2 or ChAdOx1. INTERVENTION: Vaccination with either BNT162b2 or mRNA-1273 as a booster vaccine dose. MAIN OUTCOME MEASURES: Recorded SARS-CoV-2 positive test, covid-19 related hospital admission, covid-19 related death, and non-covid-19 related death at 20 weeks after receipt of the booster dose. RESULTS: 1 618 959 people were matched in each vaccine group, contributing a total 64 546 391 person weeks of follow-up. The 20 week risks per 1000 for a positive SARS-CoV-2 test were 164.2 (95% confidence interval 163.3 to 165.1) for BNT162b2 and 159.9 (159.0 to 160.8) for mRNA-1273; the hazard ratio comparing mRNA-1273 with BNT162b2 was 0.95 (95% confidence interval 0.95 to 0.96). The 20 week risks per 1000 for hospital admission with covid-19 were 0.75 (0.71 to 0.79) for BNT162b2 and 0.65 (0.61 to 0.69) for mRNA-1273; the hazard ratio was 0.89 (0.82 to 0.95). Covid-19 related deaths were rare: the 20 week risks per 1000 were 0.028 (0.021 to 0.037) for BNT162b2 and 0.024 (0.018 to 0.033) for mRNA-1273; hazard ratio 0.83 (0.58 to 1.19). Comparative effectiveness was generally similar within subgroups defined by the primary course vaccine brand, age, previous SARS-CoV-2 infection, and clinical vulnerability. Relative benefit was similar when vaccines were compared separately in the delta and omicron variant eras. CONCLUSIONS: This matched observational study of adults estimated a modest benefit of booster vaccination with mRNA-1273 compared with BNT162b2 in preventing positive SARS-CoV-2 tests and hospital admission with covid-19 20 weeks after vaccination, during a period of delta followed by omicron variant dominance

Comparative effectiveness of nirmatrelvir/ritonavir versus sotrovimab and molnupiravir for preventing severe COVID-19 outcomes in non-hospitalised high-risk patients during Omicron waves: observational cohort study using the OpenSAFELY platform

Background: Timely evidence of the comparative effectiveness between COVID-19 therapies in real-world settings is needed to inform clinical care. This study aimed to compare the effectiveness of nirmatrelvir/ritonavir versus sotrovimab and molnupiravir in preventing severe COVID-19 outcomes in non-hospitalised high-risk COVID-19 adult patients during Omicron waves. Methods: With the approval of NHS England, we conducted a real-world cohort study using the OpenSAFELY-TPP platform. Patient-level primary care data were obtained from 24 million people in England and were securely linked with data on COVID-19 infection and therapeutics, hospital admission, and death, covering a period where both nirmatrelvir/ritonavir and sotrovimab were first-line treatment options in community settings (February 10, 2022–November 27, 2022). Molnupiravir (third-line option) was used as an exploratory comparator to nirmatrelvir/ritonavir, both of which were antivirals. Cox proportional hazards model stratified by area was used to compare the risk of 28-day COVID-19 related hospitalisation/death across treatment groups. Findings: A total of 9026 eligible patients treated with nirmatrelvir/ritonavir (n = 5704) and sotrovimab (n = 3322) were included in the main analysis. The mean age was 52.7 (SD = 14.9) years and 93% (8436/9026) had three or more COVID-19 vaccinations. Within 28 days after treatment initiation, 55/9026 (0.61%) COVID-19 related hospitalisations/deaths were observed (34/5704 [0.60%] treated with nirmatrelvir/ritonavir and 21/3322 [0.63%] with sotrovimab). After adjusting for demographics, high-risk cohort categories, vaccination status, calendar time, body mass index and other comorbidities, we observed no significant difference in outcome risk between nirmatrelvir/ritonavir and sotrovimab users (HR = 0.89, 95% CI: 0.48–1.63; P = 0.698). Results from propensity score weighted model also showed non-significant difference between treatment groups (HR = 0.82, 95% CI: 0.45–1.52; P = 0.535). The exploratory analysis comparing nirmatrelvir/ritonavir users with 1041 molnupiravir users (13/1041 [1.25%] COVID-19 related hospitalisations/deaths) showed an association in favour of nirmatrelvir/ritonavir (HR = 0.45, 95% CI: 0.22–0.94; P = 0.033). Interpretation: In routine care of non-hospitalised high-risk adult patients with COVID-19 in England, no substantial difference in the risk of severe COVID-19 outcomes was observed between those who received nirmatrelvir/ritonavir and sotrovimab between February and November 2022, when Omicron subvariants BA.2, BA.5, or BQ.1 were dominant. Funding: UK Research and Innovation, Wellcome Trust, UK Medical Research Council, National Institute for Health and Care Research, and Health Data Research UK

Impact of long COVID on health-related quality-of-life: an OpenSAFELY population cohort study using patient-reported outcome measures (OpenPROMPT).

BACKGROUND: Long COVID is a major problem affecting patient health, the health service, and the workforce. To optimise the design of future interventions against COVID-19, and to better plan and allocate health resources, it is critical to quantify the health and economic burden of this novel condition. We aimed to evaluate and estimate the differences in health impacts of long COVID across sociodemographic categories and quantify this in Quality-Adjusted Life-Years (QALYs), widely used measures across health systems. METHODS: With the approval of NHS England, we utilised OpenPROMPT, a UK cohort study measuring the impact of long COVID on health-related quality-of-life (HRQoL). OpenPROMPT invited responses to Patient Reported Outcome Measures (PROMs) using a smartphone application and recruited between November 2022 and October 2023. We used the validated EuroQol EQ-5D questionnaire with the UK Value Set to develop disutility scores (1-utility) for respondents with and without Long COVID using linear mixed models, and we calculated subsequent Quality-Adjusted Life-Months (QALMs) for long COVID. FINDINGS: The total OpenPROMPT cohort consisted of 7575 individuals who consented to data collection, with which we used data from 6070 participants who completed a baseline research questionnaire where 24.6% self-reported long COVID. In multivariable regressions, long COVID had a consistent impact on HRQoL, showing a higher likelihood or odds of reporting loss in quality-of-life (Odds Ratio (OR): 4.7, 95% CI: 3.72-5.93) compared with people who did not report long COVID. Reporting a disability was the largest predictor of losses of HRQoL (OR: 17.7, 95% CI: 10.37-30.33) across survey responses. Self-reported long COVID was associated with an 0.37 QALM loss. INTERPRETATION: We found substantial impacts on quality-of-life due to long COVID, representing a major burden on patients and the health service. We highlight the need for continued support and research for long COVID, as HRQoL scores compared unfavourably to patients with conditions such as multiple sclerosis, heart failure, and renal disease. FUNDING: This research was supported by the National Institute for Health and Care Research (NIHR) (OpenPROMPT: COV-LT2-0073)

HIV infection and COVID-19 death: a population-based cohort analysis of UK primary care data and linked national death registrations within the OpenSAFELY platform

BACKGROUND: Whether HIV infection is associated with risk of death due to COVID-19 is unclear. We aimed to investigate this association in a large-scale population-based study in England. METHODS: We did a retrospective cohort study. Working on behalf of NHS England, we used the OpenSAFELY platform to analyse routinely collected electronic primary care data linked to national death registrations. We included all adults (aged ≥18 years) alive and in follow-up on Feb 1, 2020, and with at least 1 year of continuous registration with a general practitioner before this date. People with a primary care record for HIV infection were compared with people without HIV. The outcome was COVID-19 death, defined as the presence of International Classification of Diseases 10 codes U07.1 or U07.2 anywhere on the death certificate. Cox regression models were used to estimate the association between HIV infection and COVID-19 death; they were initially adjusted for age and sex, then we added adjustment for index of multiple deprivation and ethnicity, and then for a broad range of comorbidities. Interaction terms were added to assess effect modification by age, sex, ethnicity, comorbidities, and calendar time. RESULTS: 17 282 905 adults were included, of whom 27 480 (0·16%) had HIV recorded. People living with HIV were more likely to be male, of Black ethnicity, and from a more deprived geographical area than the general population. 14 882 COVID-19 deaths occurred during the study period, with 25 among people with HIV. People living with HIV had higher risk of COVID-19 death than those without HIV after adjusting for age and sex: hazard ratio (HR) 2·90 (95% CI 1·96-4·30; p<0·0001). The association was attenuated, but risk remained high, after adjustment for deprivation, ethnicity, smoking and obesity: adjusted HR 2·59 (95% CI 1·74-3·84; p<0·0001). There was some evidence that the association was larger among people of Black ethnicity: HR 4·31 (95% CI 2·42-7·65) versus 1·84 (1·03-3·26) in non-Black individuals (p-interaction=0·044). INTERPRETATION: People with HIV in the UK seem to be at increased risk of COVID-19 mortality. Targeted policies should be considered to address this raised risk as the pandemic response evolves. FUNDING: Wellcome, Royal Society, National Institute for Health Research, National Institute for Health Research Oxford Biomedical Research Centre, UK Medical Research Council, Health Data Research UK

OpenSAFELY NHS Service Restoration Observatory 2: changes in primary care clinical activity in England during the COVID-19 pandemic

BACKGROUND: The COVID-19 pandemic has disrupted healthcare activity across a broad range of clinical services. The NHS stopped non-urgent work in March 2020, later recommending services be restored to near-normal levels before winter where possible. AIM: To describe changes in the volume and variation of coded clinical activity in general practice across six clinical areas: cardiovascular disease, diabetes, mental health, female and reproductive health, screening and related procedures, and processes related to medication. DESIGN AND SETTING: With the approval of NHS England, a cohort study was conducted of 23.8 million patient records in general practice, in situ using OpenSAFELY. METHOD: Common primary care activities were analysed using Clinical Terms Version 3 codes and keyword searches from January 2019 to December 2020, presenting median and deciles of code usage across practices per month. RESULTS: Substantial and widespread changes in clinical activity in primary care were identified since the onset of the COVID-19 pandemic, with generally good recovery by December 2020. A few exceptions showed poor recovery and warrant further investigation, such as mental health (for example, for 'Depression interim review' the median occurrences across practices in December 2020 was down by 41.6% compared with December 2019). CONCLUSION: Granular NHS general practice data at population-scale can be used to monitor disruptions to healthcare services and guide the development of mitigation strategies. The authors are now developing real-time monitoring dashboards for the key measures identified in this study, as well as further studies using primary care data to monitor and mitigate the indirect health impacts of COVID-19 on the NHS