Identification of acute myocardial infarction from electronic healthcare records using different disease coding systems

Objective: To evaluate positive predictive value (PPV) of different disease codes and free text in identifying acute myocardial infarction (AMI) from electronic healthcare records (EHRs). Design: Validation study of cases of AMI identified from general practitioner records and hospital discharge diagnoses using free text and codes from the International Classification of Primary Care (ICPC), International Classification of Diseases 9th revision-clinical modification (ICD9-CM) and ICD-10th revision (ICD-10). Setting: Population-based databases comprising routinely collected data from primary care in Italy and the Netherlands and from secondary care in Denmark from 1996 to 2009. Participants: A total of 4 034 232 individuals with 22 428 883 person-years of follow-up contributed to the data, from which 42 774 potential AMI cases were identified. A random sample of 800 cases was subsequently obtained for validation. Main outcome measures: PPVs were calculated overall and for each code/free text. 'Best-case scenario' and 'worst-case scenario' PPVs were calculated, the latter taking into account non-retrievable/non-assessable cases. We further assessed the effects of AMI misclassification on estimates of risk during drug exposure. Results: Records of 748 cases (93.5% of sample) were retrieved. ICD-10 codes had a 'best-case scenario' PPV of 100% while ICD9-CM codes had a PPV of 96.6% (95% CI 93.2% to 99.9%). ICPC codes had a 'best-case scenario' PPV of 75% (95% CI 67.4% to 82.6%) and free text had PPV ranging from 20% to 60%. Corresponding PPVs in the 'worst-case scenario' all decreased. Use of codes with lower PPV generally resulted in small changes in AMI risk during drug exposure, but codes with higher PPV resulted in attenuation of risk for positive associations. Conclusions: ICD9-CM and ICD-10 codes have good PPV in identifying AMI from EHRs; strategies are necessary to further optimise utility of ICPC codes and free-text search. Use of specific AMI disease codes in estimation of risk during drug exposure may lead to small but significant changes and at the expense of decreased precision

Non-standard errors

In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence generating process (EGP). We claim that EGP variation across researchers adds uncertainty: Non-standard errors (NSEs). We study NSEs by letting 164 teams test the same hypotheses on the same data. NSEs turn out to be sizable, but smaller for better reproducible or higher rated research. Adding peer-review stages reduces NSEs. We further find that this type of uncertainty is underestimated by participants

Validity of the coding for intensive care admission, mechanical ventilation, and acute dialysis in the Danish National Patient Registry: a short report

Linea Blichert-Hansen, Malene S Nielsson, Rikke B Nielsen, Christian F Christiansen, Mette NørgaardDepartment of Clinical Epidemiology, Aarhus University Hospital, DenmarkBackground: Large health care databases provide a cost-effective data source for observational research in the intensive care unit (ICU) if the coding is valid. The aim of this study was to investigate the accuracy of the recorded coding of ICU admission, mechanical ventilation, and acute dialysis in the population-based Danish National Patient Registry (DNPR).Methods: We conducted the study in the North Denmark Region, including seven ICUs. From the DNPR we selected a total of 150 patients with an ICU admission by the following criteria: (1) 50 patients randomly selected among all patients registered with an ICU admission code, (2) 50 patients with an ICU admission code and a concomitant code for mechanical ventilation, and (3) 50 patients with an ICU admission code and a concomitant code for acute dialysis. Using the medical records as gold standard we estimated the positive predictive value (PPV) for each of the three procedure codes.Results: We located 147 (98%) of the 150 medical records. Of these 147 patients, 141 (95.9%; 95% confidence interval [CI]: 91.8–98.3) had a confirmed ICU admission according to their medical records. Among patients, who were selected only on the coding for ICU admission, the PPV for ICU admission was 87.2% (95% CI: 75.6–94.5). For the mechanical ventilation code, the PPV was 100% (95% CI: 95.1–100). Forty-nine of 50 patients with the coding for acute dialysis received this treatment, corresponding to a PPV of 98.0% (95% CI: 91.0–99.8).Conclusion: We found a high PPV for the coding of ICU admission and even higher PPVs for mechanical ventilation, and acute dialysis in the DNPR. The DNPR is a valuable data source for observational studies of ICU patients.Keywords: critical care, epidemiology, intensive care unit, positive predictive values, validit

Positive predictive values of the coding for bisphosphonate therapy among cancer patients in the Danish National Patient Registry

Malene Schou Nielsson,1 Rune Erichsen,1 Trine Frøslev,1 Aliki Taylor,2 John Acquavella,2 Vera Ehrenstein11Department of Clinical Epidemiology, Aarhus University Hospital, Aarhus, Denmark; 2Center for Observational Research International, Amgen Ltd Thousand Oaks, CA, USA Background: The purpose of this study was to estimate the positive predictive value (PPV) of the coding for bisphosphonate treatment in selected cancer patients from the Danish National Patient Registry (DNPR).Methods: Through the DNPR, we identified all patients with recorded cancer of the breast, prostate, lung, kidney, and with multiple myeloma. We restricted the study sample to patients with bisphosphonate treatment recorded during an admission to Aalborg Hospital, Denmark, from 2005 through 2009. We retrieved and reviewed medical records of these patients from the initial cancer diagnosis onwards to confirm or rule out bisphosphonate therapy. We calculated the PPV of the treatment coding as the proportion of patients with confirmed bisphosphonate treatment.Results: We retrieved and reviewed the medical records of 60 cancer patients with treatment codes corresponding to bisphosphonate therapy. Recorded code corresponded to treatment administered intravenously for 59 of 60 patients, corresponding to a PPV of 98.3% (95% confidence interval 92.5–99.8). In the remaining patient, bisphosphonate treatment was also confirmed but was an orally administered bisphosphonate; thus, the treatment for any bisphosphonate regardless of administration was confirmed for all 60 patients (PPV of 100%, 95% confidence interval 95.9–100.0).Conclusion: The PPV of bisphosphonate treatment coding among cancer patients in the DNPR is very high and the recorded treatment nearly always corresponds to intravenous administration.Keywords: bisphosphonate, neoplasm metastases, predictive value of tests, validation studie

Identification of acute myocardial infarction from electronic healthcare records using different disease coding systems: a validation study in three European countries

Objective: To evaluate positive predictive value (PPV) of different disease codes and free text in identifying acute myocardial infarction (AMI) from electronic healthcare records (EHRs). Design: Validation study of cases of AMI identified from general practitioner records and hospital discharge diagnoses using free text and codes from the International Classification of Primary Care (ICPC), International Classification of Diseases 9th revision-clinical modification (ICD9-CM) and ICD-10th revision (ICD-10). Setting: Population-based databases comprising routinely collected data from primary care in Italy and the Netherlands and from secondary care in Denmark from 1996 to 2009. Participants: A total of 4 034 232 individuals with 22 428 883 person-years of follow-up contributed to the data, from which 42 774 potential AMI cases were identified. A random sample of 800 cases was subsequently obtained for validation. Main outcome measures: PPVs were calculated overall and for each code/free text. `Best-case scenario' and `worst-case scenario' PPVs were calculated, the latter taking into account non-retrievable/non-assessable cases. We further assessed the effects of AMI misclassification on estimates of risk during drug exposure. Results: Records of 748 cases (93.5% of sample) were retrieved. ICD-10 codes had a `best-case scenario' PPV of 100% while ICD9-CM codes had a PPV of 96.6% (95% CI 93.2% to 99.9%). ICPC codes had a `best-case scenario' PPV of 75% (95% CI 67.4% to 82.6%) and free text had PPV ranging from 20% to 60%. Corresponding PPVs in the `worst-case scenario' all decreased. Use of codes with lower PPV generally resulted in small changes in AMI risk during drug exposure, but codes with higher PPV resulted in a Conclusions: ICD9-CM and ICD-10 codes have good PPV in identifying AMI from EHRs; strategies are necessary to further optimise utility of ICPC codes and free-text search. Use of specific AMI disease codes in estimation of risk during drug exposure may lead to small but significant changes and at the expense of decreased precision

Validation study in four health-care databases: upper gastrointestinal bleeding misclassification affects precision but not magnitude of drug-related upper gastrointestinal bleeding risk

Objective: To evaluate the accuracy of disease codes and free text in identifying upper gastrointestinal bleeding (UGIB) from electronic health-care records (EHRs). Study Design and Setting: We conducted a validation study in four European electronic health-care record (EHR) databases such as Integrated Primary Care Information (IPCI), Health Search/CSD Patient Database (HSD), ARS, and Aarhus, in which we identified UGIB cases using free text or disease codes: (1) International Classification of Disease (ICD)-9 (HSD, ARS); (2) ICD-10 (Aarhus); and (3) International Classification of Primary Care (ICPC) (IPCI). From each database, we randomly selected and manually reviewed 200 cases to calculate positive predictive values (PPVs). We employed different case definitions to assess the effect of outcome misclassification on estimation of risk of drug-related UGIB. Results: PPV was 22% [95% confidence interval (CI): 16, 28] and 21% (95% CI: 16, 28) in IPCI for free text and ICPC codes, respectively. PPV was 91% (95% CI: 86, 95) for ICD-9 codes and 47% (95% CI: 35, 59) for free text in HSD. PPV for ICD-9 codes in ARS was 72% (95% CI: 65, 78) and 77% (95% CI: 69, 83) for ICD-10 codes (Aarhus). More specific definitions did not have significant impact on risk estimation of drug-related UGIB, except for wider CIs. Conclusions: ICD-9-CM and ICD-10 disease codes have good PPV in identifying UGIB from EHR; less granular terminology (ICPC) may require additional strategies. Use of more specific UGIB definitions affects precision, but not magnitude, of risk estimates. (C) 2014 Elsevier Inc. All rights reserved