Inter-rater reliability of data elements from a prototype of the Paul Coverdell National Acute Stroke Registry

<p>Abstract</p> <p>Background</p> <p>The Paul Coverdell National Acute Stroke Registry (PCNASR) is a U.S. based national registry designed to monitor and improve the quality of acute stroke care delivered by hospitals. The registry monitors care through specific performance measures, the accuracy of which depends in part on the reliability of the individual data elements used to construct them. This study describes the inter-rater reliability of data elements collected in Michigan's state-based prototype of the PCNASR.</p> <p>Methods</p> <p>Over a 6-month period, 15 hospitals participating in the Michigan PCNASR prototype submitted data on 2566 acute stroke admissions. Trained hospital staff prospectively identified acute stroke admissions, abstracted chart information, and submitted data to the registry. At each hospital 8 randomly selected cases were re-abstracted by an experienced research nurse. Inter-rater reliability was estimated by the kappa statistic for nominal variables, and intraclass correlation coefficient (ICC) for ordinal and continuous variables. Factors that can negatively impact the kappa statistic (i.e., trait prevalence and rater bias) were also evaluated.</p> <p>Results</p> <p>A total of 104 charts were available for re-abstraction. Excellent reliability (kappa or ICC > 0.75) was observed for many registry variables including age, gender, black race, hemorrhagic stroke, discharge medications, and modified Rankin Score. Agreement was at least moderate (i.e., 0.75 > kappa ≥; 0.40) for ischemic stroke, TIA, white race, non-ambulance arrival, hospital transfer and direct admit. However, several variables had poor reliability (kappa < 0.40) including stroke onset time, stroke team consultation, time of initial brain imaging, and discharge destination. There were marked systematic differences between hospital abstractors and the audit abstractor (i.e., rater bias) for many of the data elements recorded in the emergency department.</p> <p>Conclusion</p> <p>The excellent reliability of many of the data elements supports the use of the PCNASR to monitor and improve care. However, the poor reliability for several variables, particularly time-related events in the emergency department, indicates the need for concerted efforts to improve the quality of data collection. Specific recommendations include improvements to data definitions, abstractor training, and the development of ED-based real-time data collection systems.</p

Implementation of a population-based epidemiological rare disease registry: study protocol of the amyotrophic lateral sclerosis (ALS) - registry Swabia

BACKGROUND: The social and medical impact of rare diseases is increasingly recognized. Amyotrophic lateral sclerosis (ALS) is the most prevalent of the motor neuron diseases. It is characterized by rapidly progressive damage to the motor neurons with a survival of 2–5 years for the majority of patients. The objective of this work is to describe the study protocol and the implementation steps of the amyotrophic lateral sclerosis (ALS) registry Swabia, located in the South of Germany. METHODS/DESIGN: The ALS registry Swabia started in October 2010 with both, the retrospective (01.10.2008-30.09.2010) and prospective (from 01.10.2010) collection of ALS cases, in a target population of 8.6 million persons in Southern Germany. In addition, a population based case–control study was implemented based on the registry that also included the collection of various biological materials. Retrospectively, 420 patients (222 men and 198 women) were identified. Prospectively data of ALS patients were collected, of which about 70% agreed to participate in the population-based case–control study. All participants in the case–control study provided also a blood sample. The prospective part of the study is ongoing. DISCUSSION: The ALS registry Swabia has been implemented successfully. In rare diseases such as ALS, the collaboration of registries, the comparison with external samples and biorepositories will facilitate to identify risk factors and to further explore the potential underlying pathophysiological mechanisms

Comparison of hernia registries: the CORE project

INTRODUCTION: The aim of the international CORE project was to explore the databases of the existing hernia registries and compare them in content and outcome variables. METHODS: The CORE project was initiated with representatives from all established hernia registries (Danish Hernia Database, Swedish Hernia Registry, Herniamed, EuraHS, Club Hernie, EVEREG, AHSQC) in March 2015 in Berlin. The following categories were used to compare the registries: initiation and funding, data collection and use for certification of hernia centers, patient data and data protection, operative data, registration of complications and follow-up data. RESULTS: The Danish Hernia Database is the only one to qualify as a genuine national registry where participation is compulsory for entry of all procedures by all surgeons performing a hernia operation. All other registries have to be considered as voluntary and completeness of data depends upon the participating hospitals and surgeons. Only the Danish Hernia Database and the Swedish Hernia Registry are publicly funded. All other registries are reliant on financial support from the medical technology industry. As an incentive for voluntary participation in a hernia registry, hospitals or surgeons are issued a certificate confirming that they are taking part in a quality assurance study for hernia surgery. Due to data protection and privacy regulations, most registries are obliged or have chosen to enter their patient data anonymously or coded. The Danish Hernia Database and Swedish Hernia Registry utilize a national personal patient code. In the Herniamed Registry, patient data are saved in a coded and anonymous format after obtaining the patient's informed consent. CONCLUSION: Despite the differences in the way data are collected for each of the listed hernia registries, the data are indispensable in clinical research