Feasibility and reliability of PRISMA-Medical for specialty-based incident analysis

Aims and objectives: In this study, the feasibility and reliability of the Prevention Recovery Information System for Monitoring and Analysis (PRISMA)-Medical method for systematic, specialty-based analysis and classification of incidents in the neonatal intensive care unit (NICU) were determined. Methods: After the introduction of a Neonatology System for Analysis and Feedback on Medical Events (NEOSAFE) in eight tertiary care NICUs and one paediatric surgical ICU, PRISMA-Medical was started to be used to identify root causes of voluntary reported incidents by multidisciplinary unit patient safety committees. Committee members were PRISMA-trained and familiar with the department and its processes. In this study, the results of PRISMA-analysis of incidents reported during the first year are described. At t¿=¿3 months and t¿=¿12 months after introduction, test cases were performed to measure agreement at three levels of root cause classification using PRISMA-Medical. Inter-rater reliability was determined by calculating generalised ¿ values for each level of classification. Results: During the study period, 981 out of 1786 eligible incidents (55%) were analysed for underlying root causes. In total, 2313 root causes were identified and classified, giving an average of 2.4 root causes for every incident. Although substantial agreement (¿ 0.70–0.81) was reached at the main level of root cause classification of the test cases (discrimination between technical, organisational and human failure) and agreement among the committees at the second level (discrimination between skill-based, rule-based and knowledge-based errors) was acceptable (¿ 0.53–0.59), discrimination between rule-based errors (the third level of classification) was more difficult to assess (¿ 0.40–0.47). Conclusion: With some restraints, PRISMA-Medical proves to be both feasible and acceptably reliable to identify and classify multiple causes of medical events in the NICU

Specialty-based, voluntary incident reporting in neonatal intensive care: description of 4846 incident reports

OBJECTIVES: To examine the characteristics of incidents reported after introduction of a voluntary, non-punitive incident reporting system for neonatal intensive care units (NICUs) in the Netherlands; and to investigate which types of reported incident pose the highest risk to patients in the NICU. DESIGN: Prospective multicentre survey. METHODS: Voluntary, non-punitive incident reporting was introduced in eight level III NICUs and one paediatric surgical ICU. An incident was defined as any unintended event which (could have) reduced the safety margin for the patient. Multidisciplinary, unit-based patient safety committees systematically collected and analysed incident reports, and assigned risk scores to each reported incident. Data were centrally collected for specialty-based analysis. This paper describes the characteristics of incidents reported during the first year. Bivariate logistic regression analysis was conducted to identify high-risk incident categories. RESULTS: There were 5225 incident reports on 3859 admissions, of which 4846 were eligible for analysis. Incidents with medication were most frequently reported (27%), followed by laboratory (10%) and enteral nutrition (8%). Severe harm was described in seven incident reports, and moderate harm in 63 incident reports. Incidents involving mechanical ventilation and blood products were most likely to be assigned high-risk scores, followed by those involving parenteral nutrition, intravascular lines and medication dosing errors. CONCLUSIONS: Incidents occur much more frequently in Dutch NICUs than has been previously observed, and their impact on patient morbidity is considerable. Reported incidents concerning mechanical ventilation, blood products, intravascular lines, parenteral nutrition and medication dosing errors pose the highest risk to patients in the NIC

Which aspects of safety culture predict incident reporting behavior in neonatal intensive care units? A multilevel analysis

OBJECTIVES: Safety culture assessments are increasingly used to evaluate patient-safety programs. However, it is not clear which aspects of safety culture are most relevant in understanding incident reporting behavior, and ultimately improving patient safety. The objective of this study was to examine which aspects of safety culture predict incident reporting behavior in the neonatal intensive care unit (NICU), before and after implementation of a voluntary, nonpunitive incident reporting system. DESIGN: Survey study based on a translated, validated version of the Agency for Healthcare Research and Quality Hospital Survey on Patient Safety Culture. This survey incorporates two outcome measures, 11 dimensions of patient-safety culture as well as demographic data. SETTING: Eight tertiary care NICUs and one surgical pediatric ICU. SUBJECTS: All unit personnel. INTERVENTION: Implementation of a specialty-based, voluntary, nonpunitive incident reporting system. MEASUREMENTS AND MAIN RESULTS: The survey was conducted before (t = 0) and after (t = 1 yr) the intervention. Primary outcome: number of self-reported incidents in the past 12 months. Overall response rate was 80% (n = 700) at t = 0 and 76% (n = 670) at t = 1 yr. Based on a multivariate multilevel regression prediction model, the number of self-reported incidents increased after the intervention and was positively associated with a nonpunitive response to error and negatively associated with overall perceptions of safety and hospital management support for patient safety. CONCLUSIONS: A nonpunitive approach to error, hospital management support for patient safety, and overall perceptions of safety predict incident reporting behavior in the NICU. The relation between these aspects of safety culture and patient outcome requires further scrutiny and therefore remains an important issue to address in future researc