The use and predictive performance of the Peninsula Health Falls Risk Assessment Tool (PH-FRAT) in 25 residential aged care facilities : a retrospective cohort study using routinely collected data

Background: The Peninsula Health Falls Risk Assessment Tool (PH-FRAT) is a validated and widely applied tool in residential aged care facilities (RACFs) in Australia. However, research regarding its use and predictive performance is limited. This study aimed to determine the use and performance of PH-FRAT in predicting falls in RACF residents. Methods: A retrospective cohort study using routinely-collected data from 25 RACFs in metropolitan Sydney, Australia from Jul 2014-Dec 2019. A total of 5888 residents aged ≥65 years who were assessed at least once using the PH-FRAT were included in the study. The PH-FRAT risk score ranges from 5 to 20 with a score > 14 indicating fallers and ≤ 14 non-fallers. The predictive performance of PH-FRAT was determined using metrics including area under receiver operating characteristics curve (AUROC), sensitivity, specificity, sensitivityEvent Rate(ER) and specificityER. Results: A total of 27,696 falls were reported over 3,689,561 resident days (a crude incident rate of 7.5 falls /1000 resident days). A total of 38,931 PH-FRAT assessments were conducted with a median of 4 assessments per resident, a median of 43.8 days between assessments, and an overall median fall risk score of 14. Residents with multiple assessments had increased risk scores over time. The baseline PH-FRAT demonstrated a low AUROC of 0.57, sensitivity of 26.0% (sensitivityER 33.6%) and specificity of 88.8% (specificityER 82.0%). The follow-up PH-FRAT assessments increased sensitivityER values although the specificityER decreased. The performance of PH-FRAT improved using a lower risk score cut-off of 10 with AUROC of 0.61, sensitivity of 67.5% (sensitivityER 74.4%) and specificity of 55.2% (specificityER 45.6%). Conclusions: Although PH-FRAT is frequently used in RACFs, it demonstrated poor predictive performance raising concerns about its value. Introducing a lower PH-FRAT cut-off score of 10 marginally enhanced its predictive performance. Future research should focus on understanding the feasibility and accuracy of dynamic fall risk predictive tools, which may serve to better identify residents at risk of falls

Evaluation of the accuracy of diagnostic coding for influenza compared to laboratory results: the availability of test results before hospital discharge facilitates improved coding accuracy

Background: Assessing the accuracy of diagnostic coding is essential to ensure the validity and reliability of administrative coded data. The aim of the study was to evaluate the accuracy of assigned International Classification of Diseases version 10-Australian Modification (ICD-10-AM) codes for influenza by comparing with patients’ results of their polymerase chain reaction (PCR)-based laboratory tests. Method: A retrospective study was conducted across seven public hospitals in New South Wales, Australia. A total of 16,439 patients who were admitted and tested by either cartridge-based rapid PCR or batched multiplex PCR between January 2016 and December 2017 met the inclusion criteria. We calculated the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of ICD-10-AM coding using laboratory results as a gold standard. Separate analyses were conducted to determine whether the availability of test results at the time of hospital discharge influenced diagnostic coding accuracy. Results: Laboratory results revealed 2759 positive influenza cases, while ICD-10-AM coding identified 2527 patients. Overall, 13.7% (n = 378) of test positive patients were not assigned an ICD-10-AM code for influenza. A further 5.8% (n = 146) patients with negative test results were incorrectly assigned an ICD-10-AM code for influenza. The sensitivity, specificity, PPV and NPV of ICD-10-AM coding were 93.1%; 98.9%; 94.5% and 98.6% respectively when test results were received before discharge and 32.7%; 99.2%; 87.8% and 89.8% respectively when test results were not available at discharge. The sensitivity of ICD-10-AM coding varied significantly across hospitals. The use of rapid PCR or hospitalisation during the influenza season were associated with greater coding accuracy. Conclusion: Although ICD-10-AM coding for influenza demonstrated high accuracy when laboratory results were received before discharge, its sensitivity was substantially lower for patients whose test results were not available at discharge. The timely availability of laboratory test results during the episode of care could contribute to improved coding accuracy.The study was part of a partnership project funded by a National Health and Medical Research Council of Australia Partnership Project Grant (grant number, APP1111925), in partnership with NSW Health Pathology and the Australian Commission on Safety and Quality in Healthcar

The use of predictive fall models for older adults receiving aged care, using routinely collected electronic health record data : a systematic review

Background: Falls in older adults remain a pressing health concern. With advancements in data analytics and increasing uptake of electronic health records, developing comprehensive predictive models for fall risk is now possible. We aimed to systematically identify studies involving the development and implementation of predictive falls models which used routinely collected electronic health record data in home-based, community and residential aged care settings. Methods: A systematic search of entries in Cochrane Library, CINAHL, MEDLINE, Scopus, and Web of Science was conducted in July 2020 using search terms relevant to aged care, prediction, and falls. Selection criteria included English-language studies, published in peer-reviewed journals, had an outcome of falls, and involved fall risk modelling using routinely collected electronic health record data. Screening, data extraction and quality appraisal using the Critical Appraisal Skills Program for Clinical Prediction Rule Studies were conducted. Study content was synthesised and reported narratively. Results: From 7,329 unique entries, four relevant studies were identified. All predictive models were built using different statistical techniques. Predictors across seven categories were used: demographics, assessments of care, fall history, medication use, health conditions, physical abilities, and environmental factors. Only one of the four studies had been validated externally. Three studies reported on the performance of the models. Conclusions: Adopting predictive modelling in aged care services for adverse events, such as falls, is in its infancy. The increased availability of electronic health record data and the potential of predictive modelling to document fall risk and inform appropriate interventions is making use of such models achievable. Having a dynamic prediction model that reflects the changing status of an aged care client is key to this moving forward for fall prevention interventions

Diagnostic Informatics—The Role of Digital Health in Diagnostic Stewardship and the Achievement of Excellence, Safety, and Value

Diagnostic investigations (pathology laboratory and medical imaging) aim to: increase certainty of the presence or absence of disease by supporting the process of differential diagnosis; support clinical management; and monitor a patient's trajectory (e. g., disease progression or response to treatment). Digital health can be defined as the collection, storage, retrieval, transmission, and utilization of data, information, and knowledge to support healthcare. Digital health has become an essential component of the diagnostic process, helping to facilitate the accuracy and timeliness of information transfer and enhance the effectiveness of decision-making processes. Digital health is also important to diagnostic stewardship, which involves coordinated guidance and interventions to ensure the appropriate utilization of diagnostic tests for therapeutic decision-making. Diagnostic stewardship and informatics are thus important in efforts to establish shared decision-making. This is because they contribute to the establishment of shared information platforms (enabling patients to read, comment on, and share in decisions about their care) based on timely and meaningful communication. This paper will outline key diagnostic informatics and stewardship initiatives across three interrelated fields: (1) diagnostic error and the establishment of outcomes-based diagnostic research; (2) the safety and effectiveness of test result management and follow-up; and (3) digitally enhanced decision support systems

Delivering safe and effective test-result communication, management and follow-up : a mixed-methods study protocol

Introduction: The failure to follow-up pathology and medical imaging test results poses patient-safety risks which threaten the effectiveness, quality and safety of patient care. The objective of this project is to: (1) improve the effectiveness and safety of test-result management through the establishment of clear governance processes of communication, responsibility and accountability; (2) harness health information technology (IT) to inform and monitor test-result management; (3) enhance the contribution of consumers to the establishment of safe and effective test-result management systems. Methods and analysis: This convergent mixed-methods project triangulates three multistage studies at seven adult hospitals and one paediatric hospital in Australia. Study 1 adopts qualitative research approaches including semistructured interviews, focus groups and ethnographic observations to gain a better understanding of test-result communication and management practices in hospitals, and to identify patient-safety risks which require quality-improvement interventions. Study 2 analyses linked sets of routinely collected healthcare data to examine critical test-result thresholds and test-result notification processes. A controlled before-and-after study across three emergency departments will measure the impact of interventions (including the use of IT) developed to improve the safety and quality of test-result communication and management processes. Study 3 adopts a consumer-driven approach, including semistructured interviews, and the convening of consumer-reference groups and community forums. The qualitative data will identify mechanisms to enhance the role of consumers in test-management governance processes, and inform the direction of the research and the interpretation of findings. Ethics and dissemination: Ethical approval has been granted by the South Eastern Sydney Local Health District Human Research Ethics Committee and Macquarie University. Findings will be disseminated in academic, industry and consumer journals, newsletters and conferences

Personal non-commercial use only

ABSTRACT. Objective. To investigate the association between adherence to treat-to-target (T2T) protocol and disease activity, functional outcomes, and radiographic outcomes in early rheumatoid arthritis (RA). Methods. Data from a longitudinal cohort of patients with early RA were used. Adherence was determined at each followup visit over 3 years according to predefined criteria. The primary endpoint was remission according to Disease Activity Score in 28 joints (DAS28) and Simplified Disease Activity Index (SDAI) criteria. Functional and radiographic outcomes measured by modified Health Assessment Questionnaire and modified total Sharp score, respectively, were secondary endpoints. Results. A total of 198 patients with 3078 clinic visits over 3 years were included in this analysis. After adjusting for relevant variables, although there was no significant association between adherence to T2T and remission rate after 1 year, the associations reached significance after 3 years for both DAS28 (OR 1.71, 95% CI 1.16-2.50; p = 0.006) and SDAI criteria (OR 1.94, 95% CI 1.06-3.56; p = 0.033). After 3 years, adherence was also associated with improvement in physical function (β = 0.12, 95% CI 0.06-0.18; p < 0.0001). None of the radiographic outcomes were associated with adherence after either 1 or 3 years, although there was a trend for higher adherence to be associated with less radiographic progression at the end of the study (p = 0.061). Conclusion. Increased adherence to T2T was associated with better longterm disease activity and functional outcomes, which suggests that the benefit of a T2T protocol may be enhanced by ensuring adequate adherence

Personal non-commercial use only

ABSTRACT. Objective. To investigate the association between adherence to treat-to-target (T2T) protocol and disease activity, functional outcomes, and radiographic outcomes in early rheumatoid arthritis (RA). Methods. Data from a longitudinal cohort of patients with early RA were used. Adherence was determined at each followup visit over 3 years according to predefined criteria. The primary endpoint was remission according to Disease Activity Score in 28 joints (DAS28) and Simplified Disease Activity Index (SDAI) criteria. Functional and radiographic outcomes measured by modified Health Assessment Questionnaire and modified total Sharp score, respectively, were secondary endpoints. Results. A total of 198 patients with 3078 clinic visits over 3 years were included in this analysis. After adjusting for relevant variables, although there was no significant association between adherence to T2T and remission rate after 1 year, the associations reached significance after 3 years for both DAS28 (OR 1.71, 95% CI 1.16-2.50; p = 0.006) and SDAI criteria (OR 1.94, 95% CI 1.06-3.56; p = 0.033). After 3 years, adherence was also associated with improvement in physical function (β = 0.12, 95% CI 0.06-0.18; p < 0.0001). None of the radiographic outcomes were associated with adherence after either 1 or 3 years, although there was a trend for higher adherence to be associated with less radiographic progression at the end of the study (p = 0.061). Conclusion. Increased adherence to T2T was associated with better longterm disease activity and functional outcomes, which suggests that the benefit of a T2T protocol may be enhanced by ensuring adequate adherence. (J Rheumatol First Release July 15 2016; doi:10.3899/jrheum.151392

Delivering safe and effective test-result communication, management and follow-up: A mixed-methods study protocol

IntroductionThe failure to follow-up pathology and medical imaging test results poses patient-safety risks which threaten the effectiveness, quality and safety of patient care. The objective of this project is to: (1) improve the effectiveness and safety of test-result management through the establishment of clear governance processes of communication, responsibility and accountability; (2) harness health information technology (IT) to inform and monitor test-result management; (3) enhance the contribution of consumers to the establishment of safe and effective test-result management systems.Methods and analysisThis convergent mixed-methods project triangulates three multistage studies at seven adult hospitals and one paediatric hospital in Australia.Study 1 adopts qualitative research approaches including semistructured interviews, focus groups and ethnographic observations to gain a better understanding of test-result communication and management practices in hospitals, and to identify patient-safety risks which require quality-improvement interventions.Study 2 analyses linked sets of routinely collected healthcare data to examine critical test-result thresholds and test-result notification processes. A controlled before-and-after study across three emergency departments will measure the impact of interventions (including the use of IT) developed to improve the safety and quality of test-result communication and management processes.Study 3 adopts a consumer-driven approach, including semistructured interviews, and the convening of consumer-reference groups and community forums. The qualitative data will identify mechanisms to enhance the role of consumers in test-management governance processes, and inform the direction of the research and the interpretation of findings