An increasing number of convolutional neural networks for fracture recognition and classification in orthopaedics:are these externally validated and ready for clinical application?

Aims: The number of convolutional neural networks (CNN) available for fracture detection and classification is rapidly increasing. External validation of a CNN on a temporally separate (separated by time) or geographically separate (separated by location) dataset is crucial to assess generalizability of the CNN before application to clinical practice in other institutions. We aimed to answer the following questions: are current CNNs for fracture recognition externally valid?; which methods are applied for external validation (EV)?; and, what are reported performances of the EV sets compared to the internal validation (IV) sets of these CNNs? Methods: The PubMed and Embase databases were systematically searched from January 2010 to October 2020 according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. The type of EV, characteristics of the external dataset, and diagnostic performance characteristics on the IV and EV datasets were collected and compared. Quality assessment was conducted using a seven-item checklist based on a modified Methodologic Index for NOn-Randomized Studies instrument (MINORS). Results: Out of 1,349 studies, 36 reported development of a CNN for fracture detection and/or classification. Of these, only four (11%) reported a form of EV. One study used temporal EV, one conducted both temporal and geographical EV, and two used geographical EV. When comparing the CNN’s performance on the IV set versus the EV set, the following were found: AUCs of 0.967 (IV) versus 0.975 (EV), 0.976 (IV) versus 0.985 to 0.992 (EV), 0.93 to 0.96 (IV) versus 0.80 to 0.89 (EV), and F1-scores of 0.856 to 0.863 (IV) versus 0.757 to 0.840 (EV). Conclusion: The number of externally validated CNNs in orthopaedic trauma for fracture recognition is still scarce. This greatly limits the potential for transfer of these CNNs from the developing institute to another hospital to achieve similar diagnostic performance. We recommend the use of geographical EV and statements such as the Consolidated Standards of Reporting Trials–Artificial Intelligence (CONSORT-AI), the Standard Protocol Items: Recommendations for Interventional Trials–Artificial Intelligence (SPIRIT-AI) and the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis–Machine Learning (TRIPOD-ML) to critically appraise performance of CNNs and improve methodological rigor, quality of future models, and facilitate eventual implementation in clinical practice

the European trial on Reduction of Cardiac Events with Perindopril in Stable Coronary Artery Disease Investigators. Efficacy of perindopril in reduction of cardiovascular events among patients with stable coronary artery disease: randomised, double-blind, placebo-controlled, multicentre trial (the EUROPA trial).

Background Treatment with angiotensin-converting-enzyme (ACE) inhibitors reduces the rate of cardiovascular events among patients with left-ventricular dysfunction and those at high risk of such events. We assessed whether the ACE inhibitor perindopril reduced cardiovascular risk in a low-risk population with stable coronary heart disease and no apparent heart failure. Methods We recruited patients from October, 1997, to June, 2000. 13 655 patients were registered with previous myocardial infarction (64%), angiographic evidence of coronary artery disease (61%), coronary revascularisation (55%), or a positive stress test only (5%). After a run-in period of 4 weeks, in which all patients received perindopril, 12 218 patients were randomly assigned perindopril 8 mg once daily (n=6110), or matching placebo (n=6108). The mean follow-up was 4·2 years, and the primary endpoint was cardiovascular death, myocardial infarction, or cardiac arrest. Analysis was by intention to treat. Findings Mean age of patients was 60 years (SD 9), 85% were male, 92% were taking platelet inhibitors, 62% blockers, and 58% lipid-lowering therapy. 603 (10%) placebo and 488 (8%) perindopril patients experienced the primary endpoint, which yields a 20% relative risk reduction (95% CI 9–29, p=0·0003) with perindopril. These benefits were consistent in all predefined subgroups and secondary endpoints. Perindopril was well tolerated. Interpretation Among patients with stable coronary heart disease without apparent heart failure, perindopril can significantly improve outcome. About 50 patients need to be treated for a period of 4 years to prevent one major cardiovascular event. Treatment with perindopril, on top of other preventive medications, should be considered in all patients with coronary heart disease

The European Trial On Reduction of Cardiac Events with Perindopril in Stable Coronary Artery Disease

Background Treatment with angiotensin-converting-enzyme (ACE) inhibitors reduces the rate of cardiovascular events among patients with left-ventricular dysfunction and those at high risk of such events. We assessed whether the ACE inhibitor perindopril reduced cardiovascular risk in a low-risk population with stable coronary heart disease and no apparent heart failure. Methods We recruited patients from October, 1997, to June, 2000. 13 655 patients were registered with previous myocardial infarction (64%), angiographic evidence of coronary artery disease (61%), coronary revascularisation (55%), or a positive stress test only (5%). After a run-in period of 4 weeks, in which all patients received perindopril, 12 218 patients were randomly assigned perindopril 8 mg once daily (n=6110), or matching placebo (n=6108). The mean follow-up was 4·2 years, and the primary endpoint was cardiovascular death, myocardial infarction, or cardiac arrest. Analysis was by intention to treat. Findings Mean age of patients was 60 years (SD 9), 85% were male, 92% were taking platelet inhibitors, 62% β blockers, and 58% lipid-lowering therapy. 603 (10%) placebo and 488 (8%) perindopril patients experienced the primary endpoint, which yields a 20% relative risk reduction (95% Cl 9–29, p=0·0003) with perindopril. These benefits were consistent in all predefined subgroups and secondary endpoints. Perindopril was well tolerated. Interpretation Among patients with stable coronary heart disease without apparent heart failure, perindopril can significantly improve outcome. About 50 patients need to be treated for a period of 4 years to prevent one major cardiovascular event. Treatment with perindopril, on top of other preventive medications, should be considered in all patients with coronary heart disease

Efficacy of perindopril in reduction of cardiovascular events among patients with stable coronary artery disease: randomised, double-blind, placebo-controlled, multicentre trial (the EUROPA study)

BACKGROUND: Treatment with angiotensin-converting-enzyme (ACE) inhibitors reduces the rate of cardiovascular events among patients with left-ventricular dysfunction and those at high risk of such events. We assessed whether the ACE inhibitor perindopril reduced cardiovascular risk in a low-risk population with stable coronary heart disease and no apparent heart failure. METHODS: We recruited patients from October, 1997, to June, 2000. 13655 patients were registered with previous myocardial infarction (64%), angiographic evidence of coronary artery disease (61%), coronary revascularisation (55%), or a positive stress test only (5%). After a run-in period of 4 weeks, in which all patients received perindopril, 12218 patients were randomly assigned perindopril 8 mg once daily (n=6110), or matching placebo (n=6108). The mean follow-up was 4.2 years, and the primary endpoint was cardiovascular death, myocardial infarction, or cardiac arrest. Analysis was by intention to treat. FINDINGS: Mean age of patients was 60 years (SD 9), 85% were male, 92% were taking platelet inhibitors, 62% beta blockers, and 58% lipid-lowering therapy. 603 (10%) placebo and 488 (8%) perindopril patients experienced the primary endpoint, which yields a 20% relative risk reduction (95% CI 9-29, p=0.0003) with perindopril. These benefits were consistent in all predefined subgroups and secondary endpoints. Perindopril was well tolerated. INTERPRETATION: Among patients with stable coronary heart disease without apparent heart failure, perindopril can significantly improve outcome. About 50 patients need to be treated for a period of 4 years to prevent one major cardiovascular event. Treatment with perindopril, on top of other preventive medications, should be considered in all patients with coronary heart disease