Feature Extraction Based on ORB- AKAZE for Echocardiogram View Classification

In computer vision, the extraction of robust features from images to construct models that automate image recognition and classification tasks is a prominent field of research. Handcrafted feature extraction and representation techniques become critical when dealing with limited hardware resource settings, low-quality images, and larger datasets. We propose two state-of-the-art handcrafted feature extraction techniques, Oriented FAST and Rotated BRIEF (ORB) and Accelerated KAZE (AKAZE), in combination with Bag of Visual Word (BOVW), to classify standard echocardiogram views using Machine learning (ML) algorithms. These novel approaches, ORB and AKAZE, which are rotation, scale, illumination, and noise invariant methods, outperform traditional methods. The despeckling algorithm Speckle Reduction Anisotropic Diffusion (SRAD), which is based on the Partial Differential Equation (PDE), was applied to echocardiogram images before feature extraction. Support Vector Machine (SVM), decision tree, and random forest algorithms correctly classified the feature vectors obtained from the ORB with accuracy rates of 96.5%, 76%, and 97.7%, respectively. Additionally, AKAZE\u27s SVM, decision tree, and random forest algorithms outperformed state-of-the-art techniques with accuracy rates of 97.7%, 90%, and 99%, respectively

Artificial intelligence and echocardiography

Echocardiography plays a crucial role in the diagnosis and management of cardiovascular disease. However, interpretation remains largely reliant on the subjective expertise of the operator. As a result inter-operator variability and experience can lead to incorrect diagnoses. Artificial intelligence (AI) technologies provide new possibilities for echocardiography to generate accurate, consistent and automated interpretation of echocardiograms, thus potentially reducing the risk of human error. In this review, we discuss a subfield of AI relevant to image interpretation, called machine learning, and its potential to enhance the diagnostic performance of echocardiography. We discuss recent applications of these methods and future directions for AI-assisted interpretation of echocardiograms. The research suggests it is feasible to apply machine learning models to provide rapid, highly accurate and consistent assessment of echocardiograms, comparable to clinicians. These algorithms are capable of accurately quantifying a wide range of features, such as the severity of valvular heart disease or the ischaemic burden in patients with coronary artery disease. However, the applications and their use are still in their infancy within the field of echocardiography. Research to refine methods and validate their use for automation, quantification and diagnosis are in progress. Widespread adoption of robust AI tools in clinical echocardiography practice should follow and have the potential to deliver significant benefits for patient outcome

Image-Based Cardiac Diagnosis With Machine Learning: A Review

Cardiac imaging plays an important role in the diagnosis of cardiovascular disease (CVD). Until now, its role has been limited to visual and quantitative assessment of cardiac structure and function. However, with the advent of big data and machine learning, new opportunities are emerging to build artificial intelligence tools that will directly assist the clinician in the diagnosis of CVDs. This paper presents a thorough review of recent works in this field and provide the reader with a detailed presentation of the machine learning methods that can be further exploited to enable more automated, precise and early diagnosis of most CVDs

Artificial Intelligence and Transcatheter Interventions for Structural Heart Disease: A glance at the (near) future

With innovations in therapeutic technologies and changes in population demographics, transcatheter interventions for structural heart disease have become the preferred treatment and will keep growing. Yet, a thorough clinical selection and efficient pathway from diagnosis to treatment and follow-up are mandatory. In this review we reflect on how artificial intelligence may help to improve patient selection, pre-procedural planning, procedure execution and follow-up so to establish efficient and high quality health care in an increasing number of patients

Video Kinematic Evaluation: new insights on the cardiac mechanical function

The cardiac mechanical function plays a critical role in governing and regulating its performance under both normal and pathological conditions. The left ventricle has historically received more attention in both congenital and acquired heart diseases and was considered as the mainstay of normal hemodynamics. However, over the past few decades, there has been increasing recognition of the pivotal role of the right ventricle in determining functional performance status and prognosis in multiple conditions. Nonetheless, the ventricles should not be considered separately as they share the septum, are encircled with common myocardial fibers and are surrounded by the pericardium. Thus, changes in the filling of one ventricle may alter the mechanical function of its counterpart. This ventricular interdependence remains even after the removal of the pericardium because of constrictive pericarditis or during open chest surgery. Interestingly, during open chest surgery, only the right ventricle mechanical activity is visually checked by the surgeon and cardiologist due to the absence of an intraoperative imaging technique able to evaluate its complex function. Noteworthy, most of the imaging techniques available to clinicians are established for the assessment of the left ventricle, with the ejection fraction being the most used parameter. However, this value is a measure of global systolic function which comes short in identifying regional myocardial impairment and the mechanical contraction. Therefore, new approaches are needed to deeply investigate the mechanics of both ventricles and correctly assess the cardiac mechanical performance. In this thesis, I studied the mechanical function of the left ventricle through different modalities of cardiac magnetic resonance and employed an innovative imaging technique for the assessment of the right ventricle mechanical function during open chest surgery

Classification of De novo post-operative and persistent atrial fibrillation using multi-channel ECG recordings

Atrial fibrillation (AF) is the most sustained arrhythmia in the heart and also the most common complication developed after cardiac surgery. Due to its progressive nature, timely detection of AF is important. Currently, physicians use a surface electrocardiogram (ECG) for AF diagnosis. However, when the patient develops AF, its various development stages are not distinguishable for cardiologists based on visual inspection of the surface ECG signals. Therefore, severity detection of AF could start from differentiating between short-lasting AF and long-lasting AF. Here, de novo post-operative AF (POAF) is a good model for short-lasting AF while long-lasting AF can be represented by persistent AF. Therefore, we address in this paper a binary severity detection of AF for two specific types of AF. We focus on the differentiation of these two types as de novo POAF is the first time that a patient develops AF. Hence, comparing its development to a more severe stage of AF (e.g., persistent AF) could be beneficial in unveiling the electrical changes in the atrium. To the best of our knowledge, this is the first paper that aims to differentiate these different AF stages. We propose a method that consists of three sets of discriminative features based on fundamentally different aspects of the multi-channel ECG data, namely based on the analysis of RR intervals, a greyscale image representation of the vectorcardiogram, and the frequency domain representation of the ECG. Due to the nature of AF, these features are able to capture both morphological and rhythmic changes in the ECGs. Our classification system consists of a random forest classifier, after a feature selection stage using the ReliefF method. The detection efficiency is tested on 151 patients using 5-fold cross-validation. We achieved 89.07% accuracy in the classification of de novo POAF and persistent AF. The results show that the features are discriminative to reveal the severity of AF. Moreover, inspection of the most important features sheds light on the different characteristics of de novo post-operative and persistent AF.</p

Contribuciones de las técnicas machine learning a la cardiología. Predicción de reestenosis tras implante de stent coronario

[ES]Antecedentes: Existen pocos temas de actualidad equiparables a la posibilidad de la tecnología actual para desarrollar las mismas capacidades que el ser humano, incluso en medicina. Esta capacidad de simular los procesos de inteligencia humana por parte de máquinas o sistemas informáticos es lo que conocemos hoy en día como inteligencia artificial. Uno de los campos de la inteligencia artificial con mayor aplicación a día de hoy en medicina es el de la predicción, recomendación o diagnóstico, donde se aplican las técnicas machine learning. Asimismo, existe un creciente interés en las técnicas de medicina de precisión, donde las técnicas machine learning pueden ofrecer atención médica individualizada a cada paciente. El intervencionismo coronario percutáneo (ICP) con stent se ha convertido en una práctica habitual en la revascularización de los vasos coronarios con enfermedad aterosclerótica obstructiva significativa. El ICP es asimismo patrón oro de tratamiento en pacientes con infarto agudo de miocardio; reduciendo las tasas de muerte e isquemia recurrente en comparación con el tratamiento médico. El éxito a largo plazo del procedimiento está limitado por la reestenosis del stent, un proceso patológico que provoca un estrechamiento arterial recurrente en el sitio de la ICP. Identificar qué pacientes harán reestenosis es un desafío clínico importante; ya que puede manifestarse como un nuevo infarto agudo de miocardio o forzar una nueva resvascularización del vaso afectado, y que en casos de reestenosis recurrente representa un reto terapéutico. Objetivos: Después de realizar una revisión de las técnicas de inteligencia artificial aplicadas a la medicina y con mayor profundidad, de las técnicas machine learning aplicadas a la cardiología, el objetivo principal de esta tesis doctoral ha sido desarrollar un modelo machine learning para predecir la aparición de reestenosis en pacientes con infarto agudo de miocardio sometidos a ICP con implante de un stent. Asimismo, han sido objetivos secundarios comparar el modelo desarrollado con machine learning con los scores clásicos de riesgo de reestenosis utilizados hasta la fecha; y desarrollar un software que permita trasladar esta contribución a la práctica clínica diaria de forma sencilla. Para desarrollar un modelo fácilmente aplicable, realizamos nuestras predicciones sin variables adicionales a las obtenidas en la práctica rutinaria. Material: El conjunto de datos, obtenido del ensayo GRACIA-3, consistió en 263 pacientes con características demográficas, clínicas y angiográficas; 23 de ellos presentaron reestenosis a los 12 meses después de la implantación del stent. Todos los desarrollos llevados a cabo se han hecho en Python y se ha utilizado computación en la nube, en concreto AWS (Amazon Web Services). Metodología: Se ha utilizado una metodología para trabajar con conjuntos de datos pequeños y no balanceados, siendo importante el esquema de validación cruzada anidada utilizado, así como la utilización de las curvas PR (precision-recall, exhaustividad-sensibilidad), además de las curvas ROC, para la interpretación de los modelos. Se han entrenado los algoritmos más habituales en la literatura para elegir el que mejor comportamiento ha presentado. Resultados: El modelo con mejores resultados ha sido el desarrollado con un clasificador extremely randomized trees; que superó significativamente (0,77; área bajo la curva ROC a los tres scores clínicos clásicos; PRESTO-1 (0,58), PRESTO-2 (0,58) y TLR (0,62). Las curvas exhaustividad sensibilidad ofrecieron una imagen más precisa del rendimiento del modelo extremely randomized trees que muestra un algoritmo eficiente (0,96) para no reestenosis, con alta exhaustividad y alta sensibilidad. Para un umbral considerado óptimo, de 1,000 pacientes sometidos a implante de stent, nuestro modelo machine learning predeciría correctamente 181 (18%) más casos en comparación con el mejor score de riesgo clásico (TLR). Las variables más importantes clasificadas según su contribución a las predicciones fueron diabetes, enfermedad coronaria en 2 ó más vasos, flujo TIMI post-ICP, plaquetas anormales, trombo post-ICP y colesterol anormal. Finalmente, se ha desarrollado una calculadora para trasladar el modelo a la práctica clínica. La calculadora permite estimar el riesgo individual de cada paciente y situarlo en una zona de riesgo, facilitando la toma de decisión al médico en cuanto al seguimiento adecuado para el mismo. Conclusiones: Aplicado inmediatamente después de la implantación del stent, un modelo machine learning diferencia mejor a aquellos pacientes que presentarán o no reestenosis respecto a los discriminadores clásicos actuales