Medical imaging analysis with artificial neural networks

Given that neural networks have been widely reported in the research community of medical imaging, we provide a focused literature survey on recent neural network developments in computer-aided diagnosis, medical image segmentation and edge detection towards visual content analysis, and medical image registration for its pre-processing and post-processing, with the aims of increasing awareness of how neural networks can be applied to these areas and to provide a foundation for further research and practical development. Representative techniques and algorithms are explained in detail to provide inspiring examples illustrating: (i) how a known neural network with fixed structure and training procedure could be applied to resolve a medical imaging problem; (ii) how medical images could be analysed, processed, and characterised by neural networks; and (iii) how neural networks could be expanded further to resolve problems relevant to medical imaging. In the concluding section, a highlight of comparisons among many neural network applications is included to provide a global view on computational intelligence with neural networks in medical imaging

Improving Patch-Based Convolutional Neural Networks for MRI Brain Tumor Segmentation by Leveraging Location Information.

The manual brain tumor annotation process is time consuming and resource consuming, therefore, an automated and accurate brain tumor segmentation tool is greatly in demand. In this paper, we introduce a novel method to integrate location information with the state-of-the-art patch-based neural networks for brain tumor segmentation. This is motivated by the observation that lesions are not uniformly distributed across different brain parcellation regions and that a locality-sensitive segmentation is likely to obtain better segmentation accuracy. Toward this, we use an existing brain parcellation atlas in the Montreal Neurological Institute (MNI) space and map this atlas to the individual subject data. This mapped atlas in the subject data space is integrated with structural Magnetic Resonance (MR) imaging data, and patch-based neural networks, including 3D U-Net and DeepMedic, are trained to classify the different brain lesions. Multiple state-of-the-art neural networks are trained and integrated with XGBoost fusion in the proposed two-level ensemble method. The first level reduces the uncertainty of the same type of models with different seed initializations, and the second level leverages the advantages of different types of neural network models. The proposed location information fusion method improves the segmentation performance of state-of-the-art networks including 3D U-Net and DeepMedic. Our proposed ensemble also achieves better segmentation performance compared to the state-of-the-art networks in BraTS 2017 and rivals state-of-the-art networks in BraTS 2018. Detailed results are provided on the public multimodal brain tumor segmentation (BraTS) benchmarks

White Matter Hyperintensity and Multi-region Brain MRI Segmentation Using Convolutional Neural Network

Accurate segmentation of WMH (white matter hyperintensity) from the magnetic resonance image is a prerequisite for many precise medical procedures, especially for the diagnosis of vascular dementia. Brain segmentation has important research significance and clinical application prospects especially for early detection of Alzheimer’s disease. In order to effectively perform accurate segmentation according to the MRI characteristics of different regions of the brain, this thesis proposed an optimized 3D u-net and used WHM segmentation as a pre-experiment to select the good hyperparameters (i.e. network depth, image fusion method, and the implementation of loss function) to construct an image feature learning network with both long and short skip connections. Soft voting is used as the postprocessing procedure. Our model is evaluated by a 10-fold cross-validation and achieved a dice score of 0.78 for binary segmentation (WMH segmentation) and accuracy of 0.96 for multi-class segmentation (139 regions brain segmentation), outperforming other methods

Characterizing and revealing biomarkers on patients with Cerebral Amyloid Angiopathy using artificial intelligence

Dissertação de mestrado em BioinformáticaCerebral Amyloid Angiopathy is a cerebrovascular disorder resulting from the deposition of an amyloidogenic protein in small and medium sized cortical and leptomeningeal vessels. A primary cause of spontaneous intracerebral haemorrhages, it manifests predominantly in the elder population. Although CAA is a common neuropathological finding on itself, it is also known to frequently occur in conjunction with Alzheimer’s disease, being sometimes misdiagnosed. Currently, CAA diagnosis is generally conducted by post-mortem examination or, in live patients by the examination of an evacuated hematoma or brain biopsy samples, which are typically unavailable. Therefore, a reliable and non-invasive method for diagnosing CAA would facilitate the clinical decision making and accelerate the clinical intervention. The main goal of this dissertation is to study the application of Machine Learning (ML) to reveal possible biomarkers to aid the diagnosis and early medical intervention, and better understand the disease. Therefore, three scenarios were tested: Classification of four neurodegenerative diseases with annotation data obtained from visual rating scores, age and gender; Classification of the diseases with radiomic data derived from the patient’s MRI; and a combination of the previous experiments. The results show that the application of Artificial intelligence in the medical field brings advantages to support the physicians in the decision making process and, at some point, make a correct prediction of the disease label. Although the results are satisfactory, there are still improvements to be done. For instance, image segmentation of cerebral lesions or brain regions and additional clinical information of the patients would be of value.Angiopatia Amiloide Cerebral (AAC) é uma doença vascular cerebral resultante da deposição de matéria amiloide. Principal causa de hemorragias cerebral espontâneas, a AAC manifesta se predominantemente na população idosa. Embora a AAC seja uma doença que por si só tem um grande impacto no grupo etário referido, ocorre em simultâneo com inúmeras outras doenças neurodegenerativas, como a doença de Alzheimer. Atualmente, o diagnóstico de AAC realiza-se quer em post-mortem, quer em pacientes vivos. No entanto, o diagnóstico em vida é conseguido por meio de biópsias de tecidos cerebrais, sendo um método invasivo, o que dificulta a intervenção clínica. Deste modo, torna-se imperativa a procura de alternativas fiáveis e não invasivas em vida para auxiliar o diagnóstico da doença e permitir a melhoria da qualidade de vida do paciente. Perante os progressos na área da tecnologia e medicina, esta dissertação propõe o estudo da aplicação de algoritmos de Machine Learning (ML) para revelar possíveis biomarcadores para auxiliar o diagnóstico e permitir uma intervenção precoce. Deste modo, foram testados três cenários distintos: a classificação de quatro doenças neurodegenerativas com dados anotados obtidos a partir de métricas visuais de avaliação da atrofia, idade e sexo; a classificação das doenças com dados gerados a partir de métodos radiómicos; e uma combinação das duas abordagens anteriores. Neste documento apresenta-se e discute-se os resultados obtidos com a aplicação de quatro diferentes algoritmos de ML que visam a deteção automática da doença associada à imagem testada. Adicionalmente, é feita uma análise crítica de quais as características mais relevantes que levaram à tomada de decisão por parte do algoritmo. Os resultados demonstram que através de aplicação de metodologias automáticas é possível o auxílio ao diagnostico médico por especialistas e, no limite, a realização de diagnostico automático com elevada precisão. Finalmente, são apresentadas possíveis alternativas de trabalho futuro para que os resultados possam ser aperfeiçoados, como por exemplo, a segmentação das regiões de interesse, i.e., identificação das lesões, aquando da anotação por especialistas. Mediante a inclusão dessa segmentação, uma vez que será mais especifica, os resultados serão, por sua vez, aprimorados