Focal Spot, Spring 2000

https://digitalcommons.wustl.edu/focal_spot_archives/1084/thumbnail.jp

Advancements and Breakthroughs in Ultrasound Imaging

Ultrasonic imaging is a powerful diagnostic tool available to medical practitioners, engineers and researchers today. Due to the relative safety, and the non-invasive nature, ultrasonic imaging has become one of the most rapidly advancing technologies. These rapid advances are directly related to the parallel advancements in electronics, computing, and transducer technology together with sophisticated signal processing techniques. This book focuses on state of the art developments in ultrasonic imaging applications and underlying technologies presented by leading practitioners and researchers from many parts of the world

IT Infrastructure to Support the Secondary Use of Routinely Acquired Clinical Imaging Data for Research

We propose an infrastructure for the automated anonymization, extraction and processing of image data stored in clinical data repositories to make routinely acquired imaging data available for research purposes. The automated system, which was tested in the context of analyzing routinely acquired MR brain imaging data, consists of four modules: subject selection using PACS query, anonymization of privacy sensitive information and removal of facial features, quality assurance on DICOM header and image information, and quantitative imaging biomarker extraction. In total, 1,616 examinations were selected based on the following MRI scanning protocols: dementia protocol (246), multiple sclerosis protocol (446) and open question protocol (924). We evaluated the effectiveness of the infrastructure in accessing and successfully extracting biomarkers from routinely acquired clinical imaging data. To examine the validity, we compared brain volumes between patient groups with positive and negative diagnosis, according to the patient reports. Overall, success rates of image data retrieval and automatic processing were 82.5 %, 82.3 % and 66.2 % for the three protocol groups respectively, indicating that a large percentage of routinely acquired clinical imaging data can be used for brain volumetry research, despite image heterogeneity. In line with the literature, brain volumes were found to be significantly smaller (p-value <0.001) in patients with a positive diagnosis of dementia (915 ml) compared to patients with a negative diagnosis (939 ml). This study demonstrates that quantitative image biomarkers such as intracranial and brain volume can be extracted from routinely acquired clinical imaging data. This enables secondary use of clinical images for research into quantitative biomarkers at a hitherto unprecedented scale

Inteligência Artificial em Radiologia: Do Processamento de Imagem ao Diagnóstico

The objective of this article is to present a view on the potential impact of Artificial Intelligence (AI) on processing medical images, in particular in relation to diagnostic. This topic is currently attracting major attention in both the medical and engineering communities, as demonstrated by the number of recent tutorials [1-3] and review articles [4-6] that address it, with large research hospitals, as well as engineering research centers contributing to the area. Furthermore, several large companies like General Electric (GE), IBM/Merge, Siemens, Philips or Agfa, as well as more specialized companies and startups are integrating AI into their medical imaging products. The evolution of GE in this respect is interesting. GE SmartSignal software was developed for industrial applications to identify impending equipment failures well before they happen. As written in the GE prospectus, with this added lead time, one can transform from reactive maintenance to a more proactive maintenance process, allowing the workforce to focus on fixing problems rather than looking for them. With this background experience from the industrial field, GE developed predictive analytics products for clinical imaging, that embodied the Predictive component of P4 medicine (predictive, personalized, preventive, participatory). Another interesting example is the Illumeo software from Philips that embeds adaptive intelligence, i. e. the capacity to improve its automatic reasoning process from its past experience, to automatically pop out related prior exams for radiology in face of a concrete situation. Actually, with its capacity to tackle massive amounts of data of different sorts (imaging data, patient exam reports, pathology reports, patient monitoring signals, data from implantable electrophysiology devices, and data from many other sources) AI is certainly able to yield a decisive contribution to all the components of P4 medicine. For instance, in the presence of a rare disease, AI methods have the capacity to review huge amounts of prior information when confronted to the patient clinical data

Advanced Visualization and Intuitive User Interface Systems for Biomedical Applications

Modern scientific research produces data at rates that far outpace our ability to comprehend and analyze it. Such sources include medical imaging data and computer simulations, where technological advancements and spatiotemporal resolution generate increasing amounts of data from each scan or simulation. A bottleneck has developed whereby medical professionals and researchers are unable to fully use the advanced information available to them. By integrating computer science, computer graphics, artistic ability and medical expertise, scientific visualization of medical data has become a new field of study. The objective of this thesis is to develop two visualization systems that use advanced visualization, natural user interface technologies and the large amount of biomedical data available to produce results that are of clinical utility and overcome the data bottleneck that has developed. Computational Fluid Dynamics (CFD) is a tool used to study the quantities associated with the movement of blood by computer simulation. We developed methods of processing spatiotemporal CFD data and displaying it in stereoscopic 3D with the ability to spatially navigate through the data. We used this method with two sets of display hardware: a full-scale visualization environment and a small-scale desktop system. The advanced display and data navigation abilities provide the user with the means to better understand the relationship between the vessel\u27s form and function. Low-cost 3D, depth-sensing cameras capture and process user body motion to recognize motions and gestures. Such devices allow users to use hand motions as an intuitive interface to computer applications. We developed algorithms to process and prepare the biomedical and scientific data for use with a custom control application. The application interprets user gestures as commands to a visualization tool and allows the user to control the visualization of multi-dimensional data. The intuitive interface allows the user to control the visualization of data without manual contact with an interaction device. In developing these methods and software tools we have leveraged recent trends in advanced visualization and intuitive interfaces in order to efficiently visualize biomedical data in such a way that provides meaningful information that can be used to further appreciate it

Bioengineering, augmented reality, and robotic surgery in vascular surgery: A literature review

Biomedical engineering integrates a variety of applied sciences with life sciences to improve human health and reduce the invasiveness of surgical procedures. Technological advances, achieved through biomedical engineering, have contributed to significant improvements in the field of vascular and endovascular surgery. This paper aims to review the most cutting-edge technologies of the last decade involving the use of augmented reality devices and robotic systems in vascular surgery, highlighting benefits and limitations. Accordingly, two distinct literature surveys were conducted through the PubMed database: the first review provides a comprehensive assessment of augmented reality technologies, including the different techniques available for the visualization of virtual content (11 papers revised); the second review collects studies with bioengineering content that highlight the research trend in robotic vascular surgery, excluding works focused only on the clinical use of commercially available robotic systems (15 papers revised). Technological flow is constant and further advances in imaging techniques and hardware components will inevitably bring new tools for a clinical translation of innovative therapeutic strategies in vascular surgery

Accuracy and feasibility of a dedicated image guidance solution for endoscopic lateral skull base surgery.

OBJECTIVE We aimed to design, build and validate a surgical navigation system which fulfills the accuracy requirements for surgical procedures on the ear and the lateral skull base, and which integrates with the endoscopic workflow and operating room setup. MATERIALS AND METHODS The navigation system consists of portable tablet computer (iPad Pro, Apple Computer, USA) and an optical tracking system (Cambar B1, Axios3D, Germany), both connected via a wireless Bluetooth link and attached directly to the OR table. Active optical tracking references are rigidly fixed to both the patient and surgical tools. Software to support image import, registration and 2D/3D visualization has been developed. Two models were used for targeting accuracy assessment: a technical phantom model and an ex vivo temporal bone model. Additionally, workflow integration and usability of the navigation system during endoscopic lateral skull base procedures was investigated in ex vivo experiments on 12 sides of cadaver head specimens. RESULTS The accuracy experiments revealed a target registration error in the technical phantom model of 0.20 ± 0.10 mm (n = 36) and during the ex vivo assessment of 0.28 ± 0.10 mm (n = 21). Navigation was successfully carried out in n = 36 procedures (infracochlear, suprageniculate and transpromontorial approach), with navigated instruments usable without interference with the endoscope. The system aided in the successful and accurate identification of vital anatomical structures. CONCLUSIONS Useful surgical navigation is, to a large extent, a result of sufficiently accurate tracking technology. We have demonstrated sufficient accuracy and a potentially suitable integration for surgical application within endoscopic lateral skull base procedures

Development of Imaging Mass Spectrometry Analysis of Lipids in Biological and Clinically Relevant Applications

La spectrométrie de masse mesure la masse des ions selon leur rapport masse sur charge. Cette technique est employée dans plusieurs domaines et peut analyser des mélanges complexes. L’imagerie par spectrométrie de masse (Imaging Mass Spectrometry en anglais, IMS), une branche de la spectrométrie de masse, permet l’analyse des ions sur une surface, tout en conservant l’organisation spatiale des ions détectés. Jusqu’à présent, les échantillons les plus étudiés en IMS sont des sections tissulaires végétales ou animales. Parmi les molécules couramment analysées par l’IMS, les lipides ont suscité beaucoup d'intérêt. Les lipides sont impliqués dans les maladies et le fonctionnement normal des cellules; ils forment la membrane cellulaire et ont plusieurs rôles, comme celui de réguler des événements cellulaires. Considérant l’implication des lipides dans la biologie et la capacité du MALDI IMS à les analyser, nous avons développé des stratégies analytiques pour la manipulation des échantillons et l’analyse de larges ensembles de données lipidiques. La dégradation des lipides est très importante dans l’industrie alimentaire. De la même façon, les lipides des sections tissulaires risquent de se dégrader. Leurs produits de dégradation peuvent donc introduire des artefacts dans l’analyse IMS ainsi que la perte d’espèces lipidiques pouvant nuire à la précision des mesures d’abondance. Puisque les lipides oxydés sont aussi des médiateurs importants dans le développement de plusieurs maladies, leur réelle préservation devient donc critique. Dans les études multi-institutionnelles où les échantillons sont souvent transportés d’un emplacement à l’autre, des protocoles adaptés et validés, et des mesures de dégradation sont nécessaires. Nos principaux résultats sont les suivants : un accroissement en fonction du temps des phospholipides oxydés et des lysophospholipides dans des conditions ambiantes, une diminution de la présence des lipides ayant des acides gras insaturés et un effet inhibitoire sur ses phénomènes de la conservation des sections au froid sous N2. A température et atmosphère ambiantes, les phospholipides sont oxydés sur une échelle de temps typique d’une préparation IMS normale (~30 minutes). Les phospholipides sont aussi décomposés en lysophospholipides sur une échelle de temps de plusieurs jours. La validation d’une méthode de manipulation d’échantillon est d’autant plus importante lorsqu’il s’agit d’analyser un plus grand nombre d’échantillons. L’athérosclérose est une maladie cardiovasculaire induite par l’accumulation de matériel cellulaire sur la paroi artérielle. Puisque l’athérosclérose est un phénomène en trois dimension (3D), l'IMS 3D en série devient donc utile, d'une part, car elle a la capacité à localiser les molécules sur la longueur totale d’une plaque athéromateuse et, d'autre part, car elle peut identifier des mécanismes moléculaires du développement ou de la rupture des plaques. l'IMS 3D en série fait face à certains défis spécifiques, dont beaucoup se rapportent simplement à la reconstruction en 3D et à l’interprétation de la reconstruction moléculaire en temps réel. En tenant compte de ces objectifs et en utilisant l’IMS des lipides pour l’étude des plaques d’athérosclérose d’une carotide humaine et d’un modèle murin d’athérosclérose, nous avons élaboré des méthodes «open-source» pour la reconstruction des données de l’IMS en 3D. Notre méthodologie fournit un moyen d’obtenir des visualisations de haute qualité et démontre une stratégie pour l’interprétation rapide des données de l’IMS 3D par la segmentation multivariée. L’analyse d’aortes d’un modèle murin a été le point de départ pour le développement des méthodes car ce sont des échantillons mieux contrôlés. En corrélant les données acquises en mode d’ionisation positive et négative, l’IMS en 3D a permis de démontrer une accumulation des phospholipides dans les sinus aortiques. De plus, l’IMS par AgLDI a mis en évidence une localisation différentielle des acides gras libres, du cholestérol, des esters du cholestérol et des triglycérides. La segmentation multivariée des signaux lipidiques suite à l’analyse par IMS d’une carotide humaine démontre une histologie moléculaire corrélée avec le degré de sténose de l’artère. Ces recherches aident à mieux comprendre la complexité biologique de l’athérosclérose et peuvent possiblement prédire le développement de certains cas cliniques. La métastase au foie du cancer colorectal (Colorectal cancer liver metastasis en anglais, CRCLM) est la maladie métastatique du cancer colorectal primaire, un des cancers le plus fréquent au monde. L’évaluation et le pronostic des tumeurs CRCLM sont effectués avec l’histopathologie avec une marge d’erreur. Nous avons utilisé l’IMS des lipides pour identifier les compartiments histologiques du CRCLM et extraire leurs signatures lipidiques. En exploitant ces signatures moléculaires, nous avons pu déterminer un score histopathologique quantitatif et objectif et qui corrèle avec le pronostic. De plus, par la dissection des signatures lipidiques, nous avons identifié des espèces lipidiques individuelles qui sont discriminants des différentes histologies du CRCLM et qui peuvent potentiellement être utilisées comme des biomarqueurs pour la détermination de la réponse à la thérapie. Plus spécifiquement, nous avons trouvé une série de plasmalogènes et sphingolipides qui permettent de distinguer deux différents types de nécrose (infarct-like necrosis et usual necrosis en anglais, ILN et UN, respectivement). L’ILN est associé avec la réponse aux traitements chimiothérapiques, alors que l’UN est associé au fonctionnement normal de la tumeur.Mass spectrometry is the measurement of the mass over charge ratio of ions. It is broadly applicable and capable of analyzing complex mixtures. Imaging mass spectrometry (IMS) is a branch of mass spectrometry that analyses ions across a surface while conserving their spatial organization on said surface. At this juncture, the most studied IMS samples are thin tissue sections from plants and animals. Among the molecules routinely imaged by IMS, lipids have generated significant interest. Lipids are important in disease and normal cell function as they form cell membranes and act as signaling molecules for cellular events among many other roles. Considering the potential of lipids in biological and clinical applications and the capability of MALDI to ionize lipids, we developed analytical strategies for the handling of samples and analysis of large lipid MALDI IMS datasets. Lipid degradation is massively important in the food industry with oxidized products producing a bad smell and taste. Similarly, lipids in thin tissue sections cut from whole tissues are subject to degradation, and their degradation products can introduce IMS artifacts and the loss of normally occurring species to degradation can skew accuracy in IMS measures of abundance. Oxidized lipids are also known to be important mediators in the progression of several diseases and their accurate preservation is critical. As IMS studies become multi-institutional and collaborations lead to sample exchange, the need for validated protocols and measures of degradation are necessary. We observed the products of lipid degradation in tissue sections from multiple mouse organs and reported on the conditions promoting and inhibiting their presence as well as the timeline of degradation. Our key findings were the increase in oxidized phospholipids and lysophospholipids from degradation at ambient conditions, the decrease in the presence of lipids containing unsaturations on their fatty acyl chains, and the inhibition of degradation by matrix coating and cold storage of sections under N2 atmosphere. At ambient atmospheric and temperature, lipids degraded into oxidized phospholipids on the time-scale of a normal IMS experiment sample preparation (within 30 min). Lipids then degraded into lysophospholipids’ on a time scale on the order of several days. Validation of sample handling is especially important when a greater number of samples are to be analyzed either through a cohort of samples, or analysis of multiple sections from a single tissue as in serial 3D IMS. Atherosclerosis is disease caused by accumulation of cellular material at the arterial wall. The accumulation implanted in the cell wall grows and eventually occludes the blood vessel, or causes a stroke. Atherosclerosis is a 3D phenomenon and serial 3D IMS is useful for its ability to localize molecules throughout the length of a plaque and help to define the molecular mechanisms of plaque development and rupture. Serial 3D IMS has many challenges, many of which are simply a matter of producing 3D reconstructions and interpreting them in a timely fashion. In this aim and using analysis of lipids from atherosclerotic plaques from a human carotid and mouse aortic sinuses, we described 3D reconstruction methods using open-source software. Our methodology provides means to obtain high quality visualizations and demonstrates strategies for rapid interpretation of 3D IMS datasets through multivariate segmentation. Mouse aorta from model animals provided a springboard for developing the methods on lower risk samples with less variation with interesting molecular results. 3D MALDI IMS showed localized phospholipid accumulation in the mouse aortic sinuses with correlation between separate positive and negative ionization datasets. Silver-assisted LDI imaging presented differential localization of free fatty acids, cholesterol / cholesterol esters, and triglycerides. The human carotid’s 3D segmentation shows molecular histologies (spatial groupings of imaging pixels with similar spectral fingerprints) correlating to the degree of arterial stenosis. Our results outline the potential for 3D IMS in atherosclerotic research. Molecular histologies and their 3D spatial organization, obtained from the IMS techniques used herein, may predict high-risk features, and particularly identify areas of plaque that have higher-risk of rupture. These investigations would help further unravel the biological complexities of atherosclerosis, and predict clinical outcomes. Colorectal cancer liver metastasis (CRCLM) is the metastatic disease of primary colorectal cancer, one of the most common cancers worldwide. CRC is a cancer of the endothelial lining of the colon or rectum. CRC itself is often cured with surgery, while CRCLM is more deadly and treated with chemotherapy with more limited efficacy. Prognosticating and assessment of tumors is performed using classical histopathology with a margin of error. We have used lipid IMS to identify the histological compartments and extract their signatures. Using these IMS signatures we obtained a quantitative and objective histopathological score that correlates with prognosis. Additionally, by dissecting out the lipid signatures we have identified single lipid moieties that are unique to different histologies that could potentially be used as new biomarkers for assessing response to therapy. Particularly, we found a series of plasmalogen and sphingolipid species that differentiate infarct-like and usual necrosis, typical of chemotherapeutic response and normal tumor function, respectively

A Survey on Deep Learning in Medical Image Analysis

Deep learning algorithms, in particular convolutional networks, have rapidly become a methodology of choice for analyzing medical images. This paper reviews the major deep learning concepts pertinent to medical image analysis and summarizes over 300 contributions to the field, most of which appeared in the last year. We survey the use of deep learning for image classification, object detection, segmentation, registration, and other tasks and provide concise overviews of studies per application area. Open challenges and directions for future research are discussed.Comment: Revised survey includes expanded discussion section and reworked introductory section on common deep architectures. Added missed papers from before Feb 1st 201

Focal Spot, Winter 2004/2005

https://digitalcommons.wustl.edu/focal_spot_archives/1098/thumbnail.jp