Immersive Visualization for Enhanced Computational Fluid Dynamics Analysis

Modern biomedical computer simulations produce spatiotemporal results that are often viewed at a single point in time on standard 2D displays. An immersive visualization environment (IVE) with 3D stereoscopic capability can mitigate some shortcomings of 2D displays via improved depth cues and active movement to further appreciate the spatial localization of imaging data with temporal computational fluid dynamics (CFD) results. We present a semi-automatic workflow for the import, processing, rendering, and stereoscopic visualization of high resolution, patient-specific imaging data, and CFD results in an IVE. Versatility of the workflow is highlighted with current clinical sequelae known to be influenced by adverse hemodynamics to illustrate potential clinical utility

Three dimensional three component whole heart cardiovascular magnetic resonance velocity mapping: comparison of flow measurements from 3D and 2D acquisitions

<p>Abstract</p> <p>Background</p> <p>Two-dimensional, unidirectionally encoded, cardiovascular magnetic resonance (CMR) velocity mapping is an established technique for the quantification of blood flow in large vessels. However, it requires an operator to correctly align the planes of acquisition. If all three directional components of velocity are measured for each voxel of a 3D volume through the phases of the cardiac cycle, blood flow through any chosen plane can potentially be calculated retrospectively. The initial acquisition is then more time consuming but relatively operator independent.</p> <p>Aims</p> <p>To compare the curves and volumes of flow derived from conventional 2D and comprehensive 3D flow acquisitions in a steady state flow model, and in vivo through planes transecting the ascending aorta and pulmonary trunk in 10 healthy volunteers.</p> <p>Methods</p> <p>Using a 1.5 T Phillips Intera CMR system, 3D acquisitions used an anisotropic 3D segmented k-space phase contrast gradient echo sequence with a short EPI readout, with prospective ECG and diaphragm navigator gating. The 2D acquisitions used segmented k-space phase contrast with prospective ECG and diaphragm navigator gating. Quantitative flow analyses were performed retrospectively with dedicated software for both the in vivo and in vitro acquisitions.</p> <p>Results</p> <p>Analysis of in vitro data found the 3D technique to have overestimated the continuous flow rate by approximately 5% across the entire applied flow range. In vivo, the 2D and the 3D techniques yielded similar volumetric flow curves and measurements. Aortic flow: (mean ± SD), 2D = 89.5 ± 13.5 ml & 3D = 92.7 ± 17.5 ml. Pulmonary flow: 2D = 98.8 ± 18.4 ml & 3D = 94.9 ± 19.0 ml). Each in vivo 3D acquisition took about 8 minutes or more.</p> <p>Conclusion</p> <p>Flow measurements derived from the 3D and 2D acquisitions were comparable. Although time consuming, comprehensive 3D velocity acquisition could be relatively operator independent, and could potentially yield information on flow through several retrospectively chosen planes, for example in patients with congenital or valvular heart disease.</p

Visualization-Based Mapping of Language Function in the Brain

Cortical language maps, obtained through intraoperative electrical stimulation studies, provide a rich source of information for research on language organization. Previous studies have shown interesting correlations between the distribution of essential language sites and such behavioral indicators as verbal IQ and have provided suggestive evidence for regarding human language cortex as an organization of multiple distributed systems. Noninvasive studies using ECoG, PET, and functional MR lend support to this model; however, there as yet are no studies that integrate these two forms of information. In this paper we describe a method for mapping the stimulation data onto a 3-D MRI-based neuroanatomic model of the individual patient. The mapping is done by comparing an intraoperative photograph of the exposed cortical surface with a computer-based MR visualization of the surface, interactively indicating corresponding stimulation sites, and recording 3-D MR machine coordinates of the indicated sites. Repeatability studies were performed to validate the accuracy of the mapping technique. Six observers—a neurosurgeon, a radiologist, and four computer scientists, independently mapped 218 stimulation sites from 12 patients. The mean distance of a mapping from the mean location of each site was 2.07 mm, with a standard deviation of 1.5 mm, or within 5.07 mm with 95% confidence. Since the surgical sites are accurate within approximately 1 cm, these results show that the visualization-based approach is accurate within the limits of the stimulation maps. When incorporated within the kind of information system envisioned by the Human Brain Project, this anatomically based method will not only provide a key link between noninvasive and invasive approaches to understanding language organization, but will also provide the basis for studying the relationship between language function and anatomical variability

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

From Molecules to the Masses : Visual Exploration, Analysis, and Communication of Human Physiology

Det overordnede målet med denne avhandlingen er tverrfaglig anvendelse av medisinske illustrasjons- og visualiseringsteknikker for å utforske, analysere og formidle aspekter ved fysiologi til publikum med ulik faglig nivå og bakgrunn. Fysiologi beskriver de biologiske prosessene som skjer i levende vesener over tid. Vitenskapen om fysiologi er kompleks, men samtidig kritisk for vår forståelse av hvordan levende organismer fungerer. Fysiologi dekker en stor bredde romlig-temporale skalaer og fordrer behovet for å kombinere og bygge bro mellom basalfagene (biologi, fysikk og kjemi) og medisin. De senere årene har det vært en eksplosjon av nye, avanserte eksperimentelle metoder for å detektere og karakterisere fysiologiske data. Volumet og kompleksiteten til fysiologiske data krever effektive strategier for visualisering for å komplementere dagens standard analyser. Hvilke tilnærminger som benyttes i visualiseringen må nøye balanseres og tilpasses formålet med bruken av dataene, enten dette er for å utforske dataene, analysere disse eller kommunisere og presentere dem. Arbeidet i denne avhandlingen bidrar med ny kunnskap innen teori, empiri, anvendelse og reproduserbarhet av visualiseringsmetoder innen fysiologi. Først i avhandlingen er en rapport som oppsummerer og utforsker dagens kunnskap om muligheter og utfordringer for visualisering innen fysiologi. Motivasjonen for arbeidet er behovet forskere innen visualiseringsfeltet, og forskere i ulike anvendelsesområder, har for en sammensatt oversikt over flerskala visualiseringsoppgaver og teknikker. Ved å bruke søk over et stort spekter av metodiske tilnærminger, er dette den første rapporten i sitt slag som kartlegger visualiseringsmulighetene innen fysiologi. I rapporten er faglitteraturen oppsummert slik at det skal være enkelt å gjøre oppslag innen ulike tema i rom-og-tid-skalaen, samtidig som litteraturen er delt inn i de tre høynivå visualiseringsoppgavene data utforsking, analyse og kommunikasjon. Dette danner et enkelt grunnlag for å navigere i litteraturen i feltet og slik danner rapporten et godt grunnlag for diskusjon og forskningsmuligheter innen feltet visualisering og fysiologi. Basert på arbeidet med rapporten var det særlig to områder som det er ønskelig for oss å fortsette å utforske: (1) utforskende analyse av mangefasetterte fysiologidata for ekspertbrukere, og (2) kommunikasjon av data til både eksperter og ikke-eksperter. Arbeidet vårt av mangefasetterte fysiologidata er oppsummert i to studier i avhandlingen. Hver studie omhandler prosesser som foregår på forskjellige romlig-temporale skalaer og inneholder konkrete eksempler på anvendelse av metodene vurdert av eksperter i feltet. I den første av de to studiene undersøkes konsentrasjonen av molekylære substanser (metabolitter) ut fra data innsamlet med magnetisk resonansspektroskopi (MRS), en avansert biokjemisk teknikk som brukes til å identifisere metabolske forbindelser i levende vev. Selv om MRS kan ha svært høy sensitivitet og spesifisitet i medisinske anvendelser, er analyseresultatene fra denne modaliteten abstrakte og vanskelige å forstå også for medisinskfaglige eksperter i feltet. Vår designstudie som undersøkte oppgavene og kravene til ekspertutforskende analyse av disse dataene førte til utviklingen av SpectraMosaic. Dette er en ny applikasjon som gjør det mulig for domeneeksperter å analysere konsentrasjonen av metabolitter normalisert for en hel kohort, eller etter prøveregion, individ, opptaksdato, eller status på hjernens aktivitetsnivå ved undersøkelsestidspunktet. I den andre studien foreslås en metode for å utføre utforskende analyser av flerdimensjonale fysiologiske data i motsatt ende av den romlig-temporale skalaen, nemlig på populasjonsnivå. En effektiv arbeidsflyt for utforskende dataanalyse må kritisk identifisere interessante mønstre og relasjoner, noe som blir stadig vanskeligere når dimensjonaliteten til dataene øker. Selv om dette delvis kan løses med eksisterende reduksjonsteknikker er det alltid en fare for at subtile mønstre kan gå tapt i reduksjonsprosessen. Isteden presenterer vi i studien DimLift, en iterativ dimensjonsreduksjonsteknikk som muliggjør brukeridentifikasjon av interessante mønstre og relasjoner som kan ligge subtilt i et datasett gjennom dimensjonale bunter. Nøkkelen til denne metoden er brukerens evne til å styre dimensjonalitetsreduksjonen slik at den følger brukerens egne undersøkelseslinjer. For videre å undersøke kommunikasjon til eksperter og ikke-eksperter, studeres i neste arbeid utformingen av visualiseringer for kommunikasjon til publikum med ulike nivåer av ekspertnivå. Det er naturlig å forvente at eksperter innen et emne kan ha ulike preferanser og kriterier for å vurdere en visuell kommunikasjon i forhold til et ikke-ekspertpublikum. Dette påvirker hvor effektivt et bilde kan benyttes til å formidle en gitt scenario. Med utgangspunkt i ulike teknikker innen biomedisinsk illustrasjon og visualisering, gjennomførte vi derfor en utforskende studie av kriteriene som publikum bruker når de evaluerer en biomedisinsk prosessvisualisering målrettet for kommunikasjon. Fra denne studien identifiserte vi muligheter for ytterligere konvergens av biomedisinsk illustrasjon og visualiseringsteknikker for mer målrettet visuell kommunikasjonsdesign. Særlig beskrives i større dybde utviklingen av semantisk konsistente retningslinjer for farging av molekylære scener. Hensikten med slike retningslinjer er å heve den vitenskapelige kompetansen til ikke-ekspertpublikum innen molekyler visualisering, som vil være spesielt relevant for kommunikasjon til befolkningen i forbindelse med folkehelseopplysning. All kode og empiriske funn utviklet i arbeidet med denne avhandlingen er åpen kildekode og tilgjengelig for gjenbruk av det vitenskapelige miljøet og offentligheten. Metodene og funnene presentert i denne avhandlingen danner et grunnlag for tverrfaglig biomedisinsk illustrasjon og visualiseringsforskning, og åpner flere muligheter for fortsatt arbeid med visualisering av fysiologiske prosesser.The overarching theme of this thesis is the cross-disciplinary application of medical illustration and visualization techniques to address challenges in exploring, analyzing, and communicating aspects of physiology to audiences with differing expertise. Describing the myriad biological processes occurring in living beings over time, the science of physiology is complex and critical to our understanding of how life works. It spans many spatio-temporal scales to combine and bridge the basic sciences (biology, physics, and chemistry) to medicine. Recent years have seen an explosion of new and finer-grained experimental and acquisition methods to characterize these data. The volume and complexity of these data necessitate effective visualizations to complement standard analysis practice. Visualization approaches must carefully consider and be adaptable to the user's main task, be it exploratory, analytical, or communication-oriented. This thesis contributes to the areas of theory, empirical findings, methods, applications, and research replicability in visualizing physiology. Our contributions open with a state-of-the-art report exploring the challenges and opportunities in visualization for physiology. This report is motivated by the need for visualization researchers, as well as researchers in various application domains, to have a centralized, multiscale overview of visualization tasks and techniques. Using a mixed-methods search approach, this is the first report of its kind to broadly survey the space of visualization for physiology. Our approach to organizing the literature in this report enables the lookup of topics of interest according to spatio-temporal scale. It further subdivides works according to any combination of three high-level visualization tasks: exploration, analysis, and communication. This provides an easily-navigable foundation for discussion and future research opportunities for audience- and task-appropriate visualization for physiology. From this report, we identify two key areas for continued research that begin narrowly and subsequently broaden in scope: (1) exploratory analysis of multifaceted physiology data for expert users, and (2) communication for experts and non-experts alike. Our investigation of multifaceted physiology data takes place over two studies. Each targets processes occurring at different spatio-temporal scales and includes a case study with experts to assess the applicability of our proposed method. At the molecular scale, we examine data from magnetic resonance spectroscopy (MRS), an advanced biochemical technique used to identify small molecules (metabolites) in living tissue that are indicative of metabolic pathway activity. Although highly sensitive and specific, the output of this modality is abstract and difficult to interpret. Our design study investigating the tasks and requirements for expert exploratory analysis of these data led to SpectraMosaic, a novel application enabling domain researchers to analyze any permutation of metabolites in ratio form for an entire cohort, or by sample region, individual, acquisition date, or brain activity status at the time of acquisition. A second approach considers the exploratory analysis of multidimensional physiological data at the opposite end of the spatio-temporal scale: population. An effective exploratory data analysis workflow critically must identify interesting patterns and relationships, which becomes increasingly difficult as data dimensionality increases. Although this can be partially addressed with existing dimensionality reduction techniques, the nature of these techniques means that subtle patterns may be lost in the process. In this approach, we describe DimLift, an iterative dimensionality reduction technique enabling user identification of interesting patterns and relationships that may lie subtly within a dataset through dimensional bundles. Key to this method is the user's ability to steer the dimensionality reduction technique to follow their own lines of inquiry. Our third question considers the crafting of visualizations for communication to audiences with different levels of expertise. It is natural to expect that experts in a topic may have different preferences and criteria to evaluate a visual communication relative to a non-expert audience. This impacts the success of an image in communicating a given scenario. Drawing from diverse techniques in biomedical illustration and visualization, we conducted an exploratory study of the criteria that audiences use when evaluating a biomedical process visualization targeted for communication. From this study, we identify opportunities for further convergence of biomedical illustration and visualization techniques for more targeted visual communication design. One opportunity that we discuss in greater depth is the development of semantically-consistent guidelines for the coloring of molecular scenes. The intent of such guidelines is to elevate the scientific literacy of non-expert audiences in the context of molecular visualization, which is particularly relevant to public health communication. All application code and empirical findings are open-sourced and available for reuse by the scientific community and public. The methods and findings presented in this thesis contribute to a foundation of cross-disciplinary biomedical illustration and visualization research, opening several opportunities for continued work in visualization for physiology.Doktorgradsavhandlin

A four-dimensional probabilistic atlas of the human brain

The authors describe the development of a four-dimensional atlas and reference system that includes both macroscopic and microscopic information on structure and function of the human brain in persons between the ages of 18 and 90 years. Given the presumed large but previously unquantified degree of structural and functional variance among normal persons in the human population, the basis for this atlas and reference system is probabilistic. Through the efforts of the International Consortium for Brain Mapping (ICBM), 7,000 subjects will be included in the initial phase of database and atlas development. For each subject, detailed demographic, clinical, behavioral, and imaging information is being collected. In addition, 5,800 subjects will contribute DNA for the purpose of determining genotype-phenotype-behavioral correlations. The process of developing the strategies, algorithms, data collection methods, validation approaches, database structures, and distribution of results is described in this report. Examples of applications of the approach are described for the normal brain in both adults and children as well as in patients with schizophrenia. This project should provide new insights into the relationship between microscopic and macroscopic structure and function in the human brain and should have important implications in basic neuroscience, clinical diagnostics, and cerebral disorders

Patient-specific numerical simulation of blood flow in pulmonary arteries with in-vivo validation

La comprensió i visualització detallada de la dinàmica de fluids al sistema cardiovascular és una àrea de recerca molt activa en biomedicina. Se sap que el flux sanguini juga un paper clau en el funcionament correcte del sistema cardiovascular i en la progressió de les patologies que l'afecten, per aquesta raó, la dinàmica de fluids computacional i les seves simulacions han anat cobrant importància en el camp de la Medicina Cardiovascular . Atesa la limitació dels mètodes d'imatge actuals, la dinàmica de fluids computacional ha esdevingut una eina poderosa per produir informació detallada i específica de cada pacient. En aquest treball final de grau, les dades específiques d'un pacient, obtingudes mitjançant una ressonància magnètica, han estat utilitzades per crear un model tridimensional, que s'ha utilitzat per dur a terme una simulació computacional del flux sanguini a l'artèria pulmonar, mitjançant l'ús del programari lliure SimVascular. Els principals resultats aconseguits, com el cabal volumètric durant el cicle cardíac o la distribució de velocitats, han estat analitzats i comparats (gràficament i numèricament) amb les dades in vivo del pacient, de manera que, observant la correlació entre tots dos, s'han pogut validar els resultats.La comprensión y visualización detallada de la dinámica de fluidos en el sistema cardiovascular es un área de investigación muy activa en biomedicina. Se sabe que el flujo sanguíneo juega un papel clave en el correcto funcionamiento del sistema cardiovascular y en la progresión de las patologías que le afectan, por esta razón, las simulaciones computacionales de dinámica de fluidos han ido cobrando importancia en el campo de la Medicina Cardiovascular. Dada la limitación de los métodos de imagen actuales, la dinámica de fluidos computacional se ha convertido en una herramienta poderosa para producir información detallada y específica de cada paciente en particular. En este trabajo final de grado, los datos específicos de un paciente, obtenidos mediante una resonancia magnética, han sido utilizados para crear un modelo tridimensional, que se han utilizado para llevar a cabo una simulación computacional del flujo sanguíneo en la arteria pulmonar, mediante el uso del software libre SimVascular. Los principales resultados obtenidos, como el caudal volumétrico durante el ciclo cardiaco o la distribución de velocidades, han sido analizados y comparados (gráfica y numéricamente) con los datos in vivo del paciente, de forma que, observando la correlación entre ambos, se han podido validar los resultadosUnderstanding and detailed visualization of fluid dynamics in the cardiovascular system has become a very active area of research in biomedicine. It is known that blood flow plays a key role in the proper functioning of the cardiovascular system and in the progression of the related pathologies. For this reason, computational fluid dynamics simulations have become increasingly important in the field of Cardiovascular Medicine. Given the limitation of current imaging methods, computational fluid dynamics has become a powerful tool for producing detailed, patient-specific information. In this final degree thesis, patient-specific data, obtained by magnetic resonance imaging, have been used to create a three-dimensional model, which has been used to perform a computational simulation of blood flow into the pulmonary artery, using open source software SimVascular. The principal obtained results, such as the volumetric flow during the cardiac cycle or the velocity distribution, have been analysed and compared (graphically and numerically) with the in vivo data of the patient, observing the correlation between the two, results have been validated

Comprehensive 4D velocity mapping of the heart and great vessels by cardiovascular magnetic resonance

<p>Abstract</p> <p>Background</p> <p>Phase contrast cardiovascular magnetic resonance (CMR) is able to measure all three directional components of the velocities of blood flow relative to the three spatial dimensions and the time course of the heart cycle. In this article, methods used for the acquisition, visualization, and quantification of such datasets are reviewed and illustrated.</p> <p>Methods</p> <p>Currently, the acquisition of 3D cine (4D) phase contrast velocity data, synchronized relative to both cardiac and respiratory movements takes about ten minutes or more, even when using parallel imaging and optimized pulse sequence design. The large resulting datasets need appropriate post processing for the visualization of multidirectional flow, for example as vector fields, pathlines or streamlines, or for retrospective volumetric quantification.</p> <p>Applications</p> <p>Multidirectional velocity acquisitions have provided 3D visualization of large scale flow features of the healthy heart and great vessels, and have shown altered patterns of flow in abnormal chambers and vessels. Clinically relevant examples include retrograde streams in atheromatous descending aortas as potential thrombo-embolic pathways in patients with cryptogenic stroke and marked variations of flow visualized in common aortic pathologies. Compared to standard clinical tools, 4D velocity mapping offers the potential for retrospective quantification of flow and other hemodynamic parameters.</p> <p>Conclusions</p> <p>Multidirectional, 3D cine velocity acquisitions are contributing to the understanding of normal and pathologically altered blood flow features. Although more rapid and user-friendly strategies for acquisition and analysis may be needed before 4D velocity acquisitions come to be adopted in routine clinical CMR, their capacity to measure multidirectional flows throughout a study volume has contributed novel insights into cardiovascular fluid dynamics in health and disease.</p

Index to NASA Tech Briefs, 1975

This index contains abstracts and four indexes--subject, personal author, originating Center, and Tech Brief number--for 1975 Tech Briefs