Magnitude-based streamlines seed point selection for unsteady flow visualization

Flow visualization is a method utilized to obtain information from flow data sets. Proper blood flow visualization can assist surgeons in treating the patients. However, the main problem in visualizing the blood flow inside the aorta is the unsteady blood flow rate. Thus, an unsteady flow visualization method is required to show the blood flow clearly. Unfortunately, streamlines cannot be used by time-dependent flow visualization. This research aims to propose an improvement for the current streamline visualization technique and appearance by implementing an improved streamline generation method based on structured grid vector data to visualize the unsteady flow. The research methodology follows a comparative study method with the Evenly-Spaced Seed Point placement (ESSP) method as the benchmark. Magnitude-Based Seed Point placement (MBSP) and selective streamlines enhancement are introduced to produce longer, uniform, and clutter-free streamlines output. A total of 20 visualization results are produced with different streamlines separation distance. Results are then evaluated by comparing streamlines count and uniformity score. Subsequently, survey and expert reviews are carried out to strengthen the analysis. Survey questions are distributed to respondents that have data visualization knowledge background in order to get feedback related to streamlines uniformity and enhancement. In addition, experts review is conducted to get feedback based on current researches and techniques utilized in the related fields. Results indicate that streamlines count for MBSP are higher, but the differences are neglectable. Uniformity analysis shows good performance; with 80% of the MBSP results have better uniformity. Survey responses show 65% of respondents agreed MBSP results have better uniformity compared to ESSP. Majority of the respondents (92%) agreed that selective streamlines is a better approach. Experts review highlights that MBSP can distribute streamlines better in 3-dimension space compared to ESSP. Two significant findings are identified in this research: magnitude is proven to be an important input to locate seed points; and selective streamlines enhancement is a more effective approach as compared to global streamlines enhancement

4D MRI flow coupled to physics-based fluid simulation for blood-flow visualization

Modern MRI measurements deliver volumetric and time-varying blood-flow data of unprecedented quality. Visual analysis of these data potentially leads to a better diagnosis and risk assessment of various cardiovascular diseases. Recent advances have improved the speed and quality of the imaging data considerably. Nevertheless, the data remains compromised by noise and a lack of spatiotemporal resolution. Besides imaging data, also numerical simulations are employed. These are based on mathematical models of specific features of physical reality. However, these models require realistic parameters and boundary conditions based on measurements. We propose to use data assimilation to bring measured data and physically-based simulation together, and to harness the mutual benefits. The accuracy and noise robustness of the coupled approach is validated using an analytic flow field. Furthermore, we present a comparative visualization that conveys the differences between using conventional interpolation and our coupled approach

4D MRI flow coupled to physics-based fluid simulation for blood-flow visualization

Modern MRI measurements deliver volumetric and time-varying blood-flow data of unprecedented quality. Visual analysis of these data potentially leads to a better diagnosis and risk assessment of various cardiovascular diseases. Recent advances have improved the speed and quality of the imaging data considerably. Nevertheless, the data remains compromised by noise and a lack of spatiotemporal resolution. Besides imaging data, also numerical simulations are employed. These are based on mathematical models of specific features of physical reality. However, these models require realistic parameters and boundary conditions based on measurements. We propose to use data assimilation to bring measured data and physically-based simulation together, and to harness the mutual benefits. The accuracy and noise robustness of the coupled approach is validated using an analytic flow field. Furthermore, we present a comparative visualization that conveys the differences between using conventional interpolation and our coupled approach

Novel Algorithms for Merging Computational Fluid Dynamics and 4D Flow MRI

Time-resolved three-dimensional spatial encoding combined with three-directional velocity-encoded phase contrast magnetic resonance imaging (termed as 4D flow MRI), can provide valuable information for diagnosis, treatment, and monitoring of vascular diseases. The accuracy of this technique, however, is limited by errors in flow estimation due to acquisition noise as well as systematic errors. Furthermore, available spatial resolution is limited to 1.5mm - 3mm and temporal resolution is limited to 30-40ms. This is often grossly inadequate to resolve flow details in small arteries, such as those in cerebral circulation. Recently, there have been efforts to address the limitations of the spatial and temporal resolution of MR flow imaging through the use of computational fluid dynamics (CFD). While CFD is capable of providing essentially unlimited spatial and temporal resolution, numerical results are very sensitive to errors in estimation of the flow boundary conditions. In this work, we present three novel techniques that combine CFD with 4D flow MRI measurements in order to address the resolution and noise issues. The first technique is a variant of the Kalman Filter state estimator called the Ensemble Kalman Filter (EnKF). In this technique, an ensemble of patient-specific CFD solutions are used to compute filter gains. These gains are then used in a predictor-corrector scheme to not only denoise the data but also increase its temporal and spatial resolution. The second technique is based on proper orthogonal decomposition and ridge regression (POD-rr). The POD method is typically used to generate reduced order models (ROMs) in closed control applications of large degree of freedom systems that result from discretization of governing partial differential equations (PDE). The POD-rr process results in a set of basis functions (vectors), that capture the local space of solutions of the PDE in question. In our application, the basis functions are generated from an ensemble of patient-specific CFD solutions whose boundary conditions are estimated from 4D flow MRI data. The CFD solution that should be most closely representing the actual flow is generated by projecting 4D flow MRI data onto the basis vectors followed by reconstruction in both MRI and CFD resolution. The rr algorithm was used for between resolution mapping. Despite the accuracy of using rr as the mapping step, due to manual adjustment of a coefficient in the algorithm we developed the third algorithm. In this step, the rr algorithm was substituded with a dynamic mode decomposition algorithm to preserve the robustness. These algorithms have been implemented and tested using a numerical model of the flow in a cerebral aneurysm. Solutions at time intervals corresponding to the 4D flow MRI temporal resolution were collected and downsampled to the spatial resolution of the imaging data. A simulated acquisition noise was then added in k-space. Finally, the simulated data affected by noise were used as an input to the merging algorithms. Rigorous comparison to state-of-the-art techniques were conducted to assess the accuracy and performance of the proposed method. The results provided denoised flow fields with less than 1\% overall error for different signal-to-noise ratios. At the end, a small cohort of three patients were corrected and the data were reconstructed using different methods, the wall shear stress (WSS) was calculated using different reconstructed data and the results were compared. As it has been shown in chapter 5, the calculated WSS using different methods results in mutual high and low shear stress regions, however, the exact value and patterns are significantly different

From Molecules to the Masses : Visual Exploration, Analysis, and Communication of Human Physiology

Det overordnede målet med denne avhandlingen er tverrfaglig anvendelse av medisinske illustrasjons- og visualiseringsteknikker for å utforske, analysere og formidle aspekter ved fysiologi til publikum med ulik faglig nivå og bakgrunn. Fysiologi beskriver de biologiske prosessene som skjer i levende vesener over tid. Vitenskapen om fysiologi er kompleks, men samtidig kritisk for vår forståelse av hvordan levende organismer fungerer. Fysiologi dekker en stor bredde romlig-temporale skalaer og fordrer behovet for å kombinere og bygge bro mellom basalfagene (biologi, fysikk og kjemi) og medisin. De senere årene har det vært en eksplosjon av nye, avanserte eksperimentelle metoder for å detektere og karakterisere fysiologiske data. Volumet og kompleksiteten til fysiologiske data krever effektive strategier for visualisering for å komplementere dagens standard analyser. Hvilke tilnærminger som benyttes i visualiseringen må nøye balanseres og tilpasses formålet med bruken av dataene, enten dette er for å utforske dataene, analysere disse eller kommunisere og presentere dem. Arbeidet i denne avhandlingen bidrar med ny kunnskap innen teori, empiri, anvendelse og reproduserbarhet av visualiseringsmetoder innen fysiologi. Først i avhandlingen er en rapport som oppsummerer og utforsker dagens kunnskap om muligheter og utfordringer for visualisering innen fysiologi. Motivasjonen for arbeidet er behovet forskere innen visualiseringsfeltet, og forskere i ulike anvendelsesområder, har for en sammensatt oversikt over flerskala visualiseringsoppgaver og teknikker. Ved å bruke søk over et stort spekter av metodiske tilnærminger, er dette den første rapporten i sitt slag som kartlegger visualiseringsmulighetene innen fysiologi. I rapporten er faglitteraturen oppsummert slik at det skal være enkelt å gjøre oppslag innen ulike tema i rom-og-tid-skalaen, samtidig som litteraturen er delt inn i de tre høynivå visualiseringsoppgavene data utforsking, analyse og kommunikasjon. Dette danner et enkelt grunnlag for å navigere i litteraturen i feltet og slik danner rapporten et godt grunnlag for diskusjon og forskningsmuligheter innen feltet visualisering og fysiologi. Basert på arbeidet med rapporten var det særlig to områder som det er ønskelig for oss å fortsette å utforske: (1) utforskende analyse av mangefasetterte fysiologidata for ekspertbrukere, og (2) kommunikasjon av data til både eksperter og ikke-eksperter. Arbeidet vårt av mangefasetterte fysiologidata er oppsummert i to studier i avhandlingen. Hver studie omhandler prosesser som foregår på forskjellige romlig-temporale skalaer og inneholder konkrete eksempler på anvendelse av metodene vurdert av eksperter i feltet. I den første av de to studiene undersøkes konsentrasjonen av molekylære substanser (metabolitter) ut fra data innsamlet med magnetisk resonansspektroskopi (MRS), en avansert biokjemisk teknikk som brukes til å identifisere metabolske forbindelser i levende vev. Selv om MRS kan ha svært høy sensitivitet og spesifisitet i medisinske anvendelser, er analyseresultatene fra denne modaliteten abstrakte og vanskelige å forstå også for medisinskfaglige eksperter i feltet. Vår designstudie som undersøkte oppgavene og kravene til ekspertutforskende analyse av disse dataene førte til utviklingen av SpectraMosaic. Dette er en ny applikasjon som gjør det mulig for domeneeksperter å analysere konsentrasjonen av metabolitter normalisert for en hel kohort, eller etter prøveregion, individ, opptaksdato, eller status på hjernens aktivitetsnivå ved undersøkelsestidspunktet. I den andre studien foreslås en metode for å utføre utforskende analyser av flerdimensjonale fysiologiske data i motsatt ende av den romlig-temporale skalaen, nemlig på populasjonsnivå. En effektiv arbeidsflyt for utforskende dataanalyse må kritisk identifisere interessante mønstre og relasjoner, noe som blir stadig vanskeligere når dimensjonaliteten til dataene øker. Selv om dette delvis kan løses med eksisterende reduksjonsteknikker er det alltid en fare for at subtile mønstre kan gå tapt i reduksjonsprosessen. Isteden presenterer vi i studien DimLift, en iterativ dimensjonsreduksjonsteknikk som muliggjør brukeridentifikasjon av interessante mønstre og relasjoner som kan ligge subtilt i et datasett gjennom dimensjonale bunter. Nøkkelen til denne metoden er brukerens evne til å styre dimensjonalitetsreduksjonen slik at den følger brukerens egne undersøkelseslinjer. For videre å undersøke kommunikasjon til eksperter og ikke-eksperter, studeres i neste arbeid utformingen av visualiseringer for kommunikasjon til publikum med ulike nivåer av ekspertnivå. Det er naturlig å forvente at eksperter innen et emne kan ha ulike preferanser og kriterier for å vurdere en visuell kommunikasjon i forhold til et ikke-ekspertpublikum. Dette påvirker hvor effektivt et bilde kan benyttes til å formidle en gitt scenario. Med utgangspunkt i ulike teknikker innen biomedisinsk illustrasjon og visualisering, gjennomførte vi derfor en utforskende studie av kriteriene som publikum bruker når de evaluerer en biomedisinsk prosessvisualisering målrettet for kommunikasjon. Fra denne studien identifiserte vi muligheter for ytterligere konvergens av biomedisinsk illustrasjon og visualiseringsteknikker for mer målrettet visuell kommunikasjonsdesign. Særlig beskrives i større dybde utviklingen av semantisk konsistente retningslinjer for farging av molekylære scener. Hensikten med slike retningslinjer er å heve den vitenskapelige kompetansen til ikke-ekspertpublikum innen molekyler visualisering, som vil være spesielt relevant for kommunikasjon til befolkningen i forbindelse med folkehelseopplysning. All kode og empiriske funn utviklet i arbeidet med denne avhandlingen er åpen kildekode og tilgjengelig for gjenbruk av det vitenskapelige miljøet og offentligheten. Metodene og funnene presentert i denne avhandlingen danner et grunnlag for tverrfaglig biomedisinsk illustrasjon og visualiseringsforskning, og åpner flere muligheter for fortsatt arbeid med visualisering av fysiologiske prosesser.The overarching theme of this thesis is the cross-disciplinary application of medical illustration and visualization techniques to address challenges in exploring, analyzing, and communicating aspects of physiology to audiences with differing expertise. Describing the myriad biological processes occurring in living beings over time, the science of physiology is complex and critical to our understanding of how life works. It spans many spatio-temporal scales to combine and bridge the basic sciences (biology, physics, and chemistry) to medicine. Recent years have seen an explosion of new and finer-grained experimental and acquisition methods to characterize these data. The volume and complexity of these data necessitate effective visualizations to complement standard analysis practice. Visualization approaches must carefully consider and be adaptable to the user's main task, be it exploratory, analytical, or communication-oriented. This thesis contributes to the areas of theory, empirical findings, methods, applications, and research replicability in visualizing physiology. Our contributions open with a state-of-the-art report exploring the challenges and opportunities in visualization for physiology. This report is motivated by the need for visualization researchers, as well as researchers in various application domains, to have a centralized, multiscale overview of visualization tasks and techniques. Using a mixed-methods search approach, this is the first report of its kind to broadly survey the space of visualization for physiology. Our approach to organizing the literature in this report enables the lookup of topics of interest according to spatio-temporal scale. It further subdivides works according to any combination of three high-level visualization tasks: exploration, analysis, and communication. This provides an easily-navigable foundation for discussion and future research opportunities for audience- and task-appropriate visualization for physiology. From this report, we identify two key areas for continued research that begin narrowly and subsequently broaden in scope: (1) exploratory analysis of multifaceted physiology data for expert users, and (2) communication for experts and non-experts alike. Our investigation of multifaceted physiology data takes place over two studies. Each targets processes occurring at different spatio-temporal scales and includes a case study with experts to assess the applicability of our proposed method. At the molecular scale, we examine data from magnetic resonance spectroscopy (MRS), an advanced biochemical technique used to identify small molecules (metabolites) in living tissue that are indicative of metabolic pathway activity. Although highly sensitive and specific, the output of this modality is abstract and difficult to interpret. Our design study investigating the tasks and requirements for expert exploratory analysis of these data led to SpectraMosaic, a novel application enabling domain researchers to analyze any permutation of metabolites in ratio form for an entire cohort, or by sample region, individual, acquisition date, or brain activity status at the time of acquisition. A second approach considers the exploratory analysis of multidimensional physiological data at the opposite end of the spatio-temporal scale: population. An effective exploratory data analysis workflow critically must identify interesting patterns and relationships, which becomes increasingly difficult as data dimensionality increases. Although this can be partially addressed with existing dimensionality reduction techniques, the nature of these techniques means that subtle patterns may be lost in the process. In this approach, we describe DimLift, an iterative dimensionality reduction technique enabling user identification of interesting patterns and relationships that may lie subtly within a dataset through dimensional bundles. Key to this method is the user's ability to steer the dimensionality reduction technique to follow their own lines of inquiry. Our third question considers the crafting of visualizations for communication to audiences with different levels of expertise. It is natural to expect that experts in a topic may have different preferences and criteria to evaluate a visual communication relative to a non-expert audience. This impacts the success of an image in communicating a given scenario. Drawing from diverse techniques in biomedical illustration and visualization, we conducted an exploratory study of the criteria that audiences use when evaluating a biomedical process visualization targeted for communication. From this study, we identify opportunities for further convergence of biomedical illustration and visualization techniques for more targeted visual communication design. One opportunity that we discuss in greater depth is the development of semantically-consistent guidelines for the coloring of molecular scenes. The intent of such guidelines is to elevate the scientific literacy of non-expert audiences in the context of molecular visualization, which is particularly relevant to public health communication. All application code and empirical findings are open-sourced and available for reuse by the scientific community and public. The methods and findings presented in this thesis contribute to a foundation of cross-disciplinary biomedical illustration and visualization research, opening several opportunities for continued work in visualization for physiology.Doktorgradsavhandlin