Transfer function design based on user selected samples for intuitive multivariate volume exploration

pre-printMultivariate volumetric datasets are important to both science and medicine. We propose a transfer function (TF) design approach based on user selected samples in the spatial domain to make multivariate volumetric data visualization more accessible for domain users. Specifically, the user starts the visualization by probing features of interest on slices and the data values are instantly queried by user selection. The queried sample values are then used to automatically and robustly generate high dimensional transfer functions (HDTFs) via kernel density estimation (KDE). Alternatively, 2D Gaussian TFs can be automatically generated in the dimensionality reduced space using these samples. With the extracted features rendered in the volume rendering view, the user can further refine these features using segmentation brushes. Interactivity is achieved in our system and different views are tightly linked. Use cases show that our system has been successfully applied for simulation and complicated seismic data sets

Virtual Reality Aided Mobile C-arm Positioning for Image-Guided Surgery

Image-guided surgery (IGS) is the minimally invasive procedure based on the pre-operative volume in conjunction with intra-operative X-ray images which are commonly captured by mobile C-arms for the confirmation of surgical outcomes. Although currently some commercial navigation systems are employed, one critical issue of such systems is the neglect regarding the radiation exposure to the patient and surgeons. In practice, when one surgical stage is finished, several X-ray images have to be acquired repeatedly by the mobile C-arm to obtain the desired image. Excessive radiation exposure may increase the risk of some complications. Therefore, it is necessary to develop a positioning system for mobile C-arms, and achieve one-time imaging to avoid the additional radiation exposure. In this dissertation, a mobile C-arm positioning system is proposed with the aid of virtual reality (VR). The surface model of patient is reconstructed by a camera mounted on the mobile C-arm. A novel registration method is proposed to align this model and pre-operative volume based on a tracker, so that surgeons can visualize the hidden anatomy directly from the outside view and determine a reference pose of C-arm. Considering the congested operating room, the C-arm is modeled as manipulator with a movable base to maneuver the image intensifier to the desired pose. In the registration procedure above, intensity-based 2D/3D registration is used to transform the pre-operative volume into the coordinate system of tracker. Although it provides a high accuracy, the small capture range hinders its clinical use due to the initial guess. To address such problem, a robust and fast initialization method is proposed based on the automatic tracking based initialization and multi-resolution estimation in frequency domain. This hardware-software integrated approach provides almost optimal transformation parameters for intensity-based registration. To determine the pose of mobile C-arm, high-quality visualization is necessary to locate the pathology in the hidden anatomy. A novel dimensionality reduction method based on sparse representation is proposed for the design of multi-dimensional transfer function in direct volume rendering. It not only achieves the similar performance to the conventional methods, but also owns the capability to deal with the large data sets

Doctor of Philosophy

dissertationVisualization and exploration of volumetric datasets has been an active area of research for over two decades. During this period, volumetric datasets used by domain users have evolved from univariate to multivariate. The volume datasets are typically explored and classified via transfer function design and visualized using direct volume rendering. To improve classification results and to enable the exploration of multivariate volume datasets, multivariate transfer functions emerge. In this dissertation, we describe our research on multivariate transfer function design. To improve the classification of univariate volumes, various one-dimensional (1D) or two-dimensional (2D) transfer function spaces have been proposed; however, these methods work on only some datasets. We propose a novel transfer function method that provides better classifications by combining different transfer function spaces. Methods have been proposed for exploring multivariate simulations; however, these approaches are not suitable for complex real-world datasets and may be unintuitive for domain users. To this end, we propose a method based on user-selected samples in the spatial domain to make complex multivariate volume data visualization more accessible for domain users. However, this method still requires users to fine-tune transfer functions in parameter space transfer function widgets, which may not be familiar to them. We therefore propose GuideME, a novel slice-guided semiautomatic multivariate volume exploration approach. GuideME provides the user, an easy-to-use, slice-based user interface that suggests the feature boundaries and allows the user to select features via click and drag, and then an optimal transfer function is automatically generated by optimizing a response function. Throughout the exploration process, the user does not need to interact with the parameter views at all. Finally, real-world multivariate volume datasets are also usually of large size, which is larger than the GPU memory and even the main memory of standard work stations. We propose a ray-guided out-of-core, interactive volume rendering and efficient query method to support large and complex multivariate volumes on standard work stations

직접 볼륨 렌더링의 전이 함수 설계에 관한 연구

학위논문 (박사)-- 서울대학교 대학원 : 전기·컴퓨터공학부, 2017. 2. 신영길.Although direct volume rendering (DVR) has become a commodity, the design of transfer functions still a challenge. Transfer functions which map data values to optical properties (i.e., colors and opacities) highlight features of interests as well as hide unimportant regions, dramatically impacting on the quality of the visualization. Therefore, for the effective rendering of interesting features, the design of transfer functions is very important and challenging task. Furthermore, manipulation of these transfer functions is tedious and time-consuming task. In this paper, we propose a 3D spatial field for accurately identifying and visually distinguishing interesting features as well as a mechanism for data exploration using multi-dimensional transfer function. First, we introduce a 3D spatial field for the effective visualization of constricted tubular structures, called as a stenosis map which stores the degree of constriction at each voxel. Constrictions within tubular structures are quantified by using newly proposed measures (i.e., line similarity measure and constriction measure) based on the localized structure analysis, and classified with a proposed transfer function mapping the degree of constriction to color and opacity. We show the application results of our method to the visualization of coronary artery stenoses. We present performance evaluations using twenty-eight clinical datasets, demonstrating high accuracy and efficacy of our proposed method. Second, we propose a new multi-dimensional transfer function which incorporates texture features calculated from statistically homogeneous regions. This approach employs parallel coordinates to provide an intuitive interface for exploring a new multi-dimensional transfer function space. Three specific ways to use a new transfer function based on parallel coordinates enables the effective exploration of large and complex datasets. We present a mechanism for data exploration with a new transfer function space, demonstrating the practical efficacy of our proposed method. Through a study on transfer function design for DVR, we propose two useful approaches. First method to saliently visualize the constrictions within tubular structures and interactively adjust the visual appearance of the constrictions delivers a substantial aid in radiologic practice. Furthermore, second method to classify objects with our intuitive interface utilizing parallel coordinates proves to be a powerful tool for complex data exploration.Chapter 1 Introduction 1 1.1 Background 1 1.1.1 Volume rendering 1 1.1.2 Computer-aided diagnosis 3 1.1.3 Parallel coordinates 5 1.2 Problem statement 8 1.3 Main contribution 12 1.4 Organization of dissertation 16 Chapter 2 Related Work 17 2.1 Transfer function 17 2.1.1 Transfer functions based on spatial characteristics 17 2.1.2 Opacity modulation techniques 20 2.1.3 Multi-dimensional transfer functions 22 2.1.4 Manipulation mechanism for transfer functions 25 2.2 Coronary artery stenosis 28 2.3 Parallel coordinates 32 Chapter 3 Volume Visualization of Constricted Tubular Structures 36 3.1 Overview 36 3.2 Localized structure analysis 37 3.3 Stenosis map 39 3.3.1 Overview 39 3.3.2 Detection of tubular structures 40 3.3.3 Stenosis map computation 49 3.4 Stenosis-based classification 52 3.4.1 Overview 52 3.4.2 Constriction-encoded volume rendering 52 3.4.3 Opacity modulation based on constriction 54 3.5 GPU implementation 57 3.6 Experimental results 59 3.6.1 Clinical data preparation 59 3.6.2 Qualitative evaluation 60 3.6.3 Quantitative evaluation 63 3.6.4 Comparison with previous methods 66 3.6.5 Parameter study 69 Chapter 4 Interactive Multi-Dimensional Transfer Function Using Adaptive Block Based Feature Analysis 73 4.1 Overview 73 4.2 Extraction of statistical features 74 4.3 Extraction of texture features 78 4.4 Multi-dimensional transfer function design using parallel coordinates 81 4.5 Experimental results 86 Chapter 5 Conclusion 90 Bibliography 92 초 록 107Docto