Perceptual Quality Evaluation of 3D Triangle Mesh: A Technical Review

© 2018 IEEE. During mesh processing operations (e.g. simplifications, compression, and watermarking), a 3D triangle mesh is subject to various visible distortions on mesh surface which result in a need to estimate visual quality. The necessity of perceptual quality evaluation is already established, as in most cases, human beings are the end users of 3D meshes. To measure such kinds of distortions, the metrics that consider geometric measures integrating human visual system (HVS) is called perceptual quality metrics. In this paper, we direct an expansive study on 3D mesh quality evaluation mostly focusing on recently proposed perceptual based metrics. We limit our study on greyscale static mesh evaluation and attempt to figure out the most workable method for real-Time evaluation by making a quantitative comparison. This paper also discusses in detail how to evaluate objective metric's performance with existing subjective databases. In this work, we likewise research the utilization of the psychometric function to expel non-linearity between subjective and objective values. Finally, we draw a comparison among some selected quality metrics and it shows that curvature tensor based quality metrics predicts consistent result in terms of correlation

A perceptual quality metric for 3D triangle meshes based on spatial pooling

© 2018, Higher Education Press and Springer-Verlag GmbH Germany, part of Springer Nature. In computer graphics, various processing operations are applied to 3D triangle meshes and these processes often involve distortions, which affect the visual quality of surface geometry. In this context, perceptual quality assessment of 3D triangle meshes has become a crucial issue. In this paper, we propose a new objective quality metric for assessing the visual difference between a reference mesh and a corresponding distorted mesh. Our analysis indicates that the overall quality of a distorted mesh is sensitive to the distortion distribution. The proposed metric is based on a spatial pooling strategy and statistical descriptors of the distortion distribution. We generate a perceptual distortion map for vertices in the reference mesh while taking into account the visual masking effect of the human visual system. The proposed metric extracts statistical descriptors from the distortion map as the feature vector to represent the overall mesh quality. With the feature vector as input, we adopt a support vector regression model to predict the mesh quality score.We validate the performance of our method with three publicly available databases, and the comparison with state-of-the-art metrics demonstrates the superiority of our method. Experimental results show that our proposed method achieves a high correlation between objective assessment and subjective scores

A new mesh visual quality metric using saliency weighting-based pooling strategy

© 2018 Elsevier Inc. Several metrics have been proposed to assess the visual quality of 3D triangular meshes during the last decade. In this paper, we propose a mesh visual quality metric by integrating mesh saliency into mesh visual quality assessment. We use the Tensor-based Perceptual Distance Measure metric to estimate the local distortions for the mesh, and pool local distortions into a quality score using a saliency weighting-based pooling strategy. Three well-known mesh saliency detection methods are used to demonstrate the superiority and effectiveness of our metric. Experimental results show that our metric with any of three saliency maps performs better than state-of-the-art metrics on the LIRIS/EPFL general-purpose database. We generate a synthetic saliency map by assembling salient regions from individual saliency maps. Experimental results reveal that the synthetic saliency map achieves better performance than individual saliency maps, and the performance gain is closely correlated with the similarity between the individual saliency maps

T4DT: Tensorizing Time for Learning Temporal 3D Visual Data

Unlike 2D raster images, there is no single dominant representation for 3D visual data processing. Different formats like point clouds, meshes, or implicit functions each have their strengths and weaknesses. Still, grid representations such as signed distance functions have attractive properties also in 3D. In particular, they offer constant-time random access and are eminently suitable for modern machine learning. Unfortunately, the storage size of a grid grows exponentially with its dimension. Hence they often exceed memory limits even at moderate resolution. This work explores various low-rank tensor formats, including the Tucker, tensor train, and quantics tensor train decompositions, to compress time-varying 3D data. Our method iteratively computes, voxelizes, and compresses each frame's truncated signed distance function and applies tensor rank truncation to condense all frames into a single, compressed tensor that represents the entire 4D scene. We show that low-rank tensor compression is extremely compact to store and query time-varying signed distance functions. It significantly reduces the memory footprint of 4D scenes while surprisingly preserving their geometric quality. Unlike existing iterative learning-based approaches like DeepSDF and NeRF, our method uses a closed-form algorithm with theoretical guarantees

Patient-specific modellling of cortical spreading depression applied to migraine studies.

254 p.-La migraña es un trastorno neurológico muy común. Un tercio de los pacientes que sufren migraña experimentan lo que se denomina aura, una serie de alteraciones sensoriales que preceden al típico dolor de cabeza unilateral. Diversos estudios apuntan a la existencia de una correlación entre el aura visual y la depresión cortical propagada (DCP), una onda de despolarización que tiene su origen en el córtex visual para propagarse, a continuación, por todo el córtex hacia las zonas periféricas. La complejidad y la elevada especificidad de las características del córtex cerebral sugieren que la geometría podría tener un impacto significativo en la propagación de la DCP. En esta tesis hemos combinado dos modelos existentes: un modelo neurológico pormenorizado para el componente electrofisiológico de la DCP y un modelo de reacción-difusión que tiene en consideración la difusión del potasio, el impulsor de la propagación de la DCP. Durante el proceso, hemos integrado dos aspectos de la DCP que tienen lugar en diferentes escalas de tiempo: la dinámica electrofisiológica seguiría un patrón temporal del orden de milisegundos, mientras que la dinámica del potasio extracelular que acciona las funciones de propagación de la DCP se mediría en una escala de minutos. Como resultado, obtendremos un modelo multiescalar EDP-EDO. Asimismo, hemos incorporado los datos específicos del paciente en el modelo DCP: (i) la geometría cerebral específica de un paciente obtenida a través de resonancia magnética, y (ii) los tensores de conductividad personalizados obtenidos a través de diffusion tensor images. A fin de estudiar el papel que desempeña la geometría en la propagación de la DCP, hemos definido las cantidades de interés (CdI) relacionadas con la geometría y las que dependen de la DCP y las hemos evaluado en dos casos prácticos. Si bien la geometría no parece tener un impacto significativo en la propagación de la DCP, algunas CdI han resultado ser unas candidatas muy prometedoras para facilitar la clasificación de individuos sanos y pacientes con migraña. Finalmente, para justificar la carencia de datos experimentales para la validación y selección de los parámetros del modelo, hemos aplicado diversas técnicas de cuantificación de la incertidumbre al modelo DCP y hemos analizado el impacto de las diversas elecciones de parámetros en el resultado del modelo.Migraine is a common neurological disorder and one-third of migraine patients suffer from migraine aura, a perceptual disturbance preceding the typically unilateral headache. Cortical spreading depression (CSD), a depolarisation wave that originates in the visual cortex and propagates across the cortex to the peripheral areas, has been suggested as a correlate of visual aura by several studies. The complex and highly individual-specific characteristics of the brain cortex suggest that the geometry might have a significant impact on CSD propagation. In this thesis, we combine two existing models, a detailed neurological model for the electrophysiological component of CSD and a reaction-diffusion model accounting for the potassium diffusion, the driving force of CSD propagation. In the process, we integrate two aspects of CSD that occur at different time scales: the electrophysiological dynamics features a temporal scale in the order of milliseconds, while the extracellular potassium dynamics that triggers CSD propagation features is on the scale of minutes. As a result we obtain a multi-scale PDE-ODE model. In addition, we incorporate patient-specific data in the CSD model: (i) a patient-specific brain geometry obtained from magnetic resonance imaging, and (ii) personalised conductivity tensors derived from diffusion tensor imaging data. To study the role of the geometry in CSD propagation, we define geometric and CSD-dependent quantities of interest (QoI) that we evaluate in two case studies. Even though the geometry does not seem to have a major impact on the CSD propagation, some QoI are promising candidates to aid in the classification of healthy individuals and migraine patients. Finally, to account for the lack of experimental data for validation and selection of the model parameters, we apply different techniques of uncertainty quantification to the CSD model and analyse the impact of various parameter choices on the model outcom

Patient-specific modelling of cortical spreading depression applied to migraine studies

Migraine is a common neurological disorder and one-third of migraine patients suffer from migraine aura, a perceptual disturbance preceding the typically unilateral headache. Cortical spreading depression (CSD), a depolarisation wave that originates in the visual cortex and propagates across the cortex to the peripheral areas, has been suggested as a correlate of visual aura by several studies. The complex and highly individual-specific characteristics of the brain cortex suggest that the geometry might have a significant impact on CSD propagation. In this thesis, we combine two existing models, a detailed neurological model for the electrophysiological component of CSD and a reaction-diffusion model accounting for the potassium diffusion, the driving force of CSD propagation. In the process, we integrate two aspects of CSD that occur at different time scales: the electrophysiological dynamics features a temporal scale in the order of milliseconds, while the extracellular potassium dynamics that triggers CSD propagation features is on the scale of minutes. As a result we obtain a multi-scale PDE-ODE model. In addition, we incorporate patient-specific data in the CSD model: (i) a patient-specific brain geometry obtained from magnetic resonance imaging, and (ii) personalised conductivity tensors derived from diffusion tensor imaging data. To study the role of the geometry in CSD propagation, we define geometric and CSD-dependent quantities of interest (QoI) that we evaluate in two case studies. Even though the geometry does not seem to have a major impact on the CSD propagation, some QoI are promising candidates to aid in the classification of healthy individuals and migraine patients. Finally, to account for the lack of experimental data for validation and selection of the model parameters, we apply different techniques of uncertainty quantification to the CSD model and analyse the impact of various parameter choices on the model outcome

An evaluation method for multiview surface reconstruction algorithms

We propose a new method...

Visual Exploration And Information Analytics Of High-Dimensional Medical Images

Data visualization has transformed how we analyze increasingly large and complex data sets. Advanced visual tools logically represent data in a way that communicates the most important information inherent within it and culminate the analysis with an insightful conclusion. Automated analysis disciplines - such as data mining, machine learning, and statistics - have traditionally been the most dominant fields for data analysis. It has been complemented with a near-ubiquitous adoption of specialized hardware and software environments that handle the storage, retrieval, and pre- and postprocessing of digital data. The addition of interactive visualization tools allows an active human participant in the model creation process. The advantage is a data-driven approach where the constraints and assumptions of the model can be explored and chosen based on human insight and confirmed on demand by the analytic system. This translates to a better understanding of data and a more effective knowledge discovery. This trend has become very popular across various domains, not limited to machine learning, simulation, computer vision, genetics, stock market, data mining, and geography. In this dissertation, we highlight the role of visualization within the context of medical image analysis in the field of neuroimaging. The analysis of brain images has uncovered amazing traits about its underlying dynamics. Multiple image modalities capture qualitatively different internal brain mechanisms and abstract it within the information space of that modality. Computational studies based on these modalities help correlate the high-level brain function measurements with abnormal human behavior. These functional maps are easily projected in the physical space through accurate 3-D brain reconstructions and visualized in excellent detail from different anatomical vantage points. Statistical models built for comparative analysis across subject groups test for significant variance within the features and localize abnormal behaviors contextualizing the high-level brain activity. Currently, the task of identifying the features is based on empirical evidence, and preparing data for testing is time-consuming. Correlations among features are usually ignored due to lack of insight. With a multitude of features available and with new emerging modalities appearing, the process of identifying the salient features and their interdependencies becomes more difficult to perceive. This limits the analysis only to certain discernible features, thus limiting human judgments regarding the most important process that governs the symptom and hinders prediction. These shortcomings can be addressed using an analytical system that leverages data-driven techniques for guiding the user toward discovering relevant hypotheses. The research contributions within this dissertation encompass multidisciplinary fields of study not limited to geometry processing, computer vision, and 3-D visualization. However, the principal achievement of this research is the design and development of an interactive system for multimodality integration of medical images. The research proceeds in various stages, which are important to reach the desired goal. The different stages are briefly described as follows: First, we develop a rigorous geometry computation framework for brain surface matching. The brain is a highly convoluted structure of closed topology. Surface parameterization explicitly captures the non-Euclidean geometry of the cortical surface and helps derive a more accurate registration of brain surfaces. We describe a technique based on conformal parameterization that creates a bijective mapping to the canonical domain, where surface operations can be performed with improved efficiency and feasibility. Subdividing the brain into a finite set of anatomical elements provides the structural basis for a categorical division of anatomical view points and a spatial context for statistical analysis. We present statistically significant results of our analysis into functional and morphological features for a variety of brain disorders. Second, we design and develop an intelligent and interactive system for visual analysis of brain disorders by utilizing the complete feature space across all modalities. Each subdivided anatomical unit is specialized by a vector of features that overlap within that element. The analytical framework provides the necessary interactivity for exploration of salient features and discovering relevant hypotheses. It provides visualization tools for confirming model results and an easy-to-use interface for manipulating parameters for feature selection and filtering. It provides coordinated display views for visualizing multiple features across multiple subject groups, visual representations for highlighting interdependencies and correlations between features, and an efficient data-management solution for maintaining provenance and issuing formal data queries to the back end