Affective colormap design for accurate visual comprehension in industrial tomography

The design of colormaps can help tomography operators obtain accurate visual compre-hension, thereby assisting safety-critical decisions. The research presented here is about deploying colormaps that promote the best affective responses for industrial microwave tomography (MWT). To answer the two research questions related to our study, we firstly conducted a quantitative analysis of 11 frequently-used colormaps on a segmentation task. Secondly, we presented the same colormaps within a crowdsourced study comprising two parts to verify the quantitative outcomes. The first part encoded affective responses from participants into a prevailing four-quadrant valence–arousal grid; the second part recorded participant ratings towards the accuracy of each colormap on MWT segmentation. We concluded that three colormaps are the best suited in the context of MWT tasks. We also found that the colormaps triggering emotions in the positive–exciting quadrant can facilitate more accurate visual comprehension than other affect-related quadrants. A synthetic colormap design guideline was consequently proposed

The Magic of Vision: Understanding What Happens in the Process

How important is the human vision? Simply speaking, it is central for domain\ua0related users to understand a design, a framework, a process, or an application\ua0in terms of human-centered cognition. This thesis focuses on facilitating visual\ua0comprehension for users working with specific industrial processes characterized\ua0by tomography. The thesis illustrates work that was done during the past two\ua0years within three application areas: real-time condition monitoring, tomographic\ua0image segmentation, and affective colormap design, featuring four research papers\ua0of which three published and one under review.The first paper provides effective deep learning algorithms accompanied by\ua0comparative studies to support real-time condition monitoring for a specialized\ua0microwave drying process for porous foams being taken place in a confined chamber.\ua0The tools provided give its users a capability to gain visually-based insights\ua0and understanding for specific processes. We verify that our state-of-the-art\ua0deep learning techniques based on infrared (IR) images significantly benefit condition\ua0monitoring, providing an increase in fault finding accuracy over conventional\ua0methods. Nevertheless, we note that transfer learning and deep residual network\ua0techniques do not yield increased performance over normal convolutional neural\ua0networks in our case.After a drying process, there will be some outputted images which are reconstructed\ua0by sensor data, such as microwave tomography (MWT) sensor. Hence,\ua0how to make users visually judge the success of the process by referring to the\ua0outputted MWT images becomes the core task. The second paper proposes an\ua0automatic segmentation algorithm named MWTS-KM to visualize the desired low\ua0moisture areas of the foam used in the whole process on the MWT images, effectively\ua0enhance users\u27understanding of tomographic image data. We also prove its\ua0performance is superior to two other preeminent methods through a comparative\ua0study.To better boost human comprehension among the reconstructed MWT image,\ua0a colormap deisgn research based on the same segmentation task as in the second\ua0paper is fully elaborated in the third and the fourth papers. A quantitative\ua0evaluation implemented in the third paper shows that different colormaps can\ua0influence the task accuracy in MWT related analytics, and that schemes autumn,\ua0virids, and parula can provide the best performance. As the full extension of\ua0the third paper, the fourth paper introduces a systematic crowdsourced study,\ua0verifying our prior hypothesis that the colormaps triggering affect in the positiveexciting\ua0quadrant in the valence-arousal model are able to facilitate more precise\ua0visual comprehension in the context of MWT than the other three quadrants.\ua0Interestingly, we also discover the counter-finding that colormaps resulting in\ua0affect in the negative-calm quadrant are undesirable. A synthetic colormap design\ua0guideline is brought up to benefit domain related users.In the end, we re-emphasize the importance of making humans beneficial in every\ua0context. Also, we start walking down the future path of focusing on humancentered\ua0machine learning(HCML), which is an emerging subfield of computer\ua0science which combines theexpertise of data-driven ML with the domain knowledge\ua0of HCI. This novel interdisciplinary research field is being explored to support\ua0developing the real-time industrial decision-support system

Monitoring and Visualization of Crystallization Processes Using Electrical Resistance Tomography: CaCO3 and Sucrose Crystallization Case Studies

In the current research work, electrical resistance tomography (ERT) was employed for monitoring and visualization of crystallization processes. A first-of-its-kind MATLAB-based interactive GUI application "ERT-Vis" is presented. Two case studies involving varied crystallization methods were undertaken. The experiments were designed and performed involving calcium carbonate reactive (precipitative) crystallization for the high conductivity solution-solute media, and the cooling crystallization of sucrose representing the lower conductivity solution-solute combination. The software successfully provided key insights regarding the process in both crystallization systems. It could detect and separate the solid concentration distributions in the low as well as high conductivity solutions using the visual analytics tools provided. The performance and utility of the software were studied using a software evaluation case study involving domain experts. Participant feedback indicated that ERT-Vis software helps by reconstructing images instantaneously, interactively visualizing, and evaluating the output of the crystallization process monitoring data

Playing with Data: An Augmented Reality Approach to Interact with Visualizations of Industrial Process Tomography

Industrial process tomography (IPT) is a specialized imaging technique widely used in industrial scenarios for process supervision and control. Today, augmented/mixed reality (AR/MR) is increasingly being adopted in many industrial occasions, even though there is still an obvious gap when it comes to IPT. To bridge this gap, we propose the first systematic AR approach using optical see-through (OST) head mounted displays (HMDs) with comparative evaluation for domain users towards IPT visualization analysis. The proof-of-concept was demonstrated by a within-subject user study (n=20) with counterbalancing design. Both qualitative and quantitative measurements were investigated. The results showed that our AR approach outperformed conventional settings for IPT data visualization analysis in bringing higher understandability, reduced task completion time, lower error rates for domain tasks, increased usability with enhanced user experience, and a better recommendation level. We summarize the findings and suggest future research directions for benefiting IPT users with AR/MR

Supporting visualization analysis in industrial process tomography by using augmented reality—A case study of an industrial microwave drying system

Industrial process tomography (IPT) based process control is an advisable approach in industrial heating processes for improving system efficiency and quality. When using it, appropriate dataflow pipelines and visualizations are key for domain users to implement precise data acquisition and analysis. In this article, we propose a complete data processing and visualizing workflow regarding a specific case—microwave tomography (MWT) controlled industrial microwave drying system. Furthermore, we present the up-to-date augmented reality (AR) technique to support the corresponding data visualization and on-site analysis. As a pioneering study of using AR to benefit IPT systems, the proposed AR module provides straightforward and comprehensible visualizations pertaining to the process data to the related users. Inside the dataflow of the case, a time reversal imaging algorithm, a post-imaging segmentation, and a volumetric visualization module are included. For the time reversal algorithm, we exhaustively introduce each step for MWT image reconstruction and then present the simulated results. For the post-imaging segmentation, an automatic tomographic segmentation algorithm is utilized to reveal the significant information contained in the reconstructed images. For volumetric visualization, the 3D generated information is displayed. Finally, the proposed AR system is integrated with the on-going process data, including reconstructed, segmented, and volumetric images, which are used for facilitating interactive on-site data analysis for domain users. The central part of the AR system is implemented by a mobile app that is currently supported on iOS/Android platforms

Visualization of dynamic multidimensional and hierarchical datasets

When it comes to tools and techniques designed to help understanding complex abstract data, visualization methods play a prominent role. They enable human operators to lever age their pattern finding, outlier detection, and questioning abilities to visually reason about a given dataset. Many methods exist that create suitable and useful visual represen tations of static abstract, non-spatial, data. However, for temporal abstract, non-spatial, datasets, in which the data changes and evolves through time, far fewer visualization tech niques exist. This thesis focuses on the particular cases of temporal hierarchical data representation via dynamic treemaps, and temporal high-dimensional data visualization via dynamic projec tions. We tackle the joint question of how to extend projections and treemaps to stably, accurately, and scalably handle temporal multivariate and hierarchical data. The literature for static visualization techniques is rich and the state-of-the-art methods have proven to be valuable tools in data analysis. Their temporal/dynamic counterparts, however, are not as well studied, and, until recently, there were few hierarchical and high-dimensional methods that explicitly took into consideration the temporal aspect of the data. In addi tion, there are few or no metrics to assess the quality of these temporal mappings, and even fewer comprehensive benchmarks to compare these methods. This thesis addresses the abovementioned shortcomings. For both dynamic treemaps and dynamic projections, we propose ways to accurately measure temporal stability; we eval uate existing methods considering the tradeoff between stability and visual quality; and we propose new methods that strike a better balance between stability and visual quality than existing state-of-the-art techniques. We demonstrate our methods with a wide range of real-world data, including an application of our new dynamic projection methods to support the analysis and classification of hyperkinetic movement disorder data.Quando se trata de ferramentas e técnicas projetadas para ajudar na compreensão dados abstratos complexos, métodos de visualização desempenham um papel proeminente. Eles permitem que os operadores humanos alavanquem suas habilidades de descoberta de padrões, detecção de valores discrepantes, e questionamento visual para a raciocinar sobre um determinado conjunto de dados. Existem muitos métodos que criam representações visuais adequadas e úteis de para dados estáticos, abstratos, e não-espaciais. No entanto, para dados temporais, abstratos, e não-espaciais, isto é, dados que mudam e evoluem no tempo, existem poucas técnicas apropriadas. Esta tese concentra-se nos casos específicos de representação temporal de dados hierárquicos por meio de treemaps dinâmicos, e visualização temporal de dados de alta dimen sionalidade via projeções dinâmicas. Nós abordar a questão conjunta de como estender projeções e treemaps de forma estável, precisa e escalável para lidar com conjuntos de dados hierárquico-temporais e multivariado-temporais. Em ambos os casos, a literatura para técnicas estáticas é rica e os métodos estado da arte provam ser ferramentas valiosas em análise de dados. Suas contrapartes temporais/dinâmicas, no entanto, não são tão bem estudadas e, até recentemente, existiam poucos métodos hierárquicos e de alta dimensão que explicitamente levavam em consideração o aspecto temporal dos dados. Além disso, existiam poucas métricas para avaliar a qualidade desses mapeamentos visuais temporais, e ainda menos benchmarks abrangentes para comparação esses métodos. Esta tese aborda as deficiências acima mencionadas para treemaps dinâmicos e projeções dinâmicas. Propomos maneiras de medir com precisão a estabilidade temporal; avalia mos os métodos existentes, considerando o compromisso entre estabilidade e qualidade visual; e propomos novos métodos que atingem um melhor equilíbrio entre estabilidade e a qualidade visual do que as técnicas estado da arte atuais. Demonstramos nossos mé todos com uma ampla gama de dados do mundo real, incluindo uma aplicação de nossos novos métodos de projeção dinâmica para apoiar a análise e classificação dos dados de transtorno de movimentos

Influence of Early Bilingual Exposure in the Developing Human Brain.

190 p.La adquisición del lenguaje es un proceso que ese encuentra determinado tanto por mecanismos de desarrollo cognitivo, como por la experiencia lingüística durante los primeros años de vida. Aunque se trata de un proceso relativamente complejo, los bebés muestran una gran habilidad para el aprendizaje del lenguaje. Un entorno de aprendizaje lingüístico bilingüe podría considerarse aun más complejo, ya que los bebés están expuestos a las características lingüísticas de dos lenguas simultáneamente. En primer lugar, los bebés que crecen en un entorno bilingüe tienen que ser capaces de darse cuenta de que están expuestos a dos lenguas diferentes, y posteriormente deben separar y aprender las características especificas de cada una de ellas; por ejemplo, los distintos fonemas, palabras o estructuras gramaticales. Aunque la exposición lingüística total de los bebés bilingües debería ser comparable a la de los bebés monolingües, es probable que la exposición a cada una de las lenguas de su entorno sea menor, ya que tienen que dividir su tiempo de exposición entre ambas. Si bien los bebés bilingües parecen no tener problemas para enfrentarse a un contexto de aprendizaje potencialmente más complejo, ya que alcanzan las distintas etapas de adquisición del lenguaje a un ritmo similar a los bebés monolingües, sí se han observado adaptaciones a nivel conductual y a nivel de funcionamiento cerebral que podrían producirse como consecuencia de este contexto.Basque Center on cognition, brain and languag

Influence of Early Bilingual Exposure in the Developing Human Brain.

190 p.La adquisición del lenguaje es un proceso que ese encuentra determinado tanto por mecanismos de desarrollo cognitivo, como por la experiencia lingüística durante los primeros años de vida. Aunque se trata de un proceso relativamente complejo, los bebés muestran una gran habilidad para el aprendizaje del lenguaje. Un entorno de aprendizaje lingüístico bilingüe podría considerarse aun más complejo, ya que los bebés están expuestos a las características lingüísticas de dos lenguas simultáneamente. En primer lugar, los bebés que crecen en un entorno bilingüe tienen que ser capaces de darse cuenta de que están expuestos a dos lenguas diferentes, y posteriormente deben separar y aprender las características especificas de cada una de ellas; por ejemplo, los distintos fonemas, palabras o estructuras gramaticales. Aunque la exposición lingüística total de los bebés bilingües debería ser comparable a la de los bebés monolingües, es probable que la exposición a cada una de las lenguas de su entorno sea menor, ya que tienen que dividir su tiempo de exposición entre ambas. Si bien los bebés bilingües parecen no tener problemas para enfrentarse a un contexto de aprendizaje potencialmente más complejo, ya que alcanzan las distintas etapas de adquisición del lenguaje a un ritmo similar a los bebés monolingües, sí se han observado adaptaciones a nivel conductual y a nivel de funcionamiento cerebral que podrían producirse como consecuencia de este contexto.Basque Center on cognition, brain and languag

Visualization of dynamic multidimensional and hierarchical datasets

When it comes to tools and techniques designed to help understanding complex abstract data, visualization methods play a prominent role. They enable human operators to lever age their pattern finding, outlier detection, and questioning abilities to visually reason about a given dataset. Many methods exist that create suitable and useful visual represen tations of static abstract, non-spatial, data. However, for temporal abstract, non-spatial, datasets, in which the data changes and evolves through time, far fewer visualization tech niques exist. This thesis focuses on the particular cases of temporal hierarchical data representation via dynamic treemaps, and temporal high-dimensional data visualization via dynamic projec tions. We tackle the joint question of how to extend projections and treemaps to stably, accurately, and scalably handle temporal multivariate and hierarchical data. The literature for static visualization techniques is rich and the state-of-the-art methods have proven to be valuable tools in data analysis. Their temporal/dynamic counterparts, however, are not as well studied, and, until recently, there were few hierarchical and high-dimensional methods that explicitly took into consideration the temporal aspect of the data. In addi tion, there are few or no metrics to assess the quality of these temporal mappings, and even fewer comprehensive benchmarks to compare these methods. This thesis addresses the abovementioned shortcomings. For both dynamic treemaps and dynamic projections, we propose ways to accurately measure temporal stability; we eval uate existing methods considering the tradeoff between stability and visual quality; and we propose new methods that strike a better balance between stability and visual quality than existing state-of-the-art techniques. We demonstrate our methods with a wide range of real-world data, including an application of our new dynamic projection methods to support the analysis and classification of hyperkinetic movement disorder data.Quando se trata de ferramentas e técnicas projetadas para ajudar na compreensão dados abstratos complexos, métodos de visualização desempenham um papel proeminente. Eles permitem que os operadores humanos alavanquem suas habilidades de descoberta de padrões, detecção de valores discrepantes, e questionamento visual para a raciocinar sobre um determinado conjunto de dados. Existem muitos métodos que criam representações visuais adequadas e úteis de para dados estáticos, abstratos, e não-espaciais. No entanto, para dados temporais, abstratos, e não-espaciais, isto é, dados que mudam e evoluem no tempo, existem poucas técnicas apropriadas. Esta tese concentra-se nos casos específicos de representação temporal de dados hierárquicos por meio de treemaps dinâmicos, e visualização temporal de dados de alta dimen sionalidade via projeções dinâmicas. Nós abordar a questão conjunta de como estender projeções e treemaps de forma estável, precisa e escalável para lidar com conjuntos de dados hierárquico-temporais e multivariado-temporais. Em ambos os casos, a literatura para técnicas estáticas é rica e os métodos estado da arte provam ser ferramentas valiosas em análise de dados. Suas contrapartes temporais/dinâmicas, no entanto, não são tão bem estudadas e, até recentemente, existiam poucos métodos hierárquicos e de alta dimensão que explicitamente levavam em consideração o aspecto temporal dos dados. Além disso, existiam poucas métricas para avaliar a qualidade desses mapeamentos visuais temporais, e ainda menos benchmarks abrangentes para comparação esses métodos. Esta tese aborda as deficiências acima mencionadas para treemaps dinâmicos e projeções dinâmicas. Propomos maneiras de medir com precisão a estabilidade temporal; avalia mos os métodos existentes, considerando o compromisso entre estabilidade e qualidade visual; e propomos novos métodos que atingem um melhor equilíbrio entre estabilidade e a qualidade visual do que as técnicas estado da arte atuais. Demonstramos nossos mé todos com uma ampla gama de dados do mundo real, incluindo uma aplicação de nossos novos métodos de projeção dinâmica para apoiar a análise e classificação dos dados de transtorno de movimentos