Inclusive interaction design: bridging the gap between information visualization perception and color vision deficiency users

It’s becoming increasingly important to design for Inclusivity, meaning building products that are accessible to all type of users, namely color vision deficiency (CVD) deuteranope users. Along with that, we can say that Information Visualization plays a big role in the understanding of how ou world functions, since the amount of produced data (2.5 exabytes) is increasing every day. In this way, this project aims to bridge the gap between Information Visualization perception and color vision deficiency users, by exploring the effects that saturation as a variable, applied through an interaction design methodology approach, has on human visual perception. An interactive system was designe in order to explore the effects saturation had in both user’s perception. To perform the experiment, 12 trichromatic male participants were recruited and the selected graph’s colours were simulated into colours a CVD user would normally perceive. This experiment enabled to reach a range in which both trichromatic and CVD users perceive the information of a specific graph in an optimal way. Serving as a first assessment in potentially reaching a range that ensures the optimal visual perception of all types of Information Visualizations for both CVD an trichromatic users, this project intends to be used as a reference in future investigations, in order to improve the quality of life of users affected by this visual constraint

Data Painter: A Tool for Colormap Interaction

The choice of a mapping from data to color should involve careful consideration in order to maximize the user understanding of the underlying data. It is desirable for features within the data to be visually separable and identifiable. Current practice involves selecting a mapping from predefined colormaps or coding specific colormaps using software such as MATLAB. The purposes of this paper are to introduce interactive operations for colormaps that enable users to create more visually distinguishable pixel based visualizations, and to describe our tool, Data Painter, that provides a fast, easy to use framework for defining these color mappings. We demonstrate the use of the tool to create colormaps for various application areas and compare to existing color mapping methods. We present a new objective measure to evaluate their efficacy

Flexible Technique to Enhance Color-image Quality for Color-deficient Observers

Color-normal observers (CNOs) and color-deficient observers (CDOs) have different preferences and emotions for color images. A color-image quality-enhancement algorithm for a CDO is developed to easily adjust images according to each observer`s preference or image quality factors. The color-perception differences between CDO and CNO are analyzed and modeled in terms of the YCbCr chroma ratio and hue difference; then the color-shift method is designed to control the degree of color difference

Live Video and Image Recolouring for Colour Vision Deficient Patients

Colour Vision Deficiency (CVD) is an important issue for a significant population across the globe. There are several types of CVD\u27s, such as monochromacy, dichromacy, trichromacy, and anomalous trichromacy. Each of these categories contain specific other subtypes. The aim of this research is to device a scheme to address CVD by using variations in pixel plotting of colours to capture colour disparities and perform colour compensation. The proposed scheme recolours the video and images by colour contrast variation of each colour for CVD patients, and depending on the type of deficiency, it is able to provide live results. Different types of CVD’s can be identified and cured by changing the particular colour related to it and based upon the type of diseases, it performs RGB (Red, Green, and Blue) to LMS (Long, Medium, and Short) transformation. This helps in colour identification and also adjustments of colour contrasts. The processing and rendering of recoloured video and images, allows the affected patients with CVD to see perfect shades in the recoloured frames of video or images and other modes of files. In this thesis, we propose an efficient recolouring algorithm with a strong focus on real-time applications that is capable of providing different recoloured outputs based on specific types of CVD

A Visual Approach to Improving the Experience of Health Information for Vulnerable Individuals

Many individuals with low health literacy (LHL) and limited English proficiency (LEP) have poor experiences consuming health information: they find it unengaging, unappealing, difficult to understand, and un-motivating. These negative experiences may blunt, or even sabotage, the desired effect of communicating health information: to increase engagement and ability to manage health. It is imperative to find solutions to improve poor experiences of health information, because such experiences heighten vulnerability to poor health outcomes. We aimed to address a gap in the health literacy literature by studying the patient experience of health information and how visualization might be able to help. Our four studies involved patients presented with health information in various settings to improve understanding and management of their care. We used semi-structured interviews and observations to understand patient experiences of receiving personal health information in the hospital. We learned that the return of results is desired and has the potential to promote patient engagement with care. We developed a novel method to analyze LHL, LEP caregiver experience and information needs in the community setting. The novel method increased our understanding and ability to detect differences in experiences within the same ethnic group, based on language preference. Next, we interrogated the literature for a solution to easily communicate complicated health information to disinterested, LHL, LEP individuals. We found that visualizations can help increase interest, comprehension, support faster communication, and even help broach difficult topics. Finally, our findings were used to develop a novel prototype to improve experiences of consuming genetic risk information for those having LHL and LEP. Unlike traditional approaches that focus on communicating risk numbers and probabilities, the novelty of our approach was that we focused on communicating risk as a feeling. We achieved this by leveraging vicarious learning via real patient experience materials (e.g., quotes, videos) and empathy with an emotive relational agent. We evaluated and compared the prototype to standard methods of communicating genetic risk information via a mixed methods approach that included surveys, questionnaires, interviews, observations, image analysis, and facial analysis. Main outcome variables were perceived ease of understanding, comprehension, emotional response, and motivation. We employed t-tests, ANOVAs, directed content analysis, correlation, regression, hierarchical clustering, and Chernoff faces to answer the research questions. All variables were significantly different for the prototype compared to the standard method, except for motivation as rated by 32 LHL, LEP community members. Findings revealed that LHL, LEP individuals have difficulty appropriately processing standard methods of communicating risk information, such as risk numbers supported by visual aids. Further, appealing visuals may inappropriately increase confidence in understanding of information. Visualizations affected emotions, which influenced perceived ease of understanding and motivation to take action on the information. Comprehension scores did not correlate with perceived ease of understanding, emotional response, or motivation. Findings suggest that providing access to comprehensible health information may not be enough to motivate patients to engage with their care; providing a good experience (taking into account the aesthetics and emotional response) of health information may be essential to optimize outcomes

Perception in statistical graphics

There has been quite a bit of research on statistical graphics and visualization, generally focused on new types of graphics, new software to create graphics, interactivity, and usability studies. Our ability to interpret and use statistical graphics hinges on the interface between the graph itself and the brain that perceives and interprets it, and there is substantially less research on the interplay between graph, eye, brain, and mind than is sufficient to understand the nature of these relationships. The goal of the work presented here is to further explore the interplay between a static graph, the translation of that graph from paper to mental representation (the journey from eye to brain), and the mental processes that operate on that graph once it is transferred into memory (mind). Understanding the perception of statistical graphics should allow researchers to create more effective graphs which produce fewer distortions and viewer errors while reducing the cognitive load necessary to understand the information presented in the graph. Taken together, these experiments should lay a foundation for exploring the perception of statistical graphics. There has been considerable research into the accuracy of numerical judgments viewers make from graphs, and these studies are useful, but it is more effective to understand how errors in these judgments occur so that the root cause of the error can be addressed directly. Understanding how visual reasoning relates to the ability to make judgments from graphs allows us to tailor graphics to particular target audiences. In addition, understanding the hierarchy of salient features in statistical graphics allows us to clearly communicate the important message from data or statistical models by constructing graphics which are designed specifically for the perceptual system

Visualization Literacy and Decision-making in Healthcare

The ability of workers in the healthcare industry to analyze, interpret and communicate with health data is critical to decision-making and impacts both health and business outcomes. Optimal decision-making requires having real-time access to information that provides useful insights and that lends itself to collaborative decision-making. Data visualizations have the potential to facilitate decision-making in healthcare when presented as a dashboard. However, dashboards have shown varying results in both effectiveness and adoption. Data or graphical literacy challenges experienced by health team members could complicate strategic decision-making through an inability to correctly interpret or summarize the information presented in a dashboard. One assumption is that visualization literacy and its impact on how people process health data visualizations play a part in the effective interpretation of information to support decision-making. To determine the impact of visualization literacy on the process of decision-making in a healthcare setting, we first developed and deployed a dashboard designed to provide important information for decision-makers on a clinical trial management team. We engaged Project Managers and Medical Managers in the project as key decision-makers on the team. The dashboard was integrated into the normal workflow of a clinical trial management team and designated as the tool used in the workflow to report on the trial status within the organization. Next, we administered a series of assessments to the key decision-makers. The assessments were designed to evaluate numeracy, visualization literacy, and the impact of both on the decision-making ability of participants. Decision-making was assessed using a common workflow scenario supported by visualizations from the deployed dashboard. Additionally, we were interested in exploring indicators related to job satisfaction that was collected during the project period through a formal engagement survey. We performed a general linear model to assess the relationship between the assessments and decision-making. Results of our project show a significant and clear relationship between visualization literacy and decision-making ability and an insignificant relationship between numeracy and decision-making ability. Job satisfaction scores for the participant group obtained through the engagement survey suggest favorable results. However, areas of opportunity for improvement illuminated through the survey included better tools and additional resources to support the execution of tasks, a better workload balance, and improvements in collaboration across departments and functions. The results of this project contribute to the informatics discipline by demonstrating that information obtained from data visualizations produced through the aggregation of multiple sources of data can be effective decision-support tools if they are designed with user skills and abilities in mind. The results of the project suggest an opportunity to develop more useful and usable tools to improve job satisfaction as well as organizational business objectives related to workforce staffing, job competencies, and learning and development initiatives

Science in the Public Eye: Communicating and Selling Science Through Images

Scientific visuals designed to capture the attention of nonscientist audiences appear everywhere — from magazine covers to Internet blogs, from billboards to the Discovery Channel — and yet they have not received the critical attention they deserve. Situated at the crossroads of the rhetoric of science, communication studies, visual design theory, and the still emerging field of visual rhetoric, this dissertation seeks to shed light on the persuasive function of visuals in communicating science to non-experts. Occupying a grey area between scientific visualizations and art, the visuals used to communicate science to nonscientists should be classified, I argue, as scientific advertisements. Their purpose is to sell a positive and supportive attitude toward science, and since this need for support has existed since the scientific revolution, scientific advertisements have existed in different guises at least since the seventeenth century. Their form, however, differs, depending on the available technology and modes of representation. In this dissertation I explore how such images as frontispieces, portraits, magazine covers, and aestheticized visualizations have contributed to the legitimization of science across temporal and cultural boundaries by influencing public attitudes towards scientists and their research. This project addresses the concern surrounding the public's current disengagement from science by considering whether science can be sold visually in a more responsible way

Towards more effective visualisations in climate services: good practices and recommendations

Visualisations are often the entry point to information that supports stakeholders’ decision- and policy-making processes. Visual displays can employ either static, dynamic or interactive formats as well as various types of representations and visual encodings, which differently affect the attention, recognition and working memory of users. Despite being well-suited for expert audiences, current climate data visualisations need to be further improved to make communication of climate information more inclusive for broader audiences, including people with disabilities. However, the lack of evidence-based guidelines and tools makes the creation of accessible visualisations challenging, potentially leading to misunderstanding and misuse of climate information by users. Taking stock of visualisation challenges identified in a workshop by climate service providers, we review good practices commonly applied by other visualisation-related disciplines strongly based on users’ needs that could be applied to the climate services context. We show how lessons learned in the fields of user experience, data visualisation, graphic design and psychology make useful recommendations for the development of more effective climate service visualisations. This includes applying a user-centred design approach, using interaction in a suitable way in visualisations, paying attention to information architecture or selecting the right type of representation and visual encoding. The recommendations proposed here can help climate service providers reduce users’ cognitive load and improve their overall experience when using a service. These recommendations can be useful for the development of the next generation of climate services, increasing their usability while ensuring that their visual components are inclusive and do not leave anyone behind.The research leading to these results received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements no. 689029 (Climateurope), 776787 (S2S4E), 776467 (MED-GOLD) and 869565 (VitiGEOSS).Peer ReviewedPostprint (published version