Seven HCI Grand Challenges

This article aims to investigate the Grand Challenges which arise in the current and emerging landscape of rapid technological evolution towards more intelligent interactive technologies, coupled with increased and widened societal needs, as well as individual and collective expectations that HCI, as a discipline, is called upon to address. A perspective oriented to humane and social values is adopted, formulating the challenges in terms of the impact of emerging intelligent interactive technologies on human life both at the individual and societal levels. Seven Grand Challenges are identified and presented in this article: Human-Technology Symbiosis; Human-Environment Interactions; Ethics, Privacy and Security; Well-being, Health and Eudaimonia; Accessibility and Universal Access; Learning and Creativity; and Social Organization and Democracy. Although not exhaustive, they summarize the views and research priorities of an international interdisciplinary group of experts, reflecting different scientific perspectives, methodological approaches and application domains. Each identified Grand Challenge is analyzed in terms of: concept and problem definition; main research issues involved and state of the art; and associated emerging requirements

IM-sgi an interface model for shape grammar implementations

This research arises from the interest in computing as offering new paradigms in the design practice. Information technologies are the driving force for progress in the processes of design, enabling new forms of creativity. The increasing sophistication of computer applications, their easier access, and lower cost have had a significant impact on design practices and can be regarded as a paradigm shift. The invention and creativity are thus seen as knowledge processing activities and can, at least partially, be carried out with the support of computer applications. In this context Shape Grammars (SG) as production systems of designs through rules have the potential to create designs with variable user input and the ability to evaluate a large number of alternatives that may lead to innovative designs. Most architects and designers use computers on their daily practice as a representation tool for their projects, but not as a facilitator or increaser of the creative process. SG computational implementations have the potential to enhance creativity with the test of a wide range of design options, helping the appearance of new solutions, either through the emergence of new shapes or by stimulating the designer’s creativity with the possibilities presented. As Architects and Designers haven't adopted existing SG computational implementations, that take advantage of computation to facilitate and enhance their work, could the problem be on the communication between the applications and the user? If the interface of the SG implementation does not allow the user to understand how to use it or how to control and make use of its results, it can’t be successfully used. With interest in SG implementations as creative partners in the creative process, our research starts with the analysis of existing SG implementations, trying to understand if they had the potential to be adopted by architects and designers in their practice and, if not, what could be done to lead to that objective. User Interface Inspection Methods were used to perform this analysis and allowed us to understand that there are interactions and communication issues that need to be addressed for SG implementations to be adopted by designers. Taking this direction, we understood that models of interaction between the user and SG implementations have already been developed. The present research proposal started from the analysis of the interaction model of Scott Chase, where he defines the different levels of interaction between the user and SG implementation, with more or less input from the user, establishing different ways to combine synergies to obtain new creative solutions. Taking this interaction model as a starting point, next, we must assure the correct communication between user and implementation occurs. The means of communication between these two agents is the computational interface. Understanding the importance of the interface to allow the user to know how to use the computational implementation and be able to produce results, our research presents the development of an interface model for SG implementations to help to take a step towards the adoption of SG for creative projects. For this, we used methods from Human-Computer Interaction discipline, and we also took Bastien & Scapin's "List of Ergonomic Criteria Guidelines" as guiding lines to define the Criteria of our interface model, called IM-sgi, Interface Model for Shape Grammar Implementations. Thus, IM-sgi, an interface model for SG Implementations, has the purpose of helping SG implementations developers to address the interface on the right path to a correct communication with the particular type of user that architects and designers are. Interface prototypes following IM-sgi criteria are finally developed and presented to test the suitability of the IM-sgi Model to SG implementations and validate the objectives we propose.A presente pesquisa surge do interesse na computação por oferecer novos paradigmas na prática do design. As tecnologias da informação são a força motriz para o progresso nos processos de design, permitindo novas formas de criatividade. A crescente sofisticação das aplicações computacionais, o acesso mais fácil às mesmas e menor custo associado tiveram um grande impacto nas práticas de projeto e podemos considerar estar perante uma mudança de paradigma. A invenção e a criatividade são, portanto, vistas como atividades de processamento de conhecimento e podem, pelo menos parcialmente, ser realizadas com o suporte do computador. Nesse contexto, As Gramáticas de Forma, como sistemas de produção de designs através de regras, têm o potencial de criar projetos com entradas com níveis variáveis de intervenção do utilizador e apresentam a capacidade de avaliar um grande número de alternativas que podem levar a designs inovadores. A maioria dos arquitetos e designers usa o computador na sua prática diária como uma ferramenta de representação para seus projetos, mas não como um facilitador ou potenciador do processo criativo. As implementações computacionais de Gramáticas de Forma têm o potencial de aumentar a criatividade com o teste de uma ampla gama de opções de design, ajudando no surgimento de novas soluções, seja pela emergência de novas formas ou estimulando a criatividade do designer com as opções desenvolvidas. Uma vez que as implementações computacionais de Gramáticas de Forma existentes não foram adotadas por Arquitetos e Designers, que claramente tiram proveito de aplicações computacionais para facilitar e aperfeiçoar o seu trabalho, poderá o problema estar na comunicação entre as implementações e o utilizador? Se a interface da implementação não permitir que o utilizador entenda como usá-la ou como controlar e utilizar os seus resultados, ela não poderá ser utilizada com sucesso. Com interesse nas implementações de Gramáticas de Forma como parceiros criativos no processo criativo, a nossa investigação começa com a análise das implementações de Gramáticas de Forma existentes, tentando entender se estas têm potencial para ser adotadas pelos criativos na sua prática e, se não, o que poderia ser feito para chegar a este objetivo. Foram usados métodos de inspeção para realizar esta análise para nos permitir compreender que há interações e problemas de comunicação que precisam de ser resolvidos para que as implementações de Gramáticas de Forma sejam adotadas pelos projetistas. Seguindo essa direção de investigação, percebemos que foram já desenvolvidos modelos de interação entre o utilizador e as implementações de Gramáticas de Forma. A presente proposta de pesquisa surgiu a partir da análise do modelo de interação de Scott Chase, onde este define os diferentes níveis de interação entre utilizador e implementação de Gramáticas de Forma, com maior ou menor input do utilizador, estabelecendo diferentes formas de combinar sinergias para obter novas soluções criativas. Tomando esse modelo de interação como ponto de partida, devemos assegurar que a comunicação correta entre o utilizador e a implementação ocorra. O meio de comunicação desses dois agentes é o interface computacional. Entendendo a importância do interface para permitir que o utilizador entenda como usar a implementação computacional e seja capaz de produzir resultados, a nossa pesquisa apresenta o desenvolvimento de um modelo de interface para implementações de Gramáticas de Forma para ajudar a dar um passo na direção da adoção das Gramáticas de Forma para projetos criativos. Deste modo, aplicámos métodos da disciplina de HCI e também adotámos a Lista de Diretrizes e Critérios Ergonómicos de Bastien & Scapin como linhas de orientação para definir os Critérios do nosso modelo de interface, denominado IM-sgi. O IM-sgi, um modelo de interface para Implementações de Gramática de Forma, tem a finalidade de ajudar programadores de implementações de Gramáticas de Forma a endereçar a interface no sentido de atingir uma comunicação correta com o tipo particular de utilizador que são os arquitetos e designers. Protótipos de interface seguindo os critérios IM-sgi são finalmente desenvolvidos e apresentados para testar a adequação do modelo IM-sgi e validar os objetivos que propomos

Recent advances of HCI in decision-making tasks for optimized clinical workflows and precision medicine.

The ever-increasing amount of biomedical data is enabling new large-scale studies, even though ad hoc computational solutions are required. The most recent Machine Learning (ML) and Artificial Intelligence (AI) techniques have been achieving outstanding performance and an important impact in clinical research, aiming at precision medicine, as well as improving healthcare workflows. However, the inherent heterogeneity and uncertainty in the healthcare information sources pose new compelling challenges for clinicians in their decision-making tasks. Only the proper combination of AI and human intelligence capabilities, by explicitly taking into account effective and safe interaction paradigms, can permit the delivery of care that outperforms what either can do separately. Therefore, Human-Computer Interaction (HCI) plays a crucial role in the design of software oriented to decision-making in medicine. In this work, we systematically review and discuss several research fields strictly linked to HCI and clinical decision-making, by subdividing the articles into six themes, namely: Interfaces, Visualization, Electronic Health Records, Devices, Usability, and Clinical Decision Support Systems. However, these articles typically present overlaps among the themes, revealing that HCI inter-connects multiple topics. With the goal of focusing on HCI and design aspects, the articles under consideration were grouped into four clusters. The advances in AI can effectively support the physicians' cognitive processes, which certainly play a central role in decision-making tasks because the human mental behavior cannot be completely emulated and captured; the human mind might solve a complex problem even without a statistically significant amount of data by relying upon domain knowledge. For this reason, technology must focus on interactive solutions for supporting the physicians effectively in their daily activities, by exploiting their unique knowledge and evidence-based reasoning, as well as improving the various aspects highlighted in this review

Theory-driven Visual Design to Support Reflective Dietary Practice via mHealth: A Design Science Approach

Design for reflection in human-computer interaction (HCI) has evolved from focusing on an abstract and outcome-driven design subject towards exposing procedural or structural reflection characteristics. Although HCI research has recognized that an individual\u27s reflection is a long-lasting, multi-layered process that can be supported by meaningful design, researchers have made few efforts to derive insights from a theoretical perspective about appropriate translation into end-user visual means. Therefore, we synthesize theoretical knowledge from reflective practice and learning and argue for a differentiation between time contexts of reflection that design needs to address differently. In an interdisciplinary design-science-research project in the mHealth nutrition promotion context, we developed theory-driven guidelines for “reflection-in-action” and “reflection-on-action”. Our final design guidelines emerged from prior demonstrations and a final utility evaluation with mockup artifacts in a laboratory experiment with 64 users. Our iterative design and the resulting design guidelines offer assistance for addressing reflection design by answering reflective practice’s respective contextual requirements. Based on our user study, we show that reflection in terms of “reflection- in-action” benefits from offering actionable choice criteria in an instant timeframe, while “reflection-on-action” profits from the structured classification of behavior-related criteria from a longer, still memorable timeframe

Responsive and Personalized Web Layouts with Integer Programming

Over the past decade, responsive web design (RWD) has become the de facto standard for adapting web pages to a wide range of devices used for browsing. While RWD has improved the usability of web pages, it is not without drawbacks and limitations: designers and developers must manually design the web layouts for multiple screen sizes and implement associated adaptation rules, and its "one responsive design fits all"approach lacks support for personalization. This paper presents a novel approach for automated generation of responsive and personalized web layouts. Given an existing web page design and preferences related to design objectives, our integer programming -based optimizer generates a consistent set of web designs. Where relevant data is available, these can be further automatically personalized for the user and browsing device. The paper includes presentation of techniques for runtime adaptation of the designs generated into a fully responsive grid layout for web browsing. Results from our ratings-based online studies with end users (N = 86) and designers (N = 64) show that the proposed approach can automatically create high-quality responsive web layouts for a variety of real-world websites.Peer reviewe

Towards a multidisciplinary user-centric design framework for context-aware applications

The primary aim of this article is to review and merge theories of context within linguistics, computer science, and psychology, to propose a multidisciplinary model of context that would facilitate application developers in developing richer descriptions or scenarios of how a context-aware device may be used in various dynamic mobile settings. More specifically, the aim is to:1. Investigate different viewpoints of context within linguistics, computer science, and psychology, to develop summary condensed models for each discipline. 2. Investigate the impact of contrasting viewpoints on the usability of context-aware applications. 3. Investigate the extent to which single-discipline models can be merged and the benefits and insightfulness of a merged model for designing mobile computers. 4. Investigate the extent to which a proposed multidisciplinary modelcan be applied to specific applications of context-aware computing

Cody: An AI-Based System to Semi-Automate Coding for Qualitative Research

Qualitative research can produce a rich understanding of a phenomenon but requires an essential and strenuous data annotation process known as coding. Coding can be repetitive and time-consuming, particularly for large datasets. Existing AI-based approaches for partially automating coding, like supervised machine learning (ML) or explicit knowledge represented in code rules, require high technical literacy and lack transparency. Further, little is known about the interaction of researchers with AI-based coding assistance. We introduce Cody, an AI-based system that semi-automates coding through code rules and supervised ML. Cody supports researchers with interactively (re)defining code rules and uses ML to extend coding to unseen data. In two studies with qualitative researchers, we found that (1) code rules provide structure and transparency, (2) explanations are commonly desired but rarely used, (3) suggestions benefit coding quality rather than coding speed, increasing the intercoder reliability, calculated with Krippendorff’s Alpha, from 0.085 (MAXQDA) to 0.33 (Cody)

Toward a multidisciplinary model of context to support context-aware computing

Capturing, defining, and modeling the essence of context are challenging, compelling, and prominent issues for interdisciplinary research and discussion. The roots of its emergence lie in the inconsistencies and ambivalent definitions across and within different research specializations (e.g., philosophy, psychology, pragmatics, linguistics, computer science, and artificial intelligence). Within the area of computer science, the advent of mobile context-aware computing has stimulated broad and contrasting interpretations due to the shift from traditional static desktop computing to heterogeneous mobile environments. This transition poses many challenging, complex, and largely unanswered research issues relating to contextual interactions and usability. To address those issues, many researchers strongly encourage a multidisciplinary approach. The primary aim of this article is to review and unify theories of context within linguistics, computer science, and psychology. Summary models within each discipline are used to propose an outline and detailed multidisciplinary model of context involving (a) the differentiation of focal and contextual aspects of the user and application's world, (b) the separation of meaningful and incidental dimensions, and (c) important user and application processes. The models provide an important foundation in which complex mobile scenarios can be conceptualized and key human and social issues can be identified. The models were then applied to different applications of context-aware computing involving user communities and mobile tourist guides. The authors' future work involves developing a user-centered multidisciplinary design framework (based on their proposed models). This will be used to design a large-scale user study investigating the usability issues of a context-aware mobile computing navigation aid for visually impaired people