Investigando Natural User Interfaces (NUIs) : tecnologias e interação em contexto de acessibilidade

Orientador: Maria Cecília Calani BaranauskasTese (doutorado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: Natural User Interfaces (NUIs) representam um novo paradigma de interação, com a promessa de ser mais intuitivo e fácil de usar do que seu antecessor, que utiliza mouse e teclado. Em um contexto no qual as tecnologias estão cada vez mais invisíveis e pervasivas, não só a quantidade mas também a diversidade de pessoas que participam deste contexto é crescente. Nesse caso, é preciso estudar como esse novo paradigma de interação de fato consegue ser acessível a todas as pessoas que podem utilizá-lo no dia-a-dia. Ademais, é preciso também caracterizar o paradigma em si, para entender o que o torna, de fato, natural. Portanto, nesta tese apresentamos o caminho que percorremos em busca dessas duas respostas: como caracterizar NUIs, no atual contexto tecnológico, e como tornar NUIs acessíveis para todos. Para tanto, primeiro apresentamos uma revisão sistemática de literatura com o estado da arte. Depois, mostramos um conjunto de heurísticas para o design e a avaliação de NUIs, que foram aplicadas em estudos de caso práticos. Em seguida, estruturamos as ideias desta pesquisa dentro dos artefatos da Semiótica Organizacional, e obtivemos esclarecimentos sobre como fazer o design de NUIs com Acessibilidade, seja por meio de Design Universal, seja para propor Tecnologias Assistivas. Depois, apresentamos três estudos de caso com sistemas NUI cujo design foi feito por nós. A partir desses estudos de caso, expandimos nosso referencial teórico e conseguimos, por fim, encontrar três elementos que resumem a nossa caracterização de NUI: diferenças, affordances e enaçãoAbstract: Natural User Interfaces (NUIs) represent a new interaction paradigm, with the promise of being more intuitive and easy to use than its predecessor, that utilizes mouse and keyboard. In a context where technology is becoming each time more invisible and pervasive, not only the amount but also the diversity of people who participate in this context is increasing. In this case, it must be studied how this new interaction paradigm can, in fact, be accessible to all the people who may use it on their daily routine. Furthermore, it is also necessary to characterize the paradigm itself, to understand what makes it, in fact, natural. Therefore, in this thesis we present the path we took in search of these two answers: how to characterize NUIs in the current technological context, and how to make NUIs accessible to all. To do so, first we present a systematic literature review with the state of the art. Then, we show a set of heuristics for the design and evaluation of NUIs, which were applied in practical study cases. Afterwards, we structure the ideas of this research into the Organizational Semiotics artifacts, and we obtain insights into how to design NUIs with Accessibility, be it through Universal Design, be it to propose Assistive Technologies. Then, we present three case studies with NUI systems which we designed. From these case studies, we expanded our theoretical references were able to, finally, find three elements that sum up our characterization of NUI: differences, affordances and enactionDoutoradoCiência da ComputaçãoDoutora em Ciência da Computação160911/2015-0CAPESCNP

Emotional self-regulation of individuals with autism spectrum disorders: smartwatches for monitoring and interaction

In this paper, we analyze the needs of individuals with Autism Spectrum Disorders (ASD) to have a pervasive, feasible and non-stigmatizing form of assistance in their emotional self-regulation, in order to ease certain behavioral issues that undermine their mental health throughout their life. We argue the potential of recent widespread wearables, and more specifically smartwatches, to achieve this goal. Then, a smartwatch system that implements a wide range of self-regulation strategies and infers outburst patterns from physiological signals and movement is presented, along with an authoring tool for smartphones that is to be used by caregivers or family members to create and edit these strategies, in an adaptive way. We conducted an intensive experiment with two individuals with ASD who showed varied, representative behavioral responses to their emotional dysregulation. Both users were able to employ effective, customized emotional self-regulation strategies by means of the system, recovering from the majority of mild stress episodes and temper tantrums experienced in the nine days of experiment in their classroomThis work has been partially funded by the projects “e-Training y e-Coaching para la integración socio—laboral” (TIN2013-44586-R) and “eMadrid-CM: Investigación y Desarrollo de Tecnologías Educativas en la Comunidad de Madrid” (S2013/ICE-2715). It has been also funded by Fundación Orange during the early stages of the project “Tic-Tac-TEA: Sistema de asistencia para la autorregulación emocional en momentos de crisis para personas con TEA mediante smartwatches

Smart kitchen for Ambient Assisted Living

El envejecimiento de la población es una realidad en todos los países desarrollados. Las predicciones de crecimiento de esta población son alarmantes, planteando un reto para los servicios sociales y sanitarios. Las personas ancianas padecen diversas discapacidades que se van acentuando con la edad, siendo más propensas a sufrir accidentes domésticos, presentando problemas para realizar tareas cotidianas, etc. Esta situación conlleva a una pérdida paulatina de capacidades que en muchas ocasiones acaba con la vida autónoma de la persona. En este contexto, las Tecnologías de la Información y Comunicación (TIC) aplicadas al entorno doméstico pueden jugar un papel importante, permitiendo que las personas ancianas vivan más tiempo, de forma independiente en su propio hogar, presentando, por tanto, una alternativa a la hospitalización o institucionalización de las mismas. Este trabajo da un paso más en este sentido, presentando el diseño y desarrollo de un Ambiente Inteligente en la cocina, que ayuda a las personas ancianas y/o con discapacidad a desempeñar sus actividades de la vida diaria de una forma más fácil y sencilla. Esta tesis realiza sus principales aportaciones en dos campos: El metodológico y el tecnológico. Por un lado se presenta una metodología sistemática para extraer necesidades de colectivos específicos a fin de mejorar la información disponible por el equipo de diseño del producto, servicio o sistema. Esta metodología se basa en el estudio de la interacción Hombre-Máquina en base a los paradigmas y modelos existentes y el modelado y descripción de las capacidades del usuario en la misma utilizado el lenguaje estandarizado propuesto en la Clasificación Internacional del Funcionamiento, de la Discapacidad y de la Salud (CIF). Adicionalmente, se plantea el problema de la evaluación tecnológica, diseñando la metodología de evaluación de la tecnología con la finalidad de conocer su accesibilidad, funcionalidad y usabilidad del sistema desarrollado y aplicándola a 61 usuarios y 31 profesionales de la gerontología. Desde un punto de vista técnico, se afronta el diseño de un ambiente asistido inteligente (Ambient Assisted Living, AAL) en la cocina, planteando y definiendo la arquitectura del sistema. Esta arquitectura, basada en OSGi (Open Services Gateway initiative), oferta un sistema modular, con altas capacidades de interoperabilidad y escalabilidad. Además, se diseña e implementa una red de sensores distribuida en el entorno con el fin de obtener la mayor información posible del contexto, presentando distintos algoritmos para obtener información de alto nivel: detección de caídas o localización. Todos los dispositivos presentes en el entorno han sido modelados utilizando la taxonomía propuesta en OSGi4AmI, extendiendo la misma a los electrodomésticos más habituales de la cocina. Finalmente, se presenta el diseño e implementación de la inteligencia del sistema, que en función de la información procedente del contexto y de las capacidades del usuario da soporte a las principales actividades de la vida diaria (AVD) en la cocina

Technologies to support community-dwelling persons with dementia: a position paper on issues regarding development, usability, effectiveness and cost-effectiveness, deployment, and ethics

Background: With the expected increase in the numbers of persons with dementia, providing timely, adequate, and affordable care and support is challenging. Assistive and health technologies may be a valuable contribution in dementia care, but new challenges may emerge. Objective: The aim of our study was to review the state of the art of technologies for persons with dementia regarding issues on development, usability, effectiveness and cost-effectiveness, deployment, and ethics in 3 fields of application of technologies: (1) support with managing everyday life, (2) support with participating in pleasurable and meaningful activities, and (3) support with dementia health and social care provision. The study also aimed to identify gaps in the evidence and challenges for future research. Methods: Reviews of literature and expert opinions were used in our study. Literature searches were conducted on usability, effectiveness and cost-effectiveness, and ethics using PubMed, Embase, CINAHL, and PsycINFO databases with no time limit. Selection criteria in our selected technology fields were reviews in English for community-dwelling persons with dementia. Regarding deployment issues, searches were done in Health Technology Assessment databases Results: According to our results, persons with dementia want to be included in the development of technologies; there is little research on the usability of assistive technologies; various benefits are reported but are mainly based on low-quality studies; barriers to deployment of technologies in dementia care were identified, and ethical issues were raised by researchers but often not studied. Many challenges remain such as including the target group more often in development, performing more high-quality studies on usability and effectiveness and cost-effectiveness, creating and having access to high-quality datasets on existing technologies to enable adequate deployment of technologies in dementia care, and ensuring that ethical issues are considered an important topic for researchers to include in their evaluation of assistive technologies. Conclusions: Based on these findings, various actions are recommended for development, usability, effectiveness and cost-effectiveness, deployment, and ethics of assistive and health technologies across Europe. These include avoiding replication of technology development that is unhelpful or ineffective and focusing on how technologies succeed in addressing individual needs of persons with dementia. Furthermore, it is suggested to include these recommendations in national and international calls for funding and assistive technology research programs. Finally, practitioners, policy makers, care insurers, and care providers should work together with technology enterprises and researchers to prepare strategies for the implementation of assistive technologies in different care settings. This may help future generations of persons with dementia to utilize available and affordable technologies and, ultimately, to benefit from them

Intelligent technologies for the aging brain: opportunities and challenges

Intelligent computing is rapidly reshaping healthcare. In light of the global burden of population aging and neurological disorders, dementia and elderly care are among the healthcare sectors that are most likely to benefit from this technological revolution. Trends in artificial intelligence, robotics, ubiquitous computing, neurotechnology and other branches of biomedical engineering are progressively enabling novel opportunities for technology-enhanced care. These Intelligent Assistive Technologies (IATs) open the prospects of supporting older adults with neurocognitive disabilities, maintain their independence, reduce the burden on caregivers and delay the need for long-term care (1, 2). While technology develops fast, yet little knowledge is available to patients and health professionals about the current availability, applicability, and capability of existing IATs. This thesis proposes a state-of-the-art analysis of IATs in dementia and elderly care. Our findings indicate that advances in intelligent technology are resulting in a rapidly expanding number and variety of assistive solutions for older adults and people with neurocognitive disabilities. However, our analysis identifies a number of challenges that negatively affect the optimal deployment and uptake of IATs among target users and care institutions. These include design issues, sub-optimal approaches to product development, translational barriers between lab and clinics, lack of adequate validation and implementation, as well as data security and cyber-risk weaknesses. Additionally, in virtue of their technological novelty, intelligent technologies raise a number of Ethical, Legal and Social Implications (ELSI). Therefore, a significant portion of this thesis is devoted to providing an early ethical Technology Assessment (eTA) of intelligent technology, hence contributing to preparing the terrain for its safe and ethically responsible adoption. This assessment is primarily focused on intelligent technologies at the human-machine interface, as these applications enable an unprecedented exposure of the intimate dimension of individuals to the digital infosphere. Issues of privacy, integrity, equality, and dual-use were addressed at the level of stakeholder analysis, normative ethics and human-rights law. Finally, this thesis is aimed at providing evidence-based recommendations for guiding participatory and responsible development in intelligent technology, and delineating governance strategies that maximize the clinical benefits of IATs for the aging world, while minimizing unintended risks

Robotic Platforms for Assistance to People with Disabilities

People with congenital and/or acquired disabilities constitute a great number of dependents today. Robotic platforms to help people with disabilities are being developed with the aim of providing both rehabilitation treatment and assistance to improve their quality of life. A high demand for robotic platforms that provide assistance during rehabilitation is expected because of the health status of the world due to the COVID-19 pandemic. The pandemic has resulted in countries facing major challenges to ensure the health and autonomy of their disabled population. Robotic platforms are necessary to ensure assistance and rehabilitation for disabled people in the current global situation. The capacity of robotic platforms in this area must be continuously improved to benefit the healthcare sector in terms of chronic disease prevention, assistance, and autonomy. For this reason, research about human–robot interaction in these robotic assistance environments must grow and advance because this topic demands sensitive and intelligent robotic platforms that are equipped with complex sensory systems, high handling functionalities, safe control strategies, and intelligent computer vision algorithms. This Special Issue has published eight papers covering recent advances in the field of robotic platforms to assist disabled people in daily or clinical environments. The papers address innovative solutions in this field, including affordable assistive robotics devices, new techniques in computer vision for intelligent and safe human–robot interaction, and advances in mobile manipulators for assistive tasks

Sustainable Technology and Elderly Life

The coming years will see an exponential increase in the proportion of elderly people in our society. This accelerated growth brings with it major challenges in relation to the sustainability of the system. There are different aspects where these changes will have a special incidence: health systems and their monitoring; the development of a framework in which the elderly can develop their daily lives satisfactorily; and in the design of intelligent cities adapted to the future sociodemographic profile. The discussion of the challenges faced, together with the current technological evolution, can show possible ways of meeting the challenges. There are different aspects where these changes will have a special incidence: health systems and their monitoring; the development of a framework in which the elderly can develop their daily lives satisfactorily; and in the design of intelligent cities adapted to the future sociodemographic profile. This special issue discusses various ways in which sustainable technologies can be applied to improve the lives of the elderly. Six articles on the subject are featured in this volume. From a systematic review of the literature to the development of gamification and health improvement projects. The articles present suggestive proposals for the improvement of the lives of the elderly. The volume is a resource of interest for the scientific community, since it shows different research gaps in the current state of the art. But it is also a document that can help social policy makers and people working in this domain to planning successful projects