Visualization and Interaction Technologies in Serious and Exergames for Cognitive Assessment and Training: A Survey on Available Solutions and Their Validation

Exergames and serious games, based on standard personal computers, mobile devices and gaming consoles or on novel immersive Virtual and Augmented Reality techniques, have become popular in the last few years and are now applied in various research fields, among which cognitive assessment and training of heterogeneous target populations. Moreover, the adoption of Web based solutions together with the integration of Artificial Intelligence and Machine Learning algorithms could bring countless advantages, both for the patients and the clinical personnel, as allowing the early detection of some pathological conditions, improving the efficacy and adherence to rehabilitation processes, through the personalisation of training sessions, and optimizing the allocation of resources by the healthcare system. The current work proposes a systematic survey of existing solutions in the field of cognitive assessment and training. We evaluate the visualization and interaction technologies commonly adopted and the measures taken to fulfil the need of the pathological target populations. Moreover, we analyze how implemented solutions are validated, i.e. The chosen experimental designs, data collection and analysis. Finally, we consider the availability of the applications and raw data to the large community of researchers and medical professionals and the actual application of proposed solutions in the standard clinical practice. Despite the potential of these technologies, research is still at an early stage. Although the recent release of accessible immersive virtual reality headsets and the increasing interest on vision-based techniques for tracking body and hands movements, many studies still rely on non-immersive virtual reality (67.2%), mainly mobile and personal computers, and standard gaming tools for interactions (41.5%). Finally, we highlight that although the interest of research community in this field is increasingly higher, the sharing of dataset (10.6%) and implemented applications (3.8%) should be promoted and the number of healthcare structures which have successfully introduced the new technological approaches in the treatment of their host patients is limited (10.2%)

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

Neurological and Mental Disorders

Mental disorders can result from disruption of neuronal circuitry, damage to the neuronal and non-neuronal cells, altered circuitry in the different regions of the brain and any changes in the permeability of the blood brain barrier. Early identification of these impairments through investigative means could help to improve the outcome for many brain and behaviour disease states.The chapters in this book describe how these abnormalities can lead to neurological and mental diseases such as ADHD (Attention Deficit Hyperactivity Disorder), anxiety disorders, Alzheimer’s disease and personality and eating disorders. Psycho-social traumas, especially during childhood, increase the incidence of amnesia and transient global amnesia, leading to the temporary inability to create new memories.Early detection of these disorders could benefit many complex diseases such as schizophrenia and depression

Dance, Ageing and Collaborative Arts-Based Research

Dance, Ageing and Collaborative Arts-Based Research contributes a critical and comprehensive perspective on the role of the arts –specifically dance – in enhancing the lives of older people. The book focuses on the development of an innovative arts-based program for older adults and the collaborative process of exploring and understanding its impact in relation to ageing, social inclusion, and care. It offers a wide audience of readers a richer understanding of the role of the arts in ageing and life enrichment, critical contributions to theories of ageing and care, specific approaches to arts-based collaborative research, and an exploration of the impact of Sharing Dance from the perspective of older adults, artists, researchers, and community leaders. Given the interdisciplinary and collaborative nature of this book, it will be of interest across health, social science, and humanities disciplines, including gerontology, sociology, psychology, geography, nursing, social work, and performing arts. Licence line: Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license

Identifying the Neurocognitive bases of creativity to increase human and computational creativity

En esta Tesis Doctoral se ha identificado la estructura neurocognitiva que sustenta la creatividad humana a partir del análisis conjunto de más de 800 referencias bibliográficas que muestran las investigaciones más importantes realizadas hasta la fecha. Sobre la base de esta estructura, se ha identificado un paradigma neurocognitivo de la creatividad humana y se ha propuesto un modelo neurocognitivo del proceso creativo. Finalmente, también se ha propuesto un paradigma creativo neurocognitivo computacional y se ha diseñado la estructura de un sistema computacional creativo, basado en una estructura multiagente. La investigación que se ha realizado sobre el tema hasta la fecha es muy especializada y se centra en aspectos muy concretos de la creatividad, y en muchos casos tienen poca relación entre sí. Por ello, y para tener una idea conjunta y holística de los procesos neurocognitivos de la creatividad humana, es necesario estudiar todas estas investigaciones de forma interconectada. Esta idea conjunta permitiría dirigir investigaciones más específicas para ser más efectivos. Por ello, lo primero que se ha hecho ha sido clasificar, agrupar, analizar, entrelazar y estructurar, de forma ordenada, las investigaciones más importantes que se han realizado hasta la fecha. Sin embargo, el trabajo realizado va mucho más allá, ya que estructurando y entrelazando las investigaciones existentes ha sido posible identificar ciertos patrones, correlaciones y paralelismos, y realizar ciertas deducciones, que en su conjunto, han permitido identificar los procesos neurocognitivos fundamentales. bases de la creatividad humana. La Tesis se estructura en los siguientes capítulos: Capitulo 2 Análisis de los principales métodos para estimular la creatividad Se analizan las principales definiciones de creatividad, y se ha decidido que el mejor enfoque para su análisis es estructurarla taxonómicamente, bajo el modelo 4P. Se ha realizado una recopilación y análisis de los métodos más efectivos que estimulan la creatividad humana, mostrando las ventajas y desventajas de cada uno. Capítulo 3 Estructura funcional del cerebro humano y su relación con el proceso creativo Se identifica la estructura neurocognitiva general del cerebro humano que permite generar los procesos fundamentales y básicos de su actividad creativa. Capítulo 4 El papel fundamental de la DMN en el proceso creativo Se ha observado que la red de modo predeterminado (DMN) tiene un papel principal en la creatividad. Por ello, se ha dedicado un capítulo a su estudio, y se han identificado varios factores que la involucran directamente en la actividad creativa del cerebro humano. Capítulo 5 Identificación y análisis de las bases neurocognitivas de la creatividad humana Se ha identificado el conjunto general de factores neurocognitivos que sustentan los procesos creativos en el cerebro humano. Capítulo 6 Paradigma neurocognitivo de la creatividad humana Se ha propuesto un modelo neurocognitivo del proceso creativo que reestructura, completa y detalla todos los modelos conceptuales propuestos hasta el momento. Capítulo 7 Paradigma computacional de la creatividad basado en la estructura neurocognitiva humana Analizando las diferentes bases neurocognitivas que sustentan la creatividad humana, se han establecido paralelismos computacionales y se han realizado diferentes sugerencias para el diseño de un sistema computacional creativo.In this Doctoral Thesis, the neurocognitive structure that supports human creativity has been identified based on the joint analysis of more than 800 bibliographical references that show the most important investigations carried out to date. Based on this structure, a neurocognitive paradigm of human creativity has been described, and a neurocognitive model of creative process has been proposed. Finally, a computational neurocognitive creative paradigm has been also proposed, and the structure of a creative computational multi-agent system has been designed. The research that has been carried out on the subject is very specialized and focuses on very specific aspects of creativity, and in many cases they have little relationship with each other. For this reason, and in order to have a joint and holistic idea of the neurocognitive processes of human creativity, it is necessary to study all these investigations in an interconnected way. This joint idea would allow directing more specific investigations in order to be more effective. For this reason, the first thing that has been done has been to classify, group, analyze, intertwine and structure, in an orderly manner, the most important investigations that have been carried out to date. However, the work carried out goes much further, since by structuring and intertwining the existing research it has been possible to identify certain patterns, correlations and parallelisms, and make certain deductions, which as a whole, have made it possible to identify the fundamental neurocognitive bases of human creativity. Chapter 2 Analysis of the main methods to stimulate creativity The main definitions of creativity are analyzed, and it has been decided that the best approach for its analysis is to structure it taxonomically, under the 4P model. A compilation and analysis of the most effective methods that stimulate human creativity has been carried out, showing the advantages and disadvantages of each one. Chapter 3 Functional structure of the human brain and its relationship with the creative process The general neurocognitive structure of the human brain that allows the generation of the fundamental and basic processes of its creative activity are identified. Chapter 4 The fundamental role of the DMN in the creative process It has been observed that the Default mode network (DMN) has a main role in creativity. For this reason, a chapter has been dedicated to its study, and several factors have been identified that directly involve it in the creative activity of the human brain. Chapter 5 Identification and analysis of the neurocognitive bases of human creativity The general set of neurocognitive factors that underpin creative processes in the human brain has been identified. Chapter 6 Neurocognitive paradigm of human creativity A neurocognitive model of the creative process has been proposed, which restructures, completes and details all the conceptual models proposed so far. Chapter 7 Computational paradigm of creativity based on the human neurocognitive structure Analyzing the different neurocognitive bases that support human creativity, computational parallels have been established and different suggestions have been made for the design of a creative computational system

A Game-based Psychotherapy Intervention Model for Memory Disorder: Model Validation Using EEG Neurofeedback Data

Game-based psychotherapy intervention is a promising alternative to non-pharmacological approaches in treating memory disorders. Nevertheless, the game-based approach is yet to be included systematically in existing intervention models for treating memory disorders. Hence, this article discusses how a proposed gamebased psychotherapy intervention is developed and validated using neurofeedback approach. The proposed model consists of nine exogenous and six instantaneous factors as the main components. To ensure its applicability, a validation procedure has been carried out through a series of psychotherapy experiments involving the elderly with memory disorder symptoms. Electroencephalogram (EEG) data captured from the experiments are thoroughly analysed to validate relationships among factors in the model. Experimental findings have proven that all relationships are successfully validated and supported except for the belief component with the cut-off point of 56.6%. The novelty of this study can be attributed to the integration of digital games and neurofeedback in psychotherapy for memory disorders. The model is believed to be a guideline in planning suitable cognitive training and rehabilitation for people with memory disorders towards improving the quality of the elderly life