Health Educ Behav

As the segment of the population 65 years of age or older continues to grow, the number of individuals with dementia increases proportionally, highlighting the need to design therapies that meet the social and emotional needs of people with dementia. Information and communication technologies (ICT) are potential venues for supporting the delivery of such therapies, including reminiscence therapy (RT), which is a non-pharmacological intervention involving the prompting of past memories, often with artifacts such as old photographs or music for therapeutic benefits such as the facilitation of social interactions or the increase of self-esteem. This paper systematically examines the scientific literature on the use of ICT for facilitating RT to assess the current state of the evidence and identify future trends. We searched the PubMed (1966-2013), ACM (1954-2013), and PsycINFO (1908-2013) repositories using the keywords dementia and reminiscence. Three hundred eighty-six articles were retrieved, 44 of which met the inclusion and exclusion criteria. Findings of the systematic review include that there are benefits to using ICT for RT interventions. Some of these benefits are access to rich and engaging multimedia reminiscence materials, opportunities for people with dementia to participate in social interactions and take ownership of conversations, and a reduction of barriers due to motor deficits during interactions with media. Future studies should explore the types and content of media beneficial to individuals at different stages of dementia.T15 LM007442/LM/NLM NIH HHS/United StatesU38 HM000454/HM/NCHM CDC HHS/United States2T15LM007442/LM/NLM NIH HHS/United States2016-04-26T00:00:00Z25274711PMC484484

Recommending video content for use in group-based reminiscence therapy

REMPAD is a semi-automated cloud-based system used to facilitate digital reminiscence therapy for patients with mild-to-moderate dementia, enacted in a group setting. REMPAD uses profiles for participants and groups to proactively recommend interactive video content from the Internet to match these profiles. In this chapter, we focus on the design of the system and then the system architecture, the system build, data curation, and usage scenarios. We also report a series of steps carried out as part of our user-centered design approach to system development, and a series of analyses on interaction logs which indicate various levels of effectiveness for different configurations of the recommendation algorithm we use. The results indicate high user satisfaction when using the system, and strong tendency towards repeated use in future

Lifelog access modelling using MemoryMesh

As of very recently, we have observed a convergence of technologies that have led to the emergence of lifelogging as a technology for personal data application. Lifelogging will become ubiquitous in the near future, not just for memory enhancement and health management, but also in various other domains. While there are many devices available for gathering massive lifelogging data, there are still challenges to modelling large volume of multi-modal lifelog data. In the thesis, we explore and address the problem of how to model lifelog in order to make personal lifelogs more accessible to users from the perspective of collection, organization and visualization. In order to subdivide our research targets, we designed and followed the following steps to solve the problem: 1. Lifelog activity recognition. We use multiple sensor data to analyse various daily life activities. Data ranges from accelerometer data collected by mobile phones to images captured by wearable cameras. We propose a semantic, density-based algorithm to cope with concept selection issues for lifelogging sensory data. 2. Visual discovery of lifelog images. Most of the lifelog information we takeeveryday is in a form of images, so images contain significant information about our lives. Here we conduct some experiments on visual content analysis of lifelog images, which includes both image contents and image meta data. 3. Linkage analysis of lifelogs. By exploring linkage analysis of lifelog data, we can connect all lifelog images using linkage models into a concept called the MemoryMesh. The thesis includes experimental evaluations using real-life data collected from multiple users and shows the performance of our algorithms in detecting semantics of daily-life concepts and their effectiveness in activity recognition and lifelog retrieval

An affective computing and image retrieval approach to support diversified and emotion-aware reminiscence therapy sessions

A demência é uma das principais causas de dependência e incapacidade entre as pessoas idosas em todo o mundo. A terapia de reminiscência é uma terapia não farmacológica comummente utilizada nos cuidados com demência devido ao seu valor terapêutico para as pessoas com demência. Esta terapia é útil para criar uma comunicação envolvente entre pessoas com demência e o resto do mundo, utilizando as capacidades preservadas da memória a longo prazo, em vez de enfatizar as limitações existentes por forma a aliviar a experiência de fracasso e isolamento social. As soluções tecnológicas de assistência existentes melhoram a terapia de reminiscência ao proporcionar uma experiência mais envolvente para todos os participantes (pessoas com demência, familiares e clínicos), mas não estão livres de lacunas: a) os dados multimédia utilizados permanecem inalterados ao longo das sessões, e há uma falta de personalização para cada pessoa com demência; b) não têm em conta as emoções transmitidas pelos dados multimédia utilizados nem as reacções emocionais da pessoa com demência aos dados multimédia apresentados; c) a perspectiva dos cuidadores ainda não foi totalmente tida em consideração. Para superar estes desafios, seguimos uma abordagem de concepção centrada no utilizador através de inquéritos mundiais, entrevistas de seguimento, e grupos de discussão com cuidadores formais e informais para informar a concepção de soluções tecnológicas no âmbito dos cuidados de demência. Para cumprir com os requisitos identificados, propomos novos métodos que facilitam a inclusão de emoções no loop durante a terapia de reminiscência para personalizar e diversificar o conteúdo das sessões ao longo do tempo. As contribuições desta tese incluem: a) um conjunto de requisitos funcionais validados recolhidos com os cuidadores formais e informais, os resultados esperados com o cumprimento de cada requisito, e um modelo de arquitectura para o desenvolvimento de soluções tecnológicas de assistência para cuidados de demência; b) uma abordagem end-to-end para identificar automaticamente múltiplas informações emocionais transmitidas por imagens; c) uma abordagem para reduzir a quantidade de imagens que precisam ser anotadas pelas pessoas sem comprometer o desempenho dos modelos de reconhecimento; d) uma técnica de fusão tardia interpretável que combina dinamicamente múltiplos sistemas de recuperação de imagens com base em conteúdo para procurar eficazmente por imagens semelhantes para diversificar e personalizar o conjunto de imagens disponíveis para serem utilizadas nas sessões.Dementia is one of the major causes of dependency and disability among elderly subjects worldwide. Reminiscence therapy is an inexpensive non-pharmacological therapy commonly used within dementia care due to its therapeutic value for people with dementia. This therapy is useful to create engaging communication between people with dementia and the rest of the world by using the preserved abilities of long-term memory rather than emphasizing the existing impairments to alleviate the experience of failure and social isolation. Current assistive technological solutions improve reminiscence therapy by providing a more lively and engaging experience to all participants (people with dementia, family members, and clinicians), but they are not free of drawbacks: a) the multimedia data used remains unchanged throughout sessions, and there is a lack of customization for each person with dementia; b) they do not take into account the emotions conveyed by the multimedia data used nor the person with dementia’s emotional reactions to the multimedia presented; c) the caregivers’ perspective have not been fully taken into account yet. To overcome these challenges, we followed a usercentered design approach through worldwide surveys, follow-up interviews, and focus groups with formal and informal caregivers to inform the design of technological solutions within dementia care. To fulfil the requirements identified, we propose novel methods that facilitate the inclusion of emotions in the loop during reminiscence therapy to personalize and diversify the content of the sessions over time. Contributions from this thesis include: a) a set of validated functional requirements gathered from formal and informal caregivers, the expected outcomes with the fulfillment of each requirement, and an architecture’s template for the development of assistive technology solutions for dementia care; b) an end-to-end approach to automatically identify multiple emotional information conveyed by images; c) an approach to reduce the amount of images that need to be annotated by humans without compromising the recognition models’ performance; d) an interpretable late-fusion technique that dynamically combines multiple content-based image retrieval systems to effectively search for similar images to diversify and personalize the pool of images available to be used in sessions

A quantified past : fieldwork and design for remembering a data-driven life

PhD ThesisA ‘data-driven life’ has become an established feature of present and future technological visions. Smart homes, smart cities, an Internet of Things, and particularly the Quantified Self movement are all premised on the pervasive datafication of many aspects of everyday life. This thesis interrogates the human experience of such a data-driven life, by conceptualising, investigating, and speculating about these personal informatics tools as new technologies of memory. With respect to existing discourses in Human-Computer Interaction, Memory Studies and Critical Data Studies, I argue that the prevalence of quantified data and metrics is creating fundamentally new and distinct records of everyday life: a quantified past. To address this, I first conduct qualitative, and idiographic fieldwork – with long-term self-trackers, and subsequently with users of ‘smart journals’ – to investigate how this data-driven record mediates the experience of remembering. Further, I undertake a speculative and design-led inquiry to explore context of a ’quantified wedding’. Adopting a context where remembering is centrally valued, this Research through Design project demonstrates opportunities and develops considerations for the design of data-driven tools for remembering. Crucially, while speculative, this project maintains a central focus on individual experience, and introduces an innovative methodological approach ‘Speculative Enactments’ for engaging participants meaningfully in speculative inquiry. The outcomes of this conceptual, empirical and speculative inquiry are multiple. I present, and interpret, a variety of rich descriptions of existing and anticipated practices of remembering with data. Introducing six experiential qualities of data, and reflecting on how data requires selectivity and construction to meaningfully account for one’s life, I argue for the design of ‘Documentary Informatics’. This perspective fundamentally reimagines the roles and possibilities for personal informatics tools; it looks beyond the current present-focused and goal-oriented paradigm of a data-driven life, to propose a more poetic orientation to recording one’s life with quantified data

Designing Cyberbullying Prevention and Mitigation Tools

While cyberbullying is prevalent among adolescents, attempts by researchers to evaluate mechanisms for its prevention and mitigation have been largely non-existent. In this dissertation, I argue that the complex nature of cyberbullying, made more challenging by the affordances of diverse social media, cannot be solved through strictly algorithmic approaches. Instead, I employ multidisciplinary methods to evaluate data generated by teens on social media and work with teens to develop and test potential cyberbullying mitigation solutions. I further argue that solutions focused on improving users' well-being after being targeted online offer designers a valuable tool in fighting back against the harm caused by cyberbullying. Based on the interdisciplinary studies conducted in this dissertation, I offer design recommendations for cyberbullying prevention and mitigation tools. I address the mitigation of adolescent cyberbullying through a multi-methodological approach: 1) data-centric exploratory study of discourse occurring alongside cyberbullying 2) an experimental design of reactions to positive messages in response to cyberbullying 3) human-centered participatory design to design cyberbullying mitigation prototypes and 4) a longitudinal study evaluating the effectiveness of cyberbullying mitigation tools. I offer design recommendations for building and administering cyberbullying mitigation tools. This dissertation begins with a data-centric study to understand \textit{why} users are motivated to post and interact through ASKfm, a social media platform that affords cyberbullying and how anonymity and the site's other affordances affect these interactions. I discuss the unique affordances specific to semi-anonymous Q\&A social media platforms and how such affordances enable users to engage in self-disclosure and gaining social support on sensitive topics. I then present two studies to first determine if users will be receptive to anonymous positive messages responding to bullying messages, then to administer positive messages or \textit{Cyberbully Reversal Pings} to ASKfm users who have received bullying messages. I then use a human-centered approach methodology to co-design cyberbullying prototypes with teens. I use the design recommendations derived from the participatory design study to test the impact of a cyberbullying mitigation system. I address technological mechanisms to mitigate sadness and decline in well-being caused by negative online experiences and cyberbullying. I administer cyberbullying mitigation through technology-mediated memory; in other words, I use positive posts and images participants have previously shared on social media to remind them of existing social support in users’ social networks. The studies in this dissertation comprise of a mixed methods approach to understand social media platforms on which cyberbullying occurs, work collaboratively with users to design mitigation platforms and ultimately evaluate a cyberbullying mitigation platform with real users. These aforementioned studies result in design recommendations for building cyberbullying mitigation tools and design recommendations for designing a study to evaluate a cyberbullying mitigation tool

Digital life stories: Semi-automatic (auto)biographies within lifelog collections

Our life stories enable us to reflect upon and share our personal histories. Through emerging digital technologies the possibility of collecting life experiences digitally is increasingly feasible; consequently so is the potential to create a digital counterpart to our personal narratives. In this work, lifelogging tools are used to collect digital artifacts continuously and passively throughout our day. These include images, documents, emails and webpages accessed; texts messages and mobile activity. This range of data when brought together is known as a lifelog. Given the complexity, volume and multimodal nature of such collections, it is clear that there are significant challenges to be addressed in order to achieve coherent and meaningful digital narratives of our events from our life histories. This work investigates the construction of personal digital narratives from lifelog collections. It examines the underlying questions, issues and challenges relating to construction of personal digital narratives from lifelogs. Fundamentally, it addresses how to organize and transform data sampled from an individual’s day-to-day activities into a coherent narrative account. This enquiry is enabled by three 20-month long-term lifelogs collected by participants and produces a narrative system which enables the semi-automatic construction of digital stories from lifelog content. Inspired by probative studies conducted into current practices of curation, from which a set of fundamental requirements are established, this solution employs a 2-dimensional spatial framework for storytelling. It delivers integrated support for the structuring of lifelog content and its distillation into storyform through information retrieval approaches. We describe and contribute flexible algorithmic approaches to achieve both. Finally, this research inquiry yields qualitative and quantitative insights into such digital narratives and their generation, composition and construction. The opportunities for such personal narrative accounts to enable recollection, reminiscence and reflection with the collection owners are established and its benefit in sharing past personal experience experiences is outlined. Finally, in a novel investigation with motivated third parties we demonstrate the opportunities such narrative accounts may have beyond the scope of the collection owner in: personal, societal and cultural explorations, artistic endeavours and as a generational heirloom

Digital Media and Textuality: From Creation to Archiving

Due to computers' ability to combine different semiotic modes, texts are no longer exclusively comprised of static images and mute words. How have digital media changed the way we write and read? What methods of textual and data analysis have emerged? How do we rescue digital artifacts from obsolescence? And how can digital media be used or taught inside classrooms? These and other questions are addressed in this volume that assembles contributions by artists, writers, scholars and editors. They offer a multiperspectival view on the way digital media have changed our notion of textuality