Wizards of Oz in the Evolving Map of Design Research – Trying to Frame GUI Interaction Interviews

We present and discuss GUI-ii, Graphical User Interface interaction interview, a method used to remotely discuss, develop and test GUI prototypes with users and stakeholders. Examples of such sessions are presented to demonstrate that the main benefits of GUI-ii are that this way of co-designing allows for interaction-informed discussions around functions and user interfaces, where re-design and hands-on experience can be integrated and efficiently carried out remotely. Using a facilitation tool to enact GUI layout and responses allows participation and evaluation to take turns in participatory design processes in a productive way. We discuss this form of Participatory Design along the dimensions found in Sanders’ Map of Design Research. The discussion concludes that GUI-ii facilitates participation by relaxing demands for physical presence and by allowing people to participate from their own work environment while still making it easy for them to directly influence contents, structure and interaction

Introducing a Socio-Technical Perspective on Digital Competence Education Through Co-design

Digital competence and programming have been part of the Swedish school curricula since 2018. This paper demonstrates how co-design design activities can be conducted as a way to provide digital competence education from a socio-technical perspective. Such activities were conducted with novice designers in three sessions, each with two school classes, from a Swedish engineering upper secondary school program in 2019. The students gained hands-on experience with interaction design and co-design as they designed a mobile application using a Wizard-of-Oz prototyping system and evaluated the prototype with users. This trial is used to argue that time allocation for socio-technical perspectives on digital competence in the Swedish school curricula can be expanded to be able to provide students with a more holistic view of digitization beyond technical issues

Capturing Situational Context in an Augmented Memory System

Bookmarking a moment is a new approach being introduced to capture past experience and insert information into an augmented memory system. This idea is inspired from the concept of the bookmark in web browsers. Semi-automatic bookmarking different moments when time is limited and revisiting these moments before inserting them into an augmented memory system will help people to remember their past experience. An exploratory study was conducted to discover and shape the design requirements for a system called CatchIt. It aims to understand end-users’ needs to capture their personal experience, which is an important and complex issue in the case of capture and access of personal experiences. CatchIt is a system to bookmark the significant moments during the day before enriching them, and entering them into the augmented memory system called Digital Parrot. The conceptual design of CatchIt will be the main aim of this study. The primary requirements were derived from the scenarios and analysis of the findings of five different study stages were designed to inspect these: unobserved field visit, shadowing, using indictors, Wizard of Oz and using technology. Thirty participants were involved in field visit, survey and follows up interview. Each stage had different tasks to be performed and the findings of each stage contributed to understanding different parts of user needs and system design requirements. The results of this study indicated the system should automatically record the context information, especially the time and location since they were typically neglected by the participants. Different information such as textual and visual information should be manually recorded based on the users’ setting or situations. A single button is a promising input mechanism to bookmark a moment and it should be fast and effort- less. The result showed no clear correlation between learning style and type of the information that had been captured. Also, we found that there might be a correlation between passive capture and false memories. All these findings were used to provide a foundation for further work to implement the bookmark system and evaluate this approach. Some issues raised in this study need further research. The work will contribute to a greater understanding of human memory and selective capture

Analysis of the interaction between elderly people and a simulated virtual coach

The EMPATHIC project develops and validates new interaction paradigms for personalized virtual coaches (VC) to promote healthy and independent aging. To this end, the work presented in this paper is aimed to analyze the interaction between the EMPATHIC-VC and the users. One of the goals of the project is to ensure an end-user driven design, involving senior users from the beginning and during each phase of the project. Thus, the paper focuses on some sessions where the seniors carried out interactions with a Wizard of Oz driven, simulated system. A coaching strategy based on the GROW model was used throughout these sessions so as to guide interactions and engage the elderly with the goals of the project. In this interaction framework, both the human and the system behavior were analyzed. The way the wizard implements the GROW coaching strategy is a key aspect of the system behavior during the interaction. The language used by the virtual agent as well as his or her physical aspect are also important cues that were analyzed. Regarding the user behavior, the vocal communication provides information about the speaker's emotional status, that is closely related to human behavior and which can be extracted from the speech and language analysis. In the same way, the analysis of the facial expression, gazes and gestures can provide information on the non verbal human communication even when the user is not talking. In addition, in order to engage senior users, their preferences and likes had to be considered. To this end, the effect of the VC on the users was gathered by means of direct questionnaires. These analyses have shown a positive and calm behavior of users when interacting with the simulated virtual coach as well as some difficulties of the system to develop the proposed coaching strategy.The research presented in this paper is conducted as part of the project EMPATHIC that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement no 769872

A framework for the design, prototyping and evaluation of mobile interfaces for domestic environments

The idea of the smart home has been discussed for over three decades, but it has yet to achieve mass-market adoption. This thesis asks the question Why is my home not smart? It highlights four main areas that are barriers to adoption, and concentrates on a single one of these issues: usability. It presents an investigation that focuses on design, prototyping and evaluation of mobile interfaces for domestic environments resulting in the development of a novel framework. A smart home is the physical realisation of a ubiquitous computing system for domestic living. The research area offers numerous benefits to end-users such as convenience, assistive living, energy saving and improved security and safety. However, these benefits have yet to become accessible due to a lack of usable smart home control interfaces. This issue is considered a key reason for lack of adoption and is the focus for this thesis. Within this thesis, a framework is introduced as a novel approach for the design, prototyping and evaluation of mobile interfaces for domestic environments. Included within this framework are three components. Firstly, the Reconfigurable Multimedia Environment (RME), a physical evaluation and observation space for conducting user centred research. Secondly, Simulated Interactive Devices (SID), a video-based development and control tool for simulating interactive devices commonly found within a smart home. Thirdly, iProto, a tool that facilitates the production and rapid deployment of high fidelity prototypes for mobile touch screen devices. This framework is evaluated as a round-tripping toolchain for prototyping smart home control and found to be an efficient process for facilitating the design and evaluation of such interfaces

헬스케어를 위한 대화형 인공지능의 모사된 페르소나 디자인 및 사용자 경험 연구

학위논문(박사) -- 서울대학교대학원 : 인문대학 협동과정 인지과학전공, 2021.8. 이준환.디지털 헬스케어(Digital Healthcare) 기술의 발전은 일상 헬스케어 영역에서의 혁신을 주도 하고 있다. 이는 의학 전문가들의 정확한 진단, 질병의 치료를 도울 뿐만 아니라 사용자가 스스로 일상에서 자기관리를 할 수 있도록 돕는다. 디지털 헬스케어 기술의 대표적인 목표 중 하나는 효과적으로 헬스케어 서비스를 개인화 시키는 것인데, 이러한 측면에서 대화형 인공지능(Conversational AI)은 사용하기 쉽고 효율적인 비용으로 개인화된 서비스를 제공할 수 있기에 주목받고 있다. 기존의 개인화된 케어 서비스들의 경우는 대부분 의료기관의 질병치료 서비스들에 포함되었는데, 대화형 인공지능은 이러한 개인화된 케어 서비스의 영역을 일상에서의 질병 예방을 위한 관리로 확장하는데 기여한다. 일대일 대화를 통해 맞춤형 교육, 테라피, 그외의 관련 정보 등을 제공할 수 있다는 측면에서 일상 헬스케어에 적합한 디지털 헬스케어 기술로의 활용도가 높다. 이러한 이점으로 인해 다양한 역할을 가진 대화형 인공지능들의 개발이 이루어지고 있다. 그러나, 이러한 대화형 인공지능들에게 사용자의 선호도에 적합한 페르소나를 부여하는 연구는 드물게 이루어 지고 있다. 대화형 인공지능의 주요 기능인 자연어 기반 상호작용은 CASA 패러다임(CASA Paradigm)에서 제기하는 사용자가 시스템을 의인화하는 경향을 높인다. 때문에 페르소나에 대한 사용자의 선호도가 지속적인 대화형 인공지능의 사용과 몰입에 영향을 미친다. 또한 대화형 인공지능의 장기적인 사용을 위해서 적절한 사용자와의 사회적, 감정적 상호작용을 디자인 해 주어야 하는데, 인지된 페르소나에 대한 사용자의 선호도가 이 과정에도 유의미한 영향을 미친다. 때문에 지속적인 참여가 결과에 큰 영향을 미치는 일상 헬스케어 영역에서 대화형 인공지능을 활용하는데 개인화된 페르소나 디자인이 긍정적인 사용자 경험 및 사용자 건강 증진의 가능성을 높일 것으로 본 연구는 가정한다. 개인화된 페르소나 디자인을 위해 사용자와 현실에서 친밀한 관계에 있는 실존인물(호스트)의 페르소나를 대화형 인공지능에 적용하고 평가하는 것이 본 연구의 핵심적인 아아디어이다. 이를 검증하기 위해서 해당 학위 논문은 총 세 가지의 세부 연구를 포함한다. 첫째는 실존인물의 페르소나 중에서도 일상 건강관리에 적합한 호스트의 페르소나를 탐색하는 연구이다. 둘째는 호스트의 페르소나를 대화형 인공지능에 적용하기 위해 고려해야 할 언어적 요소들을 정의하는 연구이다. 마지막으로는 위의 과정을 통해 개발된 실존하는 인물의 페르소나를 가진 대화형 인공지능이 일상 헬스케어 영역에서 실제 효과를 보이는지를 평가하는 연구이다. 또한 해당 학위논문은 일련의 연구들에서 발견한 결과들을 바탕으로 사용자와 친밀한 관계에 있는 페르소나를 일상 헬스케어를 위한 대화형 인공지능에 적용할 때 고려해야할 디자인 함의점들을 도출하고 가이드라인을 제시한다.Advance in digital healthcare technologies has been leading a revolution in healthcare. It has been showing the enormous potential to improve medical professionals’ ability for accurate diagnosis, disease treatment, and the users’ daily self-care. Since the recent transformation of digital healthcare aims to provide effective personalized health services, Conversational AI (CA) is being highlighted as an easy-to-use and cost-effective means to deliver personalized services. Particularly, CA is gaining attention as a mean for personalized care by ingraining positive self-care behavior in a daily manner while previous methods for personalized care are focusing on the medical context. CA expands the boundary of personalized care by enabling one-to-one tailored conversation to deliver health education and healthcare therapies. Due to CA's opportunities as a method for personalized care, it has been implemented with various types of roles including CA for diagnosis, CA for prevention, and CA for therapy. However, there lacks study on the personalization of healthcare CA to meet user's preferences on the CA's persona. Even though the CASA paradigm has been applied to previous studies designing and evaluating the human-likeness of CA, few healthcare CAs personalize its human-like persona except some CAs for mental health therapy. Moreover, there exists the need to improve user experience by increasing social and emotional interaction between the user and the CA. Therefore, designing an acceptable and personalized persona of CA should be also considered to make users to be engaged in the healthcare task with the CA. In this manner, the thesis suggests an idea of applying the persona of the person who is in a close relationship with the user to the conversational CA for daily healthcare as a strategy for persona personalization. The main hypothesis is the idea of applying a close person's persona would improve user engagement. To investigate the hypothesis, the thesis explores if dynamics derived from the social relationship in the real world can be implemented to the relationship between the user and the CA with the persona of a close person. To explore opportunities and challenges of the research idea, series of studies were conducted to (1) explore appropriate host whose persona would be implemented to healthcare CA, (2) define linguistic characteristics to consider when applying the persona of a close person to the CA, and (3)implement CA with the persona of a close person to major lifestyle domains. Based on findings, the thesis provides design guidelines for healthcare CA with the persona of the real person who is in a close relationship with the user.Abstract 1 1 Introduction 12 2 Literature Review 18 2.1 Roles of CA in Healthcare 18 2.2 Personalization in Healthcare CA 23 2.3 Persona Design CA 25 2.4 Methods for Designing Chatbot’s Dialogue Style 30 2.4.1 Wizard of Oz Method 32 2.4.2 Analyzing Dialogue Data with NLP 33 2.4.3 Participatory Design 35 2.4.4 Crowdsourcing 37 3 Goal of the Study 39 4 Study 1. Exploring Candidate Persona for CA 43 4.1 Related Work 44 4.1.1 Need for Support in Daily Healthcare 44 4.1.2 Applying Persona to Text-based CA 45 4.2 Research Questions 47 4.3 Method 48 4.3.1 Wizard of Oz Study 49 4.3.2 Survey Measurement 52 4.3.3 Post Interview 54 4.3.4 Analysis 54 4.4 Results 55 4.4.1 System Acceptance 56 4.4.2 Perceived Trustfulness and Perceived Intimacy 57 4.4.3 Predictive Power of Corresponding Variables 58 4.4.4 Linguistic Factors Affecting User Perception 58 4.5 Implications 60 5 Study 2. Linguistic Characteristics to Consider When Applying Close Person’s Persona to a Text-based Agent 63 5.1 Related Work 64 5.1.1 Linguistic Characteristics and Persona Perception 64 5.1.2 Language Component 66 5.2 Research Questions 68 5.3 Method 69 5.3.1 Modified Wizard of Oz Study 69 5.3.2 Survey 72 5.4 Results 73 5.4.1 Linguistic Characteristics 73 5.4.2 Priority of Linguistic Characteristics 80 5.4.3 Differences between language Component 82 5.5 Implications 82 6 Study3.Implementation on Lifestyle Domains 85 6.1 Related Work 86 6.1.1 Family as Effective Healthcare Provider 86 6.1.2 Chatbots Promoting Healthy Lifestyle 87 6.2 Research questions 94 6.3 Implementing Persona of Family Member 95 6.3.1 Domains of Implementation 96 6.3.2 Measurements Used in the Study 97 6.4 Experiment 1: Food Journaling Chatbot 100 6.4.1 Method 100 6.4.2 Results 111 6.5 Experiment 2: Physical Activity Intervention 128 6.5.1 Method 131 6.5.2 Results 140 6.6 Experiment 3: Chatbot for Coping Stress 149 6.6.1 Method 151 6.6.2 Results 158 6.7 Implications from Domain Experiments 169 6.7.1 Comparing User Experience 170 6.7.2 Comparing User Perception 174 6.7.3 Implications from Study 3 183 7 Discussion 192 7.1 Design Guidelines 193 7.2 Ethical Considerations 200 7.3 Limitations 206 8 Conclusion 210 References 212 Appendix 252 국문초록 262박

The Erasure of Rural West Texas Voices in Higher Education Institutions an Autoethnographic Study of Minoritized Students of West Texas in Their Journey to Obtain Success in Higher Education Institutions

I was once told there is a person in the world who has locked within his or her mind the framework for the cure for cancer or even the ability to create an energy model that will revolutionize how society consumes natural resources. Now imagine if I told you I have seen that person alive and well working as an oil well driller on a rig in Mentone, Texas. The first question most people would ask is, “Why is the person drilling in the middle of nowhere Texas instead of impacting the world by way of displaying his or her incredible innovative potential?” This scenario is the basis of my study. I want to bring to the forefront the stories of the rural minoritized students whose innovation has been discarded, overlooked, and erased because it has consistently been deemed irrelevant or unimportant by the collegiate world. In consideration of the alienation and isolation that these minoritized students face, I am proposing an autoethnographic study that merges cultural and social issues related to the divisive code-switching rhetoric minoritized students are forced to utilize in institutions of higher learning and the narratives about the architecture of the academic buildings they are forced to inhabit. I will analyze how higher education institutions negate these students’ ethnic diversity and innovative potential by coercing them into silence or submission, forcing them to assimilate, discouraging them through persuasive reasoning, or isolating them in the built environment. These students leave the safety of their small environments hoping to learn from or contribute to the collegiate world, only to discover that the universities they have aspired to join will overlook and devalue them until they leave or assimilate into the predetermined role the school has designed for them. My interviews with various high school students will document their experiences with the collegiate world and how their vision, direction, and contributions to higher education institutions were stifled, controlled, neglected, or silenced

Real, Truly Live Places: Notes toward the Queer Uncanny

This dissertation problematizes contemporary ideas of epistemological dependability and advances queer theory's critique of heteronormativity by reading the psychoanalytic concept of the uncanny in conjunction with the critical concept of the queer to produce the queer uncanny. The first chapter analyzes the The Wizard of Oz (1939) and introduces the disruptive interpretive potential of the queer uncanny in several of its manifestations: the compulsion to repeat, doubling, and dislogic. The second chapter focuses on the novel Mysterious Skin (Scott Heim) and of redemption in light of childhood sexual molestation, demonstrates the ability of the queer uncanny to broaden available interpretative ranges vis-à-vis cultural discourses surrounding traumatic events like child sexual abuse. The final chapter applies the lens of the queer uncanny to a municipal domestic partnership registry ordinance that by its own terms provides no rights to registrants but which upon further analysis turns out to offer evidence of the performative potential of the queer uncanny