Should machines be tools or tool-users? Clarifying motivations and assumptions in the quest for superintelligence

Much of the basic non-technical vocabulary of artificial intelligence is surprisingly ambiguous. Some key terms with unclear meanings include intelligence, embodiment, simulation, mind, consciousness, perception, value, goal, agent, knowledge, belief, optimality, friendliness, containment, machine and thinking. Much of this vocabulary is naively borrowed from the realm of conscious human experience to apply to a theoretical notion of “mind-in-general” based on computation. However, if there is indeed a threshold between mechanical tool and autonomous agent (and a tipping point for singularity), projecting human conscious-level notions into the operations of computers creates confusion and makes it harder to identify the nature and location of that threshold. There is confusion, in particular, about how—and even whether—various capabilities deemed intelligent relate to human consciousness. This suggests that insufficient thought has been given to very fundamental concepts—a dangerous state of affairs, given the intrinsic power of the technology. It also suggests that research in the area of artificial general intelligence may unwittingly be (mis)guided by unconscious motivations and assumptions. While it might be inconsequential if philosophers get it wrong (or fail to agree on what is right), it could be devastating if AI developers, corporations, and governments follow suit. It therefore seems worthwhile to try to clarify some fundamental notions

Translating Learning into Numbers: A Generic Framework for Learning Analytics

With the increase in available educational data, it is expected that Learning Analytics will become a powerful means to inform and support learners, teachers and their institutions in better understanding and predicting personal learning needs and performance. However, the processes and requirements behind the beneficial application of Learning and Knowledge Analytics as well as the consequences for learning and teaching are still far from being understood. In this paper, we explore the key dimensions of Learning Analytics (LA), the critical problem zones, and some potential dangers to the beneficial exploitation of educational data. We propose and discuss a generic design framework that can act as a useful guide for setting up Learning Analytics services in support of educational practice and learner guidance, in quality assurance, curriculum development, and in improving teacher effectiveness and efficiency. Furthermore, the presented article intends to inform about soft barriers and limitations of Learning Analytics. We identify the required skills and competences that make meaningful use of Learning Analytics data possible to overcome gaps in interpretation literacy among educational stakeholders. We also discuss privacy and ethical issues and suggest ways in which these issues can be addressed through policy guidelines and best practice examples

Habitual Ethics?

What if data-intensive technologies’ ability to mould habits with unprecedented precision is also capable of triggering some mass disability of profound consequences? What if we become incapable of modifying the deeply-rooted habits that stem from our increased technological dependence? On an impoverished understanding of habit, the above questions are easily shrugged off. Habits are deemed rigid by definition: ‘as long as our deliberative selves remain capable of steering the design of data-intensive technologies, we’ll be fine’. To question this assumption, this open access book first articulates the way in which the habitual stretches all the way from unconscious tics to purposive, intentionally acquired habits. It also highlights the extent to which our habit-reliant, pre-reflective intelligence normally supports our deliberative selves. It is when habit rigidification sets in that this complementarity breaks down. The book moves from a philosophical inquiry into the ‘double edge’ of habit — its empowering and compromising sides — to consideration of individual and collective strategies to keep habits at the service of our ethical life. Allowing the norms that structure our forms of life to be cotton-wooled in abstract reasoning is but one of the factors that can compromise ongoing social and moral transformations. Systems designed to simplify our practical reasoning can also make us ‘sheep-like’. Drawing a parallel between the moral risk inherent in both legal and algorithmic systems, the book concludes with concrete interventions designed to revive the scope for normative experimentation. It will appeal to any reader concerned with our retaining an ability to trigger change within the practices that shape our ethical sensibility. The eBook editions of this book are available open access under a CC BY-NC-ND 4.0 licence on bloomsburycollections.com. Open access was funded by the Mozilla Foundation

Habitual Ethics?

What if data-intensive technologies’ ability to mould habits with unprecedented precision is also capable of triggering some mass disability of profound consequences? What if we become incapable of modifying the deeply-rooted habits that stem from our increased technological dependence? On an impoverished understanding of habit, the above questions are easily shrugged off. Habits are deemed rigid by definition: ‘as long as our deliberative selves remain capable of steering the design of data-intensive technologies, we’ll be fine’. To question this assumption, this open access book first articulates the way in which the habitual stretches all the way from unconscious tics to purposive, intentionally acquired habits. It also highlights the extent to which our habit-reliant, pre-reflective intelligence normally supports our deliberative selves. It is when habit rigidification sets in that this complementarity breaks down. The book moves from a philosophical inquiry into the ‘double edge’ of habit — its empowering and compromising sides — to consideration of individual and collective strategies to keep habits at the service of our ethical life. Allowing the norms that structure our forms of life to be cotton-wooled in abstract reasoning is but one of the factors that can compromise ongoing social and moral transformations. Systems designed to simplify our practical reasoning can also make us ‘sheep-like’. Drawing a parallel between the moral risk inherent in both legal and algorithmic systems, the book concludes with concrete interventions designed to revive the scope for normative experimentation. It will appeal to any reader concerned with our retaining an ability to trigger change within the practices that shape our ethical sensibility. The eBook editions of this book are available open access under a CC BY-NC-ND 4.0 licence on bloomsburycollections.com. Open access was funded by the Mozilla Foundation

Critical Programming: Toward a Philosophy of Computing

Beliefs about the relationship between human beings and computing machines and their destinies have alternated from heroic counterparts to conspirators of automated genocide, from apocalyptic extinction events to evolutionary cyborg convergences. Many fear that people are losing key intellectual and social abilities as tasks are offloaded to the everywhere of the built environment, which is developing a mind of its own. If digital technologies have contributed to forming a dumbest generation and ushering in a robotic moment, we all have a stake in addressing this collective intelligence problem. While digital humanities continue to flourish and introduce new uses for computer technologies, the basic modes of philosophical inquiry remain in the grip of print media, and default philosophies of computing prevail, or experimental ones propagate false hopes. I cast this as-is situation as the post-postmodern network dividual cyborg, recognizing that the rational enlightenment of modernism and regressive subjectivity of postmodernism now operate in an empire of extended mind cybernetics combined with techno-capitalist networks forming societies of control. Recent critical theorists identify a justificatory scheme foregrounding participation in projects, valorizing social network linkages over heroic individualism, and commending flexibility and adaptability through life long learning over stable career paths. It seems to reify one possible, contingent configuration of global capitalism as if it was the reflection of a deterministic evolution of commingled technogenesis and synaptogenesis. To counter this trend I offer a theoretical framework to focus on the phenomenology of software and code, joining social critiques with textuality and media studies, the former proposing that theory be done through practice, and the latter seeking to understand their schematism of perceptibility by taking into account engineering techniques like time axis manipulation. The social construction of technology makes additional theoretical contributions dispelling closed world, deterministic historical narratives and requiring voices be given to the engineers and technologists that best know their subject area. This theoretical slate has been recently deployed to produce rich histories of computing, networking, and software, inform the nascent disciplines of software studies and code studies, as well as guide ethnographers of software development communities. I call my syncretism of these approaches the procedural rhetoric of diachrony in synchrony, recognizing that multiple explanatory layers operating in their individual temporal and physical orders of magnitude simultaneously undergird post-postmodern network phenomena. Its touchstone is that the human-machine situation is best contemplated by doing, which as a methodology for digital humanities research I call critical programming. Philosophers of computing explore working code places by designing, coding, and executing complex software projects as an integral part of their intellectual activity, reflecting on how developing theoretical understanding necessitates iterative development of code as it does other texts, and how resolving coding dilemmas may clarify or modify provisional theories as our minds struggle to intuit the alien temporalities of machine processes

Self-knowledge through self-tracking devices: design guidelines for usability and a socio-technical examination from posthumanity perspective

The Digital Era introduces emerging product categories that have evolved around certain habits and concepts. One tendency in the Information Age is recording and storing quantitative and qualitative data based on an individual's life by using ubiquitous computing devices. Such products, bringing self-observation and autobiographical memory capabilities to an extreme level, have the potential to morph human beings by augmenting and altering their self-understanding through presenting previously nonexistent information regarding their lives. The diversity found in this product range is increasing parallel to the growing demand. However, the meaning of these products for human life is rarely discussed. It remains a question whether these personal logs lead to an enriched self-knowledge for their users or not. This thesis aims to investigate the design principles and the influences of self-tracking products and services on daily life within a socio-technical framework in order to establish a connection between selftracking by ubiquitous computing devices and the notion of self-concept

정신건강에서 사용자 내러티브와 자아성찰을 지원하는 대화형 에이전트 디자인

학위논문 (박사) -- 서울대학교 대학원 : 융합과학기술대학원 융합과학부(디지털정보융합전공), 2020. 8. 서봉원.In the advent of artificial intelligence (AI), we are surrounded by technological gadgets, devices and intelligent personal assistant (IPAs) that voluntarily take care of our home, work and social networks. They help us manage our life for the better, or at least that is what they are designed for. As a matter of fact, few are, however, designed to help us grapple with the thoughts and feelings that often construct our living. In other words, technologies hardly help us think. How can they be designed to help us reflect on ourselves for the better? In the simplest terms, self-reflection refers to thinking deeply about oneself. When we think deeply about ourselves, there can be both positive and negative consequences. On the one hand, reflecting on ourselves can lead to a better self-understanding, helping us achieve life goals. On the other hand, we may fall into brooding and depression. The sad news is that the two are usually intertwined. The problem, then, is the irony that reflecting on oneself by oneself is not easy. To tackle this problem, this work aims to design technology in the form of a conversational agent, or a chatbot, to encourage a positive self-reflection. Chatbots are natural language interfaces that interact with users in text. They work at the tip of our hands as if SMS or instant messaging, from flight reservation and online shopping to news service and healthcare. There are even chatbot therapists offering psychotherapy on mobile. That machines can now talk to us creates an opportunity for designing a natural interaction that used to be humans own. This work constructs a two-dimensional design space for translating self-reflection into a human-chatbot interaction, with user self-disclosure and chatbot guidance. Users confess their thoughts and feelings to the bot, and the bot is to guide them in the scaffolding process. Previous work has established an extensive line of research on the therapeutic effect of emotional disclosure. In HCI, reflection design has posited the need for guidance, e.g. scaffolding users thoughts, rather than assuming their ability to reflect in a constructive manner. The design space illustrates different reflection processes depending on the levels of user disclosure and bot guidance. Existing reflection technologies have most commonly provided minimal levels of disclosure and guidance, and healthcare technologies the opposite. It is the aim of this work to investigate the less explored space by designing chatbots called Bonobot and Diarybot. Bonobot differentiates itself from other bot interventions in that it only motivates the idea of change rather than direct engagement. Diarybot is designed in two chat versions, Basic and Responsive, which create novel interactions for reflecting on a difficult life experience by explaining it to and exploring it with a chatbot. These chatbots are set up for a user study with 30 participants, to investigate the user experiences of and responses to design strategies. Based on the findings, challenges and opportunities from designing for chatbot-guided reflection are explored. The findings of this study are as follows. First, participants preferred Bonobots questions that prompted the idea of change. Its responses were also appreciated, but only when they conveyed accurate empathy. Thus questions, coupled with empathetic responses, could serve as a catalyst for disclosure and even a possible change of behavior, a motivational boost. Yet the chatbot-led interaction led to surged user expectations for the bot. Participants demanded more than just the guidance, such as solutions and even superhuman intelligence. Potential tradeoff between user engagement and autonomy in designing human-AI partnership is discussed. Unlike Bonobot, Diarybot was designed with less guidance to encourage users own narrative making. In both Diarybot chats, the presence of a bot could make it easier for participants to share the most difficult life experiences, compared to a no-chatbot writing condition. Yet an increased interaction with the bot in Responsive chat could lead to a better user engagement. On the contrary, more emotional expressiveness and ease of writing were observed with little interaction in Basic chat. Coupled with qualitative findings that reveal user preference for varied interactions and tendency to adapt to bot patterns, predictability and transparency of designing chatbot interaction are discussed in terms of managing user expectations in human-AI interaction. In sum, the findings of this study shed light on designing human-AI interaction. Chatbots can be a potential means of supporting guided disclosure on lifes most difficult experiences. Yet the interaction between a machine algorithm and an innate human cognition bears interesting questions for the HCI community, especially in terms of user autonomy, interface predictability, and design transparency. Discussing the notion of algorithmic affordances in AI agents, this work proposes meaning-making as novel interaction design metaphor: In the symbolic interaction via language, AI nudges users, which inspires and engages users in their pursuit of making sense of lifes agony. Not only does this metaphor respect user autonomy but also it maintains the veiled workings of AI from users for continued engagement. This work makes the following contributions. First, it designed and implemented chatbots that can provide guidance to encourage user narratives in self-reflection. Next, it offers empirical evidence on chatbot-guided disclosure and discusses implications for tensions and challenges in design. Finally, this work proposes meaning-making as a novel design metaphor. It calls for the responsible design of intelligent interfaces for positive reflection in pursuit of psychological wellbeing, highlighting algorithmic affordances and interpretive process of human-AI interaction.최근 인공지능(Artificial Intelligence; AI) 기술은 우리 삶의 면면을 매우 빠르게 바꿔놓고 있다. 특히 애플의 시리(Siri)와 구글 어시스턴트 (Google Assistant) 등 자연어 인터페이스(natural language interfaces)의 확장은 곧 인공지능 에이전트와의 대화가 인터랙션의 주요 수단이 될 것임을 능히 짐작케 한다. 실상 인공지능 에이전트는 실생활에서 콘텐츠 추천과 온라인 쇼핑 등 다양한 서비스를 제공하고 있지만, 이들의 대부분은 과업-지향적이다. 즉 인공지능은 우리의 삶을 편리하게 하지만, 과연 편안하게 할 수 있는가? 본 연구는 편하지만 편하지 않은 현대인을 위한 기술의 역할을 고민하는 데에서 출발한다. 자아성찰(self-reflection), 즉 자신에 대해 깊이 생각해 보는 활동은 자기인식과 자기이해를 도모하고 배움과 목표의식을 고취하는 등 분야를 막론하고 널리 연구 및 적용되어 왔다. 하지만 자아성찰의 가장 큰 어려움은 스스로 건설적인 성찰을 도모하기 힘들다는 것이다. 특히, 부정적인 감정적 경험에 대한 자아성찰은 종종 우울감과 불안을 동반한다. 극복이 힘든 경우 상담 또는 치료를 찾을 수 있지만, 사회적 낙인과 잣대의 부담감으로 꺼려지는 경우가 다수이다. 성찰 디자인(Reflection Design)은 인간-컴퓨터상호작용(HCI)의 오랜 화두로, 그동안 효과적인 성찰을 도울 수 있는 디자인 전략들이 다수 연구되어 왔지만 대부분 다양한 사용자 데이터 수집 전략을 통해 과거 회상 및 해석을 돕는 데 그쳤다. 최근 소위 챗봇 상담사가 등장하여 심리상담과 치료 분야에 적용되고 있지만, 이 또한 성찰을 돕기보다는 효율적인 처치 도구에 머무르고 있을 뿐이다. 즉 기술은 치료 수단이거나 성찰의 대상이 되지만, 그 과정에 개입하는 경우는 제한적이라고 할 수 있다. 이에 본 연구는 성찰 동반자로서 대화형 에이전트인 챗봇을 디자인할 것을 제안한다. 이 챗봇의 역할은 사용자의 부정적인 감정적 경험 또는 트라우마에 대해 이야기할 수 있도록 도울 뿐 아니라, 그 과정에서 반추를 통제하여 건설적인 내러티브를 이끌어 내는 가이드를 제공하는 것이다. 이러한 챗봇을 설계하기 위해, 선행 연구를 기반으로 사용자의 자기노출(user self-disclosure)과 챗봇 가이드(guidance)를 두 축으로 한 디자인 공간(design space)을 정의하였다. 그리고 자기노출과 가이드의 정도에 따른 네 가지 자아성찰 경험을 분류하였다: 자기노출과 가이드가 최소화된 회상 공간, 자기노출이 위주이고 가이드가 최소화된 설명 공간, 자기노출과 챗봇이 이끄는 가이드가 혼합된 탐색 공간, 가이드를 적극 개입시켜 자기노출을 높이는 변화 공간이 그것이다. 본 연구의 목표는 상술된 디자인 공간에서의 성찰 경험과 과정을 돕는 챗봇을 구현하고, 사용자 실험을 통해 성찰 경험과 디자인 전략에 대한 반응을 수집 및 분석함으로써 챗봇 기반의 자아 성찰 인터랙션을 새롭게 제시하고 이에 대한 실증적 근거를 마련하는 것이다. 현재까지 많은 성찰 기술은 회상에 집중되어 있기에, 나머지 세 공간에서의 성찰을 지원하는 보노봇과 기본형반응형 일기봇을 디자인하였다. 또한, 사용자 평가를 바탕으로 도출한 연구결과를 통해 도래한 인간-인공지능 상호작용(human-AI interaction)의 맥락에서 성찰 동반자로서의 챗봇 기술이 갖는 의미와 역할을 탐구한다. 보노봇과 일기봇은 인간중심상담과 대화분석의 이론적 근거를 바탕으로 한 정서지능(emotional intelligence)과 절차지능(proecedural intelligence)을 핵심 축으로, 대화 흐름 제어(flow manager)와 발화 생성(response generator)을 핵심 모듈로 구현하였다. 먼저, 보노봇은 동기강화상담(motivational interviewing)을 기반으로 고민과 스트레스에 대한 내러티브를 이끌어내어, 이에 대한 해결을 위한 가이드 질문을 통해 변화를 위한 성찰을 돕는다. 챗봇의 구현을 위해, 동기강화상담의 네 단계 대화를 설정하고 각 단계를 구성할 수 있는 상담사 발화 행동을 관련문헌에서 수집 및 전처리 과정을 거쳐 스크립트화하였다. 또한, 사전 전처리된 문장이 맥락을 유지할 수 있는 대화에 쓰일 수 있도록, 대화의 주제는 대학원생의 어려움으로 한정하였다. 보노봇과의 대화가 사용자의 성찰에 미치는 영향과 이에 대한 인식을 탐색하기 위해 질적 연구방법을 사용하여 30명의 대학원생과 사용자 실험을 진행하였다. 실험결과, 사용자는 변화 대화를 유도할 수 있는 다양한 탐색 질문을 선호하였다. 또한, 사용자의 맥락에 정확히 들어맞는 질문과 피드백은 사용자를 더욱 적극적인 자기 노출로 이끌게 할 수 있음을 발견하였다. 그러나 챗봇이 마치 상담사처럼 대화를 이끌어갈 경우, 높아진 사용자의 기대 수준으로 인해 일부 사용자가 변화에 대한 동기를 표출하였음에도 불구하고 변화에 대한 자율성을 챗봇에 양도하려는 모습 또한 나타남을 분석하였다. 보노봇 연구를 바탕으로 일기봇은 챗봇 대신 사용자가 보다 적극적으로 성찰 내러티브를 전개할 수 있도록 디자인하였다. 일기봇은 트라우마에 대한 표현적 글쓰기를 지원하는 챗봇으로, 기본형 또는 반응형 대화를 제공한다. 기본형 대화는 트라우마에 대해 자유롭게 설명할 수 있는 대화 환경을 제공하고, 반응형 대화는 사용자가 작성한 내러티브에 대한 후속 인터랙션을 통해 과거의 경험을 재탐색하도록 하였다. 또한, 후속 인터랙션의 발화 행동은 다양한 상담치료에서 발췌하되 유저의 내러티브에서 추출한 감정어 및 인간관계 키워드를 활용하도록 하였다. 각 일기봇에 대한 반응을 비교 분석하기 위해, 챗봇 없이 도큐먼트에 표현적 글쓰기 활동만을 하는 대조군을 설정하고 30명의 사용자를 모집하여 각 조건에 랜덤으로 배정, 설문과 면담을 동반한 4일간의 글쓰기 실험을 진행하였다. 실험결과, 사용자는 일기봇과의 인터랙션을 통해 보이지 않는 가상의 청자를 상상함으로써 글쓰기를 대화 활동으로 인지하고 있음을 알 수 있었다. 특히, 반응형 대화의 후속 질문들은 사용자로 하여금 상황을 객관화하고 새로운 관점으로 생각해 볼 수 있는 효과를 거두었다. 반응형 대화에서 후속 인터랙션을 경험한 사용자는 일기봇의 인지된 즐거움과 사회성, 신뢰도와 재사용 의향에 대한 평가가 다른 두 조건에서보다 유의하게 높았다. 반면, 기본형 대화 참여자는 다른 두 조건에서보다 감정적 표현의 용이성과 글쓰기의 어려움을 각각 유의하게 높게, 그리고 낮게 평가하였다. 즉, 챗봇은 많은 인터랙션 없이도 청자의 역할을 수행할 수 있었지만, 후속 질문을 통한 인터랙션이 가능했던 반응형 대화는 더욱 적극적인 유저 참여(engagement)를 이끌어낼 수 있었다. 또한, 실험이 진행됨에 따라, 사용자가 반응형 일기봇의 알고리즘에 자신의 글쓰기 주제와 단어 선택 등을 맞게 바꾸어 가는 적응적(adaptive) 행동이 관찰되었다. 앞선 연구결과를 통해, 다양한 챗봇 디자인 전략을 바탕으로 사용자의 내러티브가 다르게 유도될 수 있으며, 따라서 서로 다른 유형의 성찰 경험을 이끌어낼 수 있음을 발견하였다. 또한, 자율적인 행위인 자아성찰이 기술과의 상호작용으로 호혜적 성질을 갖게 될 때 사용자의 자율성, 상호작용의 예측가능성과 디자인 투명성에서 발생할 수 있는 갈등관계(tensions)를 탐색하고 인공지능 에이전트의 알고리즘 어포던스(algorithmic affordances)를 논의하였다. 보이지 않는 챗봇 알고리즘에 의해 사용자의 성찰이 유도될 수 있다는 것은 기존의 인간-컴퓨터 상호작용에서 강조되는 사용자 제어와 디자인 투명성에서 전복을 초래하는 것처럼 보일 수 있으나, 상징적 상호작용(symbolic interaction)의 맥락에서 오히려 사용자가 알고리즘에 의해 지나간 과거에 대한 새로운 의미를 적극 탐색해나가는 과정이 될 수 있다. 본 연구는 이것을 새로운 디자인 메타포, 즉 의미-만들기(meaning-making)로 제안하고 알고리즘의 넛지(nudge)에 의한 사용자의 주관적 해석 경험(interpretive process)을 강조한다. 이것은 하나의 챗봇 알고리즘이라 할지라도 서로 다른 사용자의 다양한 성찰 경험을 유도해낼 수 있다는 것을 의미하며, 이러한 맥락에서 인공지능은 기존의 블랙 박스를 유지하면서도 사용자의 자율성을 보장할 수 있다. 본 연구는 우리와 협업하는 인공지능 챗봇 기술의 디자인에 대한 경험적 이해를 높이고, 이론을 기반으로 한 챗봇을 구현함으로써 디자인 전략에 대한 실증적 근거를 제시한다. 또한 자아 성찰 과정에 동행하는 동반자(companion)로서의 기술로 새로운 디자인 메타포를 제시함으로써 인간컴퓨터상호작용(HCI)의 이론적 확장에 기여하고, 사용자의 부정적 경험에 대한 의미 추구를 돕는 관계지향적 인공지능으로서 향후 현대인의 정신건강에 이바지할 수 있는 사회적, 산업적 의의를 갖는다.CHAPTER 1. INTRODUCTION １ 1.1. BACKGROUND AND MOTIVATION １ 1.2. RESEARCH GOAL AND QUESTIONS ５ 1.2.1. Research Goal ５ 1.2.2. Research Questions ５ 1.3. MAJOR CONTRIBUTIONS ８ 1.4. THESIS OVERVIEW ９ CHAPTER 2. LITERATURE REVIEW １１ 2.1. THE REFLECTING SELF １１ 2.1.1. Self-Reflection and Mental Wellbeing １１ 2.1.2. The Self in Reflective Practice １５ 2.1.3. Design Space ２２ 2.2. SELF-REFLECTION IN HCI ２６ 2.2.1. Reflection Design in HCI ２６ 2.2.2. HCI for Mental Wellbeing ３６ 2.2.3. Design Opportunities ４０ 2.3. CONVERSATIONAL AGENT DESIGN ４２ 2.3.1. Theoretical Background ４２ 2.3.2. Technical Background ４７ 2.3.3. Design Strategies ４９ 2.4. SUMMARY ６９ CHAPTER 3. DESIGNING CHATBOT FOR TRANSFORMATIVE REFLECTION ７１ 3.1. DESIGN GOAL AND DECISIONS ７１ 3.2. CHATBOT IMPLEMENTATION ７６ 3.2.1. Emotional Intelligence ７６ 3.2.2. Procedural Intelligence ７７ 3.3. EXPERIMENTAL USER STUDY ７９ 3.3.1. Participants ７９ 3.3.2. Task ８０ 3.3.3. Procedure ８０ 3.3.4. Ethics Approval ８０ 3.3.5. Surveys and Interview ８１ 3.4. RESULTS ８２ 3.4.1. Survey Findings ８２ 3.4.2. Qualitative Findings ８３ 3.5. IMPLICATIONS ８８ 3.5.1. Articulating Hopes and Fears ８９ 3.5.2. Designing for Guidance ９１ 3.5.3. Rethinking Autonomy ９２ 3.6. SUMMARY ９４ CHAPTER 4. DESIGNING CHATBOTS FOR EXPLAINING AND EXPLORING REFLECTIONS ９６ 4.1. DESIGN GOAL AND DECISIONS ９６ 4.1.1. Design Decisions for Basic Chat ９８ 4.1.2. Design Decisions for Responsive Chat ９８ 4.2. CHATBOT IMPLEMENTATION １０２ 4.2.1. Emotional Intelligence １０３ 4.2.2. Procedural Intelligence １０５ 4.3. EXPERIMENTAL USER STUDY １０６ 4.3.1. Participants １０６ 4.3.2. Task １０７ 4.3.3. Procedure １０７ 4.3.4. Safeguarding of Study Participants and Ethics Approval １０８ 4.3.5. Surveys and Interviews １０８ 4.4. RESULTS １１１ 4.4.1. Quantitative Findings １１１ 4.4.2. Qualitative Findings １１８ 4.5. IMPLICATIONS １２７ 4.5.1. Telling Stories to a Chatbot １２８ 4.5.2. Designing for Disclosure １３０ 4.5.3. Rethinking Predictability and Transparency １３２ 4.6. SUMMARY １３３ CHAPTER 5. DESIGNING CHATBOTS FOR SELF-REFLECTION: SUPPORTING GUIDED DISCLOSURE １３５ 5.1. DESIGNING FOR GUIDED DISCLOSURE １３９ 5.1.1. Chatbots as Virtual Confidante １３９ 5.1.2. Routine and Variety in Interaction １４１ 5.1.3. Reflection as Continued Experience １４４ 5.2. TENSIONS IN DESIGN １４５ 5.2.1. Adaptivity １４５ 5.2.2. Autonomy １４７ 5.2.3. Algorithmic Affordance １４８ 5.3. MEANING-MAKING AS DESIGN METAPHOR １５０ 5.3.1. Meaning in Reflection １５１ 5.3.2. Meaning-Making as Interaction １５３ 5.3.3. Making Meanings with AI １５５ CHAPTER 6. CONCLUSION １５８ 6.1. RESEARCH SUMMARY １５８ 6.2. LIMITATIONS AND FUTURE WORK １６１ 6.3. FINAL REMARKS １６３ BIBLIOGRAPHY １６５ ABSTRACT IN KOREAN １９２Docto

Data Epistemologies / Surveillance and Uncertainty

Data Epistemologies studies the changing ways in which ‘knowledge’ is defined, promised, problematised, legitimated vis-á-vis the advent of digital, ‘big’ data surveillance technologies in early twenty-first century America. As part of the period’s fascination with ‘new’ media and ‘big’ data, such technologies intersect ambitious claims to better knowledge with a problematisation of uncertainty. This entanglement, I argue, results in contextual reconfigurations of what ‘counts’ as knowledge and who (or what) is granted authority to produce it – whether it involves proving that indiscriminate domestic surveillance prevents terrorist attacks, to arguing that machinic sensors can know us better than we can ever know ourselves. The present work focuses on two empirical cases. The first is the ‘Snowden Affair’ (2013-Present): the public controversy unleashed through the leakage of vast quantities of secret material on the electronic surveillance practices of the U.S. government. The second is the ‘Quantified Self’ (2007-Present), a name which describes both an international community of experimenters and the wider industry built up around the use of data-driven surveillance technology for self-tracking every possible aspect of the individual ‘self’. By triangulating media coverage, connoisseur communities, advertising discourse and leaked material, I examine how surveillance technologies were presented for public debate and speculation. This dissertation is thus a critical diagnosis of the contemporary faith in ‘raw’ data, sensing machines and algorithmic decision-making, and of their public promotion as the next great leap towards objective knowledge. Surveillance is not only a means of totalitarian control or a technology for objective knowledge, but a collective fantasy that seeks to mobilise public support for new epistemic systems. Surveillance, as part of a broader enthusiasm for ‘data-driven’ societies, extends the old modern project whereby the human subject – its habits, its affects, its actions – become the ingredient, the raw material, the object, the target, for the production of truths and judgments about them by things other than themselves

THE VARIETIES OF USER EXPERIENCE BRIDGING EMBODIED METHODOLOGIES FROM SOMATICS AND PERFORMANCE TO HUMAN COMPUTER INTERACTION

Embodied Interaction continues to gain significance within the field of Human Computer Interaction (HCI). Its growing recognition and value is evidenced in part by a remarkable increase in systems design and publication focusing on various aspects of Embodiment. The enduring need to interact through experience has spawned a variety of interdisciplinary bridging strategies in the hope of gaining deeper understanding of human experience. Along with phenomenology, cognitive science, psychology and the arts, recent interdisciplinary contributions to HCI include the knowledge-rich domains of Somatics and Performance that carry long-standing traditions of embodied practice. The common ground between HCI and the fields of Somatics and Performance is based on the need to understand and model human experience. Yet, Somatics and Performance differ from normative HCI in their epistemological frameworks of embodiment. This is particularly evident in their histories of knowledge construction and representation. The contributions of Somatics and Performance to the history of embodiment are not yet fully understood within HCI. Differing epistemologies and their resulting approaches to experience identify an under-theorized area of research and an opportunity to develop a richer knowledge and practice base. This is examined by comparing theories and practices of embodied experience between HCI and Somatics (Performance) and analyzing influences, values and assumptions underlying epistemological frameworks. The analysis results in a set of design strategies based in embodied practices within Somatics and Performance. The subsequent application of these strategies is examined through a series of interactive art installations that employ embodied interaction as a central expression of technology. Case Studies provide evidence in the form of rigorously documented design processes that illustrate these strategies. This research exemplifies 'Research through Art' applied in the context of experience design for tangible, wearable and social interaction