2,953 research outputs found
Recommended from our members
Emotional Biosensing: Exploring Critical Alternatives
Emotional biosensing is rising in daily life: Data and categories claim to know how people feel and suggest what they should do about it, while CSCW explores new biosensing possibilities. Prevalent approaches to emotional biosensing are too limited, focusing on the individual, optimization, and normative categorization. Conceptual shifts can help explore alternatives: toward materiality, from representation toward performativity, inter-action to intra-action, shifting biopolitics, and shifting affect/desire. We contribute (1) synthesizing wide-ranging conceptual lenses, providing analysis connecting them to emotional biosensing design, (2) analyzing selected design exemplars to apply these lenses to design research, and (3) offering our own recommendations for designers and design researchers. In particular we suggest humility in knowledge claims with emotional biosensing, prioritizing care and affirmation over self- improvement, and exploring alternative desires. We call for critically questioning and generatively re- imagining the role of data in configuring sensing, feeling, ‘the good life,’ and everyday experience
Kehollistuneet vuorovaikutuskoreografiat. Kinesteettinen lähestymistapa älykkäiden ympäristöjen suunnitteluun
Research investigates interaction design through application of the concept of choreography. Special attention is paid to assess what kind of influences technological designs have on the user’s body and movements. Choreographic approach to interaction design emphasizes the felt experience of movement as content to interaction design and offers methods for conducting multi-level choreographic analysis. The concept of kinesthesia, which refers to the felt sensation of movement, is regarded as the foundational concept for both understanding and realizing the choreographic analysis.
Choreographic method is applied in studying a future vision of intelligent information and communication environments. Intelligent environment refers to development where objects in everyday environments become connected and form a communicating-actuating network that possess abilities to collect information on the environment and of its users, and enables processing of this information for serving the user’s needs. The research data consists of two visions on intelligent environments in video format, introduced by Microsoft. Visions are analyzed through choreographic analysis with intention to investigate interactions between the user, the intelligent environment and the computer system. Micro level choreography analysis focuses on how the user experiences choreographies as movement continuums. Also local level choreographies that address the broader interaction context will be analyzed. Task based analysis focuses on two functions, first, sending and fetching digital information and, second, real time re-modelling of data and visualizations.
Phenomenological methodology that enabled embodiment of the choreographies through dancing was applied in the analysis. Dancing aimed at internalizing the choreographies and enabled the analysis of felt sensation of movement. Key finding of the study is that choreographic analysis and hermeneutics of the body work well to be utilized in tandem in conducting a case study research on intelligent ICT environments. Dancing is considered as choreographic practice that provides understanding on the unfolding of interactions in space, time and movement. Furthermore, dancing integrates the designer’s explicit technological information to the design context and highlights the kinesthetic dimension of interaction. Presented methods provide relevant support for defining technological systems in intelligent ICT environments that are grounded in the embodied experience of interaction. I suggest that ‘dancing as choreographic practice’ is to be applied in user-centered design of intelligent information and communication environments.Tutkimus tarkastelee vuorovaikutussuunnittelua koreografian käsitteen kautta. Koreografinen lähestymistapa tarkastelee teknologian kokonaisvaltaista ohjausvaikutusta käyttäjän liikkeeseen teknologian käyttötilanteessa. Koreografinen suunnitteluote korostaa liikkeen kokemuksen huomioimisen tärkeyttä vuorovaikutussuunnittelussa ja tarjoaa menetelmiä monitasoisen vuorovaikutusanalyysin toteuttamiseen. Kinestesian käsite, jolla tarkoitetaan liikkeen kokemista kehossa, nousee yhdeksi koreografisen lähestymistavan keskeisistä käsitteistä.
Sovellan koreografista menetelmää tulevaisuuden älykästä informaatio- ja kommunikaatioympäristöä kuvaavan vision tutkimiseen. Älykkäällä ympäristöllä viittaan kehityskulkuun, jossa jokapäiväisissä ympäristöissämme läsnä oleva teknologia verkottuu, kykenee keräämään ja jakamaan tietoa ympäristöstä ja käyttäjistä sekä mahdollistaa tiedon jalostuksen käyttäjän tarpeita palvelevalla tavalla. Aineistona on käytetty Microsoftin teknologiavisioita, joissa esitetyt kuvaukset älykkäistä ympäristöistä sekä esimerkit käyttäjän ja teknologian välisistä liikkeellisistä vuorovaikutuksista nousevat analyysin kohteeksi. Analyysissa keskitytään ensinnäkin käyttäjän toteuttamien mikroliikkeiden jatkumon kokemuksen analyysiin. Toiseksi analysoidaan yksilön kokemusta paikallisen tason koreografioissa. Tällä analyysitasolla huomiota kiinnitetään teknologista vuorovaikutusta laajemman vuorovaikutustapahtuman kontekstiin jolloin mm. sosiaaliset tapahtumat ja tilan vaikutus vuorovaikutukseen tulevat huomioiduksi. Analyysi toteutetaan tehtäväperusteisena ja analyysi käsittää kaksi toimintoa: tiedostojen jakaminen ja vastaanottaminen sekä datan ja visualisointien muokkaus.
Toteutin tutkimuksen nojaten fenomenologiseen metodologiaan, joka mahdollisti koreografioiden henkilökohtaisen omaksumisen tanssin eli tutkimuksen kohteena olevien vuorovaikutustapojen kehollisen harjoittamisen kautta. Teknologiavisioissa esitetyn liikemateriaalin perusteella jäsentyi koreografia, jonka tanssiminen mahdollisti liiketiedon sisäistämisen ja vuorovaikutusten kehollisesti koettujen ulottuvuuksien arvioinnin. Tutkimus osoitti koreografisen analyysin ja osittain tanssimalla toteutetun ruumiin hermeneuttisen lähestymistavan soveltuvan hyvin sovellettavaksi yhdessä älykästä ympäristöä käsittelevässä tapaustutkimuksessa. Tutkimuksen johtopäätöksenä koreografisen menetelmän ja vuorovaikutusten kehollisen harjoittamisen todetaan auttavan suunnittelijaa tilassa, ajassa ja liikkeessä tapahtuvien vuorovaikutusten jäsentämisessä, ja arvioimaan miten teknologisen järjestelmän suunnitteluratkaisut vaikuttavat käyttäjän kehoon ja liikkeeseen vuorovaikutustapahtumassa. Esitän ’tanssimista koreografisena käytäntönä’ sovellettavaksi älykkäiden ympäristöjen käyttäjäkeskeisen suunnittelun menetelmänä
Corseto: A Kinesthetic Garment for Designing, Composing for, and Experiencing an Intersubjective Haptic Voice
We present a novel intercorporeal experience - an intersubjective haptic voice. Through an autobiographical design inquiry, based on singing techniques from the classical opera tradition, we created Corsetto, a kinesthetic garment for transferring somatic reminiscents of vocal experience from an expert singer to a listener. We then composed haptic gestures enacted in the Corsetto, emulating upper-body movements of the live singer performing a piece by Morton Feldman named Three Voices. The gestures in the Corsetto added a haptics-based \u27fourth voice\u27 to the immersive opera performance. Finally, we invited audiences who were asked to wear Corsetto during live performances. Afterwards they engaged in micro-phenomenological interviews. The analysis revealed how the Corsetto managed to bridge inner and outer bodily sensations, creating a feeling of a shared intercorporeal experience, dissolving boundaries between listener, singer and performance. We propose that \u27intersubjective haptics\u27 can be a generative medium not only for singing performances, but other possible intersubjective experiences
NON-VERBAL COMMUNICATION WITH PHYSIOLOGICAL SENSORS. THE AESTHETIC DOMAIN OF WEARABLES AND NEURAL NETWORKS
Historically, communication implies the transfer of information between bodies, yet this
phenomenon is constantly adapting to new technological and cultural standards. In a
digital context, it’s commonplace to envision systems that revolve around verbal modalities.
However, behavioural analysis grounded in psychology research calls attention to
the emotional information disclosed by non-verbal social cues, in particular, actions that
are involuntary. This notion has circulated heavily into various interdisciplinary computing
research fields, from which multiple studies have arisen, correlating non-verbal
activity to socio-affective inferences. These are often derived from some form of motion
capture and other wearable sensors, measuring the ‘invisible’ bioelectrical changes that
occur from inside the body.
This thesis proposes a motivation and methodology for using physiological sensory
data as an expressive resource for technology-mediated interactions. Initialised from a
thorough discussion on state-of-the-art technologies and established design principles
regarding this topic, then applied to a novel approach alongside a selection of practice
works to compliment this. We advocate for aesthetic experience, experimenting with
abstract representations. Atypically from prevailing Affective Computing systems, the
intention is not to infer or classify emotion but rather to create new opportunities for rich
gestural exchange, unconfined to the verbal domain.
Given the preliminary proposition of non-representation, we justify a correspondence
with modern Machine Learning and multimedia interaction strategies, applying an iterative,
human-centred approach to improve personalisation without the compromising
emotional potential of bodily gesture. Where related studies in the past have successfully
provoked strong design concepts through innovative fabrications, these are typically limited
to simple linear, one-to-one mappings and often neglect multi-user environments;
we foresee a vast potential. In our use cases, we adopt neural network architectures to
generate highly granular biofeedback from low-dimensional input data.
We present the following proof-of-concepts: Breathing Correspondence, a wearable
biofeedback system inspired by Somaesthetic design principles; Latent Steps, a real-time auto-encoder to represent bodily experiences from sensor data, designed for dance performance;
and Anti-Social Distancing Ensemble, an installation for public space interventions,
analysing physical distance to generate a collective soundscape. Key findings are
extracted from the individual reports to formulate an extensive technical and theoretical
framework around this topic. The projects first aim to embrace some alternative perspectives
already established within Affective Computing research. From here, these concepts
evolve deeper, bridging theories from contemporary creative and technical practices with
the advancement of biomedical technologies.Historicamente, os processos de comunicação implicam a transferência de informação
entre organismos, mas este fenómeno está constantemente a adaptar-se a novos padrões
tecnológicos e culturais. Num contexto digital, é comum encontrar sistemas que giram
em torno de modalidades verbais. Contudo, a análise comportamental fundamentada
na investigação psicológica chama a atenção para a informação emocional revelada por
sinais sociais não verbais, em particular, acções que são involuntárias. Esta noção circulou
fortemente em vários campos interdisciplinares de investigação na área das ciências da
computação, dos quais surgiram múltiplos estudos, correlacionando a actividade nãoverbal
com inferências sócio-afectivas. Estes são frequentemente derivados de alguma
forma de captura de movimento e sensores “wearable”, medindo as alterações bioeléctricas
“invisíveis” que ocorrem no interior do corpo.
Nesta tese, propomos uma motivação e metodologia para a utilização de dados sensoriais
fisiológicos como um recurso expressivo para interacções mediadas pela tecnologia.
Iniciada a partir de uma discussão aprofundada sobre tecnologias de ponta e princípios
de concepção estabelecidos relativamente a este tópico, depois aplicada a uma nova abordagem,
juntamente com uma selecção de trabalhos práticos, para complementar esta.
Defendemos a experiência estética, experimentando com representações abstractas. Contrariamente
aos sistemas de Computação Afectiva predominantes, a intenção não é inferir
ou classificar a emoção, mas sim criar novas oportunidades para uma rica troca gestual,
não confinada ao domínio verbal.
Dada a proposta preliminar de não representação, justificamos uma correspondência
com estratégias modernas de Machine Learning e interacção multimédia, aplicando uma
abordagem iterativa e centrada no ser humano para melhorar a personalização sem o
potencial emocional comprometedor do gesto corporal. Nos casos em que estudos anteriores
demonstraram com sucesso conceitos de design fortes através de fabricações
inovadoras, estes limitam-se tipicamente a simples mapeamentos lineares, um-para-um,
e muitas vezes negligenciam ambientes multi-utilizadores; com este trabalho, prevemos
um potencial alargado. Nos nossos casos de utilização, adoptamos arquitecturas de redes
neurais para gerar biofeedback altamente granular a partir de dados de entrada de baixa dimensão.
Apresentamos as seguintes provas de conceitos: Breathing Correspondence, um sistema
de biofeedback wearable inspirado nos princípios de design somaestético; Latent
Steps, um modelo autoencoder em tempo real para representar experiências corporais
a partir de dados de sensores, concebido para desempenho de dança; e Anti-Social Distancing
Ensemble, uma instalação para intervenções no espaço público, analisando a
distância física para gerar uma paisagem sonora colectiva. Os principais resultados são
extraídos dos relatórios individuais, para formular um quadro técnico e teórico alargado
para expandir sobre este tópico. Os projectos têm como primeiro objectivo abraçar algumas
perspectivas alternativas às que já estão estabelecidas no âmbito da investigação
da Computação Afectiva. A partir daqui, estes conceitos evoluem mais profundamente,
fazendo a ponte entre as teorias das práticas criativas e técnicas contemporâneas com o
avanço das tecnologias biomédicas
Deep Flow: a tentacular worlding of dance, biosensor technology, lived experience and embodied materials of the human and non-humankind
How to find relations between lived experience and biosensor technology in dance practice? This PaR presents a novel methodology, tentacular worlding, to explore Embodied Dance practice as lived experience, using phenomenological methods and biosensor technologies to better understand experiential aspects of dance more fully, by looking inwardly. It challenges dance practice intersecting with biosensors that visualise invisible physiological events such as heart rate, in external mediated environments, to which dancer’s respond. These ocularcentric practices illustrate only certain aspects of a dancer’s bodily engagement with technology thereby privileging vision over bodily experience. Looking outwardly neglects the vast storehouse of lived experiences that technologies used instrumentally, cannot capture.
To explore the strategy of looking inwardly, a relational methodological approach tentacular worlding is applied. This inspires an interdisciplinary study of the human body in dance practice, phenomenology, technology, and ecofeminist posthumanism. Phenomenological dance methods are used to; explore whole bodily experiences; investigate bodily interactions with differing environments; and discover human relations with biosensor technologies and differing materials. It challenges ocularcentrism by blindfolding the practitioner to augment bodily sensing in the absence of visual information. Multimodal qualitative and quantitative methods are used to interpret these experiences and methods of analysis emphasise tentacular relations between lived experience, the heart, and biometric data.
Tentacular worlding gave birth to the Embodied Dance practice Deep Flow, to foreground relations between lived and bodily experiencing, meditation, fascia release and heart rate variability. By looking inwardly, within an ecology of embodied experience, visible and invisible, tangible, and intangible materials, Deep Flow collapses binary notions of inside and outside, subject and object, an embodied materiality. It proposes; a return to bodily experience and embodied states of flow, to construct knowledge from a first-person perspective and to explore the complexity of relations between the heart, the human and nonhuman
Exploring the Affective Loop
Research in psychology and neurology shows that both body and mind are
involved when experiencing emotions (Damasio 1994, Davidson et al.
2003). People are also very physical when they try to communicate their
emotions. Somewhere in between beings consciously and unconsciously
aware of it ourselves, we produce both verbal and physical signs to make
other people understand how we feel. Simultaneously, this production of
signs involves us in a stronger personal experience of the emotions we
express.
Emotions are also communicated in the digital world, but there is little
focus on users' personal as well as physical experience of emotions in
the available digital media. In order to explore whether and how we can
expand existing media, we have designed, implemented and evaluated
/eMoto/, a mobile service for sending affective messages to others. With
eMoto, we explicitly aim to address both cognitive and physical
experiences of human emotions. Through combining affective gestures for
input with affective expressions that make use of colors, shapes and
animations for the background of messages, the interaction "pulls" the
user into an /affective loop/. In this thesis we define what we mean by
affective loop and present a user-centered design approach expressed
through four design principles inspired by previous work within Human
Computer Interaction (HCI) but adjusted to our purposes; /embodiment/
(Dourish 2001) as a means to address how people communicate emotions in
real life, /flow/ (Csikszentmihalyi 1990) to reach a state of
involvement that goes further than the current context, /ambiguity/ of
the designed expressions (Gaver et al. 2003) to allow for open-ended
interpretation by the end-users instead of simplistic, one-emotion
one-expression pairs and /natural but designed expressions/ to address
people's natural couplings between cognitively and physically
experienced emotions. We also present results from an end-user study of
eMoto that indicates that subjects got both physically and emotionally
involved in the interaction and that the designed "openness" and
ambiguity of the expressions, was appreciated and understood by our
subjects. Through the user study, we identified four potential design
problems that have to be tackled in order to achieve an affective loop
effect; the extent to which users' /feel in control/ of the interaction,
/harmony and coherence/ between cognitive and physical expressions/,/
/timing/ of expressions and feedback in a communicational setting, and
effects of users' /personality/ on their emotional expressions and
experiences of the interaction
THE VARIETIES OF USER EXPERIENCE BRIDGING EMBODIED METHODOLOGIES FROM SOMATICS AND PERFORMANCE TO HUMAN COMPUTER INTERACTION
Embodied Interaction continues to gain significance within the field of Human
Computer Interaction (HCI). Its growing recognition and value is evidenced in part by
a remarkable increase in systems design and publication focusing on various aspects of
Embodiment. The enduring need to interact through experience has spawned a variety
of interdisciplinary bridging strategies in the hope of gaining deeper understanding of
human experience. Along with phenomenology, cognitive science, psychology and the
arts, recent interdisciplinary contributions to HCI include the knowledge-rich domains
of Somatics and Performance that carry long-standing traditions of embodied practice.
The common ground between HCI and the fields of Somatics and Performance is based
on the need to understand and model human experience. Yet, Somatics and
Performance differ from normative HCI in their epistemological frameworks of
embodiment. This is particularly evident in their histories of knowledge construction
and representation. The contributions of Somatics and Performance to the history of
embodiment are not yet fully understood within HCI. Differing epistemologies and their
resulting approaches to experience identify an under-theorized area of research and an
opportunity to develop a richer knowledge and practice base. This is examined by
comparing theories and practices of embodied experience between HCI and Somatics
(Performance) and analyzing influences, values and assumptions underlying
epistemological frameworks. The analysis results in a set of design strategies based in
embodied practices within Somatics and Performance. The subsequent application of
these strategies is examined through a series of interactive art installations that
employ embodied interaction as a central expression of technology. Case Studies
provide evidence in the form of rigorously documented design processes that illustrate
these strategies. This research exemplifies 'Research through Art' applied in the
context of experience design for tangible, wearable and social interaction
- …