Pictures in Your Mind: Using Interactive Gesture-Controlled Reliefs to Explore Art

Tactile reliefs offer many benefits over the more classic raised line drawings or tactile diagrams, as depth, 3D shape, and surface textures are directly perceivable. Although often created for blind and visually impaired (BVI) people, a wider range of people may benefit from such multimodal material. However, some reliefs are still difficult to understand without proper guidance or accompanying verbal descriptions, hindering autonomous exploration. In this work, we present a gesture-controlled interactive audio guide (IAG) based on recent low-cost depth cameras that can be operated directly with the hands on relief surfaces during tactile exploration. The interactively explorable, location-dependent verbal and captioned descriptions promise rapid tactile accessibility to 2.5D spatial information in a home or education setting, to online resources, or as a kiosk installation at public places. We present a working prototype, discuss design decisions, and present the results of two evaluation studies: the first with 13 BVI test users and the second follow-up study with 14 test users across a wide range of people with differences and difficulties associated with perception, memory, cognition, and communication. The participant-led research method of this latter study prompted new, significant and innovative developments

Identifying with an avatar: A multidisciplinary perspective

Avatars perform a complex range of inter-related functions. They not only allow us to express a digital identity, they facilitate the expression of physical motility and, through non-verbal expression, help to mediate social interaction in networked environments. When well designed, they can contribute to a sense of “presence” (a sense of being there) and a sense of “co-presence” (a sense of being there with others) in digital space. Because of this complexity, the study of avatars can be enriched by theoretical insights from a range of disciplines. This paper considers avatars from the perspectives of critical theory, visual communication, and art theory (on portraiture) to help elucidate the role of avatars as an expression of identity. It goes on to argue that identification with an avatar is also produced through their expression of motility and discusses the benefits of film theory for explaining this process. Conceding the limits of this approach, the paper draws on philosophies of body image, Human Computer Interaction (HCI) theory on embodied interaction, and fields as diverse as dance to explain the sense of identification, immersion, presence and co-presence that avatars can produce

Anachropomorphism!

Folks, the Truth is hard to know—if can be known at all.¹ Conventional Western wisdom tells us: stick to the facts. (I’m looking at you, Enlightenment.) We privilege the written word as an objective and reliable vehicle for communication. Useful, yes, but we over-rely. I counter with this: bodily performativity and purposeful inaccuracy that produces, paradoxically, narrative accuracy. These methods roil in our gut or tug at our heartstrings—instead of recoiling, we should embrace them. I like to unpack “the stories we tell ourselves,”² our personal and societal mythologies, with a particular eye to how the past plays a role in these constructions. Telling things slant³—diving into the uncanny—disrupts our visual complacency with both delight and disorientation. By employing temporal and spatial anachronisms in a performative motion-based practice, I aim not to obscure truth, but to promote inquiry. 1. Riffing on the New York Times’ The Truth is Hard campaign. 2. Clifford Geertz, The Interpretation of Cultures. 3. A nod to Emily Dickinson’s “Tell all the truth but tell it slant.