CreaTable Content and Tangible Interaction in Aphasia

Multimedia digital content (combining pictures, text and music) is ubiquitous. The process of creating such content using existing tools typically requires complex, language-laden interactions which pose a challenge for users with aphasia (a language impairment following brain injury). Tangible interactions offer a potential means to address this challenge, however, there has been little work exploring their potential for this purpose. In this paper, we present CreaTable – a platform that enables us to explore tangible interaction as a means of supporting digital content creation for people with aphasia. We report details of the co-design of CreaTable and findings from a digital creativity workshop. Workshop findings indicated that CreaTable enabled people with aphasia to create something they would not otherwise have been able to. We report how users’ aphasia profiles affected their experience, describe tensions in collaborative content creation and provide insight into more accessible content creation using tangibles

Where art meets technology:Integrating tangible and intelligent tools in creative processes

Art and design are essential aspects of our culture and how we interact with the world. Artists and designers use a wide selection of tools, whose impact is rapidly growing with the progression of digital technologies. This change has opened up new opportunities for the CHI community to build creative supportive tools. The digital switch has come with many benefits such as lowering barriers, mobile work environments and mass production for distribution of work. Along with these benefits we also see challenges for art and design work and its future perception in society. As technology takes a more significant role in supporting art and design what will this mean for the individual artist or designer? The focus of this workshop is to bring together researchers and practitioners to explore what the future of digital art and design will hold. The exploration will centre around synthesizing key challenges and questions, along with ideas for future interaction technologies that consider mobile and tangible aspects of digital art

Art and Design Practices as a Driver for Deformable Controls, Textures and Screen Interactions

In this thesis, we demonstrate the innovative uses of deformable interfaces to help de-velop future digital art and design interactions. The great benefits of advancing digital art can often come at a cost of tactile feeling and physical expression, while traditional methods celebrate the diverse sets of physical tools and materials. We identified these sets of tools and materials to inform the development of new art and design interfaces that offer rich physical mediums for digital artist and designers. In order to bring forth these unique inter-actions, we draw on the latest advances in deformable interface technology. Therefore, our research contributes a set of understandings about how deformable interfaces can be har-nessed for art and design interfaces. We identify and discuss the following contributions: insights into tangible and digital practices of artists and designers; prototypes to probe the benefits and possibilities of deformable displays and materials in support of digital-physical art and design, user-centred evaluations of these prototypes to inform future developments, and broader insights into the deformable interface research.Each chapter of this thesis investigates a specific element of art and design, alongside an aspect of deformable interfaces resulting in a new prototype. We begin the thesis by studying the use of physical actuation to simulate artist tools in deformable surfaces. In this chapter, our evaluations highlight the merits of improved user experiences and insights into eyes-free interactions. We then turn to explore deformable textures. Driven by the tactile feeling of mixing paints, we present a gel-based interface that is capable of simulating the feeling of paints on the back of mobile devices. Our evaluations showed how artists endorsed the interactions and held potential for digital oil painting.Our final chapter presents research conducted with digital designers. We explore their colour picking processes and developed a digital version of physical swatches using a mod-ular screen system. This use of tangible proxies in digital-based processes brought a level of playfulness and held potential to support collaborative workflows across disciplines. To conclude, we share how our outcomes from these studies could help shape the broader space of art and design interactions and deformable interface research. We suggest future work and directions based on our findings