Talking with pictures: Exploring the possibilities of iconic communication

As multimedia computing becomes the order of the day, so there is a greater need to understand and to come to terms with the problems of visual presentation. This paper deals with iconic languages as a means of communicating ideas and concepts without words. Two example systems, developed respectively at the universities of Exeter and Brighton, are described. Both embody basic principles of the iconic communication which,, though not unique to learning technology, is forming an increasingly important part of user‐interfaces, including those in the area computer‐assisted learning

Constructing narratives to describe video events using aided communication

Narratives are a pervasive form of discourse and a rich source for exploring a range of language and cognitive skills. The limited research base to date suggests that narratives generated using aided communication may be structurally simple, and that features of cohesion and reference may be lacking. This study reports on the analysis of narratives generated in interactions involving aided communication in response to short, silent, video vignettes depicting events with unintended or unexpected consequences. Two measures were applied to the data: the Narrative Scoring Scheme and the Narrative Analysis Profile. A total of 15 participants who used aided communication interacted with three different communication partners (peers, parents, professionals) relaying narratives about three video events. Their narratives were evaluated with reference to narratives of 15 peers with typical development in response to the same short videos and to the narratives that were interpreted by their communication partners. Overall, the narratives generated using aided communication were shorter and less complete than those of the speaking peers, but they incorporated many similar elements. Topic maintenance and inclusion of scene-setting elements were consistent strengths. Communication partners offered rich interpretations of aided narratives. Relative to the aided narratives, these interpreted narratives were typically structurally more complete and cohesive and many incorporated more elaborated semantic content. The data reinforce the robust value of narratives in interaction and their potential for showcasing language and communication achievements in aided communication.Peer reviewe

Tac-tiles: multimodal pie charts for visually impaired users

Tac-tiles is an accessible interface that allows visually impaired users to browse graphical information using tactile and audio feedback. The system uses a graphics tablet which is augmented with a tangible overlay tile to guide user exploration. Dynamic feedback is provided by a tactile pin-array at the fingertips, and through speech/non-speech audio cues. In designing the system, we seek to preserve the affordances and metaphors of traditional, low-tech teaching media for the blind, and combine this with the benefits of a digital representation. Traditional tangible media allow rapid, non-sequential access to data, promote easy and unambiguous access to resources such as axes and gridlines, allow the use of external memory, and preserve visual conventions, thus promoting collaboration with sighted colleagues. A prototype system was evaluated with visually impaired users, and recommendations for multimodal design were derived

A microcomputer-based synthesis of Blissymbols from key components to facilitate language acquisition in severely disabled people

Blissymbolics is a semantically-based graphic language which was originally developed as universal channel of communication to promote world peace. Instead, this logical and unambiguous symbol system has been adopted as a communication-enhancement system for pre-reading non-speaking children, and it is now ranked as the most comprehensive and effective graphic system used within augmentative communication. Over the years, a number of multi-functional programmes designed to manipulate microcomputer- based assembly of Blissymbols have been developed. Although some of these applications have become rather popular, none of them is based on a mechanism which provides their users with a cognitive access to the stored symbol vocabulary. The present research was initiated and devised with an underlying goal to gain an insight into some of the most potent characteristics of Blissymbolics, and then, with the backing of the findings, offer a microcomputer-based interface featuring a cognitive technique designed to facilitate retrieval, manipulation, teaching and learning of Blissymbols