Speech assisted mobile text entry

Presented at the 10th International Conference on Auditory Display (ICAD2004)The ever-increasing number of mobile applications increases also the likelihood that these applications need to be used in contexts where usage of traditional visual manual user interaces is difficult. In this paper, a multimodal user interface utilizing manual input, and both spoken and visual output for entering text is presented. Results from user tests show that in stationary usage context, the spoken output is not helpful, but disturbs text production. In a mobile context, novice users were not able to take full advantage of the spoken output. An expert user could type text rather quickly, even blindfolded, and the comments from novice users showed that the potential for assisting in difficult to use contexts was recognised in the concept