TabAccess, a Wireless Controller for Tablet Accessibility for Individuals with Limited Upper-Body Mobility

Abstract

©2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.Presented at the 2013 Presented at the IEEE Biosignals and Biorobotics Conference, Brazil, February 2013.Over 3 million individuals in the US have a disability in their hands and/or forearms and thus have difficulties in effecting pinch and swipe gestures needed for tablet interaction. In this paper, a forearm mountable mobile interface, TabAccess (controller for Tablet Accessibility) is introduced. The objective is to provide an input interface for individuals with limited manipulation skills an alternative way to interact with touchscreen tablet applications. We believe that by combining TabAccess with mobile computers, effective education and entertainment opportunities could be delivered to persons lacking fine motor skills. For translation of gross motor gestures into touchscreen-based gestures, a methodology was developed to convert raw sensor data retrieved from the sensors into press and swipe gestures. The proposed device recognizes different gestures generated by a combination of sensors with hidden Markov models. This paper presents the design specifications of TabAccess, and discusses the training and testing results with three diverse applications - a music player, a robot controller, and a communication app