3 research outputs found
Ability-Based Methods for Personalized Keyboard Generation
This study introduces an ability-based method for personalized keyboard
generation, wherein an individual's own movement and human-computer interaction
data are used to automatically compute a personalized virtual keyboard layout.
Our approach integrates a multidirectional point-select task to characterize
cursor control over time, distance, and direction. The characterization is
automatically employed to develop a computationally efficient keyboard layout
that prioritizes each user's movement abilities through capturing directional
constraints and preferences. We evaluated our approach in a study involving 16
participants using inertial sensing and facial electromyography as an access
method, resulting in significantly increased communication rates using the
personalized keyboard (52.0 bits/min) when compared to a generically optimized
keyboard (47.9 bits/min). Our results demonstrate the ability to effectively
characterize an individual's movement abilities to design a personalized
keyboard for improved communication. This work underscores the importance of
integrating a user's motor abilities when designing virtual interfaces.Comment: 20 pages, 7 figure
Computational optimization and prediction strategies for increasing communication rate in phoneme-based augmentative and alternative communication (AAC)
Up to 1.2% of the population is unable to meet daily communication needs using typical speech and may use augmentative and alternative communication (AAC) strategies to communicate, including manual sign language, facial gestures, and aided strategies such as selecting targets on an onscreen keyboard. However, for individuals whose impairments affect both speech and non-speech motor systems (e.g., spinal cord injury, amyotrophic lateral sclerosis, multiple sclerosis), their ability to use manual sign and access computer systems are impacted. AAC access methods in this population remain inherently slow and effortful (e.g., eye-tracking, head-tracking, mechanical switches). Thus, optimizing communication interfaces for alternate access methods may provide significant improvements in communication rates and quality of life.
In this series of studies, we developed and evaluated methods for improving communication rates through optimization and prediction in communication interfaces. These interfaces enabled participants to select sounds (phonemes) instead of letters and were computationally optimized offline via a model of human movement in order for targets likely to be selected together to be in close proximity. Online prediction was implemented such that likely targets were dynamically enlarged. Computational simulations suggested that optimized phonemic interfaces could increase communication rates by up to 30.9% compared to random phonemic interfaces. Communication rates were empirically evaluated in 36 participants without motor impairment using an alternate computer access method to produce messages with phonemic interfaces over 12 sessions. Results suggested that optimization increased communication rates by 10.5–23.0% compared to a random phonemic interface. Prediction increased communication rates during training sessions, but was not a significant factor in communication rates during the final session. Empirical evaluations in individuals with motor impairment revealed that all participants strongly agreed that they would improve with practice, and four out of six participants strongly preferred the interface with prediction.
Results of these studies suggest that optimized and predictive phonemic interfaces may provide increased communication rates for individuals with motor impairments affecting both oral communication and computer access. Methods for dynamically enlarging targets may also be applicable to other (non-phonemic) interfaces to increase communication rates. Further research is needed to fully translate these results into clinical practice.2020-10-24T00:00:00