378 research outputs found
Fuzzy Mouse Cursor Control System for Computer Users with Spinal Cord Injuries
People with severe motor-impairments due to Spinal Cord Injury (SCI) or Spinal Cord Dysfunction (SCD), often experience difficulty with accurate and efficient control of pointing devices (Keates et al., 02). Usually this leads to their limited integration to society as well as limited unassisted control over the environment. The questions “How can someone with severe motor-impairments perform mouse pointer control as accurately and efficiently as an able-bodied person?” and “How can these interactions be advanced through use of Computational Intelligence (CI)?” are the driving forces behind the research described in this paper. Through this research, a novel fuzzy mouse cursor control system (FMCCS) is developed. The goal of this system is to simplify and improve efficiency of cursor control and its interactions on the computer screen by applying fuzzy logic in its decision-making to make disabled Internet users use the networked computer conveniently and easily. The FMCCS core consists of several fuzzy control functions, which define different user interactions with the system. The development of novel cursor control system is based on utilization of motor functions that are still available to most complete paraplegics, having capability of limited vision and breathing control. One of the biggest obstacles of developing human computer interfaces for disabled people focusing primarily on eyesight and breath control is user’s limited strength, stamina, and reaction time. Within the FMCCS developed in this research, these limitations are minimized through the use of a novel pneumatic input device and intelligent control algorithms for soft data analysis, fuzzy logic and user feedback assistance during operation. The new system is developed using a reliable and cheap sensory system and available computing techniques. Initial experiments with healthy and SCI subjects have clearly demonstrated benefits and promising performance of the new system: the FMCCS is accessible for people with severe SCI; it is adaptable to user specific capabilities and wishes; it is easy to learn and operate; point-to-point movement is responsive, precise and fast. The integrated sophisticated interaction features, good movement control without strain and clinical risks, as well the fact that quadriplegics, whose breathing is assisted by a respirator machine, still possess enough control to use the new system with ease, provide a promising framework for future FMCCS applications. The most motivating leverage for further FMCCS development is however, the positive feedback from persons who tested the first system prototype
A technique for the measurement and possible rehabilitation of Visual Neglect using the Leap Sensor
Visual Neglect is a common neuropsychological deficit associated with a
person having a Stroke [1]. This deficit is manifested by a Stroke patient’s
inability to notice things usually in the left hand side of their visual space.
This has a serious impact on their daily lives as they fail to notice obstacles
while walking or leave half of a meal uneaten because they are unaware of
its existence. Currently, pen and paper-based techniques are used to assess
the presence of Visual neglect in patients and there have been a number of
rehabilitative programs developed to try and ameliorate the symptoms of
Visual Neglect with limited success [2]. Using the Leap Sensor, this project
sets out to develop a novel measurement paradigm for the detection and
diagnosis of visual neglect as well as laying the ground work for developing
a novel rehabilitative intervention (a means of helping stroke patients to
either recover from visual neglect or make adaptations do lessen the effect
of visual neglect). In addition, we replace pen and paper tests with a web
based system which enables professionals to complete such assessments of
visual neglect virtually and archive their results
Advanced and natural interaction system for motion-impaired users
Human-computer interaction is an important area that searches for better and more comfortable systems to promote communication between humans and machines. Vision-based interfaces can offer a more natural and appealing way of communication. Moreover, it can help in the e-accessibility component of the e-inclusion. The aim is to develop a usable system, that is, the end-user must consider the use of this device effective, efficient and satisfactory. The research's main contribution is SINA, a hands-free interface based on computer vision techniques for motion impaired users. This interface does not require the user to use his upper body limbs, as only nose motion is considered. Besides the technical aspect, user's satisfaction when using an interface is a critical issue. The approach that we have adopted is to integrate usability evaluation at relevant points of the software developmen
A technique for the measurement and possible rehabilitation of Visual Neglect using the Leap Sensor
Visual Neglect is a common neuropsychological deficit associated with a
person having a Stroke [1]. This deficit is manifested by a Stroke patient’s
inability to notice things usually in the left hand side of their visual space.
This has a serious impact on their daily lives as they fail to notice obstacles
while walking or leave half of a meal uneaten because they are unaware of
its existence. Currently, pen and paper-based techniques are used to assess
the presence of Visual neglect in patients and there have been a number of
rehabilitative programs developed to try and ameliorate the symptoms of
Visual Neglect with limited success [2]. Using the Leap Sensor, this project
sets out to develop a novel measurement paradigm for the detection and
diagnosis of visual neglect as well as laying the ground work for developing
a novel rehabilitative intervention (a means of helping stroke patients to
either recover from visual neglect or make adaptations do lessen the effect
of visual neglect). In addition, we replace pen and paper tests with a web
based system which enables professionals to complete such assessments of
visual neglect virtually and archive their results
A Human−Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility
People with physical disabilities in their upper extremities face serious issues in using
classical input devices due to lacking movement possibilities and precision. This article suggests an
alternative input concept and presents corresponding input devices. The proposed interface combines
an inertial measurement unit and force sensing resistors, which can replace mouse and keyboard.
Head motions are mapped to mouse pointer positions, while mouse button actions are triggered
by contracting mastication muscles. The contact pressures of each fingertip are acquired to replace
the conventional keyboard. To allow for complex text entry, the sensory concept is complemented
by an ambiguous keyboard layout with ten keys. The related word prediction function provides
disambiguation at word level. Haptic feedback is provided to users corresponding to their virtual
keystrokes for enhanced closed-loop interactions. This alternative input system enables text input as
well as the emulation of a two-button mouse
Augmentative and alternative communication (AAC) advances: A review of configurations for individuals with a speech disability
High-tech augmentative and alternative communication (AAC) methods are on a constant rise; however, the interaction between the user and the assistive technology is still challenged for an optimal user experience centered around the desired activity. This review presents a range of signal sensing and acquisition methods utilized in conjunction with the existing high-tech AAC platforms for individuals with a speech disability, including imaging methods, touch-enabled systems, mechanical and electro-mechanical access, breath-activated methods, and brain–computer interfaces (BCI). The listed AAC sensing modalities are compared in terms of ease of access, affordability, complexity, portability, and typical conversational speeds. A revelation of the associated AAC signal processing, encoding, and retrieval highlights the roles of machine learning (ML) and deep learning (DL) in the development of intelligent AAC solutions. The demands and the affordability of most systems hinder the scale of usage of high-tech AAC. Further research is indeed needed for the development of intelligent AAC applications reducing the associated costs and enhancing the portability of the solutions for a real user’s environment. The consolidation of natural language processing with current solutions also needs to be further explored for the amelioration of the conversational speeds. The recommendations for prospective advances in coming high-tech AAC are addressed in terms of developments to support mobile health communicative applications
Ocular attention-sensing interface system
The purpose of the research was to develop an innovative human-computer interface based on eye movement and voice control. By eliminating a manual interface (keyboard, joystick, etc.), OASIS provides a control mechanism that is natural, efficient, accurate, and low in workload
Applications of the electric potential sensor for healthcare and assistive technologies
The work discussed in this thesis explores the possibility of employing the Electric
Potential Sensor for use in healthcare and assistive technology applications with the
same and in some cases better degrees of accuracy than those of conventional
technologies. The Electric Potential Sensor is a generic and versatile sensing
technology capable of working in both contact and non-contact (remote) modes. New
versions of the active sensor were developed for specific surface electrophysiological
signal measurements. The requirements in terms of frequency range, electrode size
and gain varied with the type of signal measured for each application. Real-time
applications based on electrooculography, electroretinography and electromyography
are discussed, as well as an application based on human movement.
A three sensor electrooculography eye tracking system was developed which is of
interest to eye controlled assistive technologies. The system described achieved an
accuracy at least as good as conventional wet gel electrodes for both horizontal and
vertical eye movements. Surface recording of the electroretinogram, used to monitor
eye health and diagnose degenerative diseases of the retina, was achieved and
correlated with both corneal fibre and wet gel surface electrodes. The main signal
components of electromyography lie in a higher bandwidth and surface signals of the
deltoid muscle were recorded over the course of rehabilitation of a subject with an
injured arm. Surface electromyography signals of the bicep were also recorded and
correlated with the joint dynamics of the elbow. A related non-contact application of
interest to assistive technologies was also developed. Hand movement within a
defined area was mapped and used to control a mouse cursor and a predictive text
interface
Dwell-free input methods for people with motor impairments
Millions of individuals affected by disorders or injuries that cause severe motor impairments have difficulty performing compound manipulations using traditional input devices. This thesis first explores how effective various assistive technologies are for people with motor impairments. The following questions are studied: (1) What activities are performed? (2) What tools are used to support these activities? (3) What are the advantages and limitations of these tools? (4) How do users learn about and choose assistive technologies? (5) Why do users adopt or abandon certain tools? A qualitative study of fifteen people with motor impairments indicates that users have strong needs for efficient text entry and communication tools that are not met by existing technologies.
To address these needs, this thesis proposes three dwell-free input methods, designed to improve the efficacy of target selection and text entry based on eye-tracking and head-tracking systems. They yield: (1) the Target Reverse Crossing selection mechanism, (2) the EyeSwipe eye-typing interface, and (3) the HGaze Typing interface. With Target Reverse Crossing, a user moves the cursor into a target and reverses over a goal to select it. This mechanism is significantly more efficient than dwell-time selection. Target Reverse Crossing is then adapted in EyeSwipe to delineate the start and end of a word that is eye-typed with a gaze path connecting the intermediate characters (as with traditional gesture typing). When compared with a dwell-based virtual keyboard, EyeSwipe affords higher text entry rates and a more comfortable interaction. Finally, HGaze Typing adds head gestures to gaze-path-based text entry to enable simple and explicit command activations. Results from a user study demonstrate that HGaze Typing has better performance and user satisfaction than a dwell-time method
Methods and metrics for the improvement of the interaction and the rehabilitation of cerebral palsy through inertial technology
Cerebral palsy (CP) is one of the most limiting disabilities in childhood, with 2.2 cases
per 1000 1-year survivors. It is a disorder of movement and posture due to a defect or
lesion of the immature brain during the pregnancy or the birth. These motor limitations
appear frequently in combination with sensory and cognitive alterations generally result
in great difficulties for some people with CP to manipulate objects, communicate and
interact with their environment, as well as limiting their mobility.
Over the last decades, instruments such as personal computers have become a popular
tool to overcome some of the motor limitations and promote neural plasticity, especially
during childhood. According to some estimations, 65% of youths with CP that present
severely limited manipulation skills cannot use standard mice nor keyboards. Unfortunately,
even when people with CP use assistive technology for computer access, they face
barriers that lead to the use of typical mice, track balls or touch screens for practical
reasons. Nevertheless, with the proper customization, novel developments of alternative
input devices such as head mice or eye trackers can be a valuable solution for these
individuals.
This thesis presents a collection of novel mapping functions and facilitation algorithms
that were proposed and designed to ease the act of pointing to graphical elements on
the screen—the most elemental task in human-computer interaction—to individuals with
CP. These developments were implemented to be used with any head mouse, although
they were all tested with the ENLAZA, an inertial interface. The development of such
techniques required the following approach:
Developing a methodology to evaluate the performance of individuals with CP in
pointing tasks, which are usually described as two sequential subtasks: navigation
and targeting.
Identifying the main motor abnormalities that are present in individuals with CP
as well as assessing the compliance of these people with standard motor behaviour
models such as Fitts’ law.
Designing and validating three novel pointing facilitation techniques to be implemented
in a head mouse. They were conceived for users with CP and muscle
weakness that have great difficulties to maintain their heads in a stable position.
The first two algorithms consist in two novel mapping functions that aim to facilitate
the navigation phase, whereas the third technique is based in gravity wells
and was specially developed to facilitate the selection of elements in the screen.
In parallel with the development of the facilitation techniques for the interaction
process, we evaluated the feasibility of use inertial technology for the control of
serious videogames as a complement to traditional rehabilitation therapies of posture
and balance. The experimental validation here presented confirms that this
concept could be implemented in clinical practice with good results.
In summary, the works here presented prove the suitability of using inertial technology
for the development of an alternative pointing device—and pointing algorithms—based
on movements of the head for individuals with CP and severely limited manipulation
skills and new rehabilitation therapies for the improvement of posture and balance. All
the contributions were validated in collaboration with several centres specialized in CP
and similar disorders and users with disability recruited in those centres.La parálisis cerebral (PC) es una de las deficiencias más limitantes de la infancia, con
un incidencia de 2.2 casos por cada 1000 supervivientes tras un año de vida. La PC
se manifiesta principalmente como una alteración del movimiento y la postura y es
consecuencia de un defecto o lesión en el cerebro inmaduro durante el embarazo o el
parto. Las limitaciones motrices suelen aparecer además en compañía de alteraciones
sensoriales y cognitivas, lo que provoca por lo general grandes dificultades de movilidad,
de manipulación, de relación y de interacción con el entorno.
En las últimas décadas, el ordenador personal se ha extendido como herramienta para la
compensación de parte de estas limitaciones motoras y como medio de promoción de la
neuroplasticidad, especialmente durante la infancia. Desafortunadamente, cerca de un
65% de las personas PC que son diagnosticadas con limitaciones severas de manipulación
son incapaces de utilizar ratones o teclados convencionales. A veces, ni siquiera la
tecnología asistencial les resulta de utilidad ya que se encuentran con impedimentos que
hacen que opten por usar dispositivos tradicionales aun sin dominar su manejo. Para
estas personas, los desarrollos recientes de ratones operados a través de movimientos
residuales con la cabeza o la mirada podrían ser una solución válida, siempre y cuando
se personalice su manejo.
Esta tesis presenta un conjunto de novedosas funciones de mapeo y algoritmos de facilitaci
ón que se han propuesto y diseñado con el ánimo de ayudar a personas con PC
en las tareas de apuntamiento de objetos en la pantalla —las más elementales dentro
de la interacción con el ordenador. Aunque todas las contribuciones se evaluaron con
la interfaz inercial ENLAZA, desarrollada igualmente en nuestro grupo, podrían ser
aplicadas a cualquier ratón basado en movimientos de cabeza. El desarrollo de los
trabajos se resume en las siguientes tareas abordadas:
Desarrollo de una metodología para la evaluación de la habilidad de usuarios con
PC en tareas de apuntamiento, que se contemplan como el encadenamiento de dos
sub-tareas: navegación (alcance) y selección (clic).
Identificación de los tipos de alteraciones motrices presentes en individuos con PC
y el grado de ajuste de éstos a modelos estándares de comportamiento motriz como
puede ser la ley de Fitts.
Propuesta y validación de tres técnicas de facilitación del alcance para ser implementadas
en un ratón basado en movimientos de cabeza. La facilitación se ha centrado
en personas que presentan debilidad muscular y dificultades para mantener
la posición de la cabeza. Mientras que los dos primeros algoritmos se centraron
en facilitar la navegación, el tercero tuvo como objetivo ayudar en la selección a
través de una técnica basada en pozos gravitatorios de proximidad.
En paralelo al desarrollo de estos algoritmos de facilitación de la interacción, evaluamos
la posibilidad de utilizar tecnología inercial para el control de videojuegos en
rehabilitación. Nuestra validación experimental demostró que este concepto puede
implementarse en la práctica clínica como complemento a terapias tradicionales de
rehabilitación de la postura y el equilibrio.
Como conclusión, los trabajos desarrollados en esta tesis vienen a constatar la idoneidad
de utilizar sensores inerciales para el desarrollo de interfaces de accesso alternativo al
ordenador basados en movimientos residuales de la cabeza para personas con limitaciones
severas de manipulación. Esta solución se complementa con algoritmos de facilitación
del alcance. Por otra parte, estas soluciones tecnológicas de interfaz con el ordenador
representan igualmente un complemento de terapias tradicionales de rehabilitación de
la postura y el equilibrio. Todas las contribuciones se validaron en colaboración con
una serie de centros especializados en parálisis cerebral y trastornos afines contando con
usuarios con discapacidad reclutados en dichos centros.This thesis was completed in the Group of Neural and Cognitive Engineering (gNEC) of the CAR UPM-CSIC with the financial support of the FP7 Framework EU Research Project ABC (EU-2012-287774), the IVANPACE Project (funded by Obra Social de Caja Cantabria, 2012-2013), and the Spanish Ministry of Economy and Competitiveness in the framework of two projects: the Interplay Project (RTC-2014-1812-1) and most
recently the InterAAC Project (RTC-2015-4327-1)Programa Oficial de Doctorado en Ingeniería Eléctrica, Electrónica y AutomáticaPresidente: Juan Manuel Belda Lois.- Secretario: María Dolores Blanco Rojas.- Vocal: Luis Fernando Sánchez Sante
- …