3 research outputs found
Viia-hand: a Reach-and-grasp Restoration System Integrating Voice interaction, Computer vision and Auditory feedback for Blind Amputees
Visual feedback plays a crucial role in the process of amputation patients
completing grasping in the field of prosthesis control. However, for blind and
visually impaired (BVI) amputees, the loss of both visual and grasping
abilities makes the "easy" reach-and-grasp task a feasible challenge. In this
paper, we propose a novel multi-sensory prosthesis system helping BVI amputees
with sensing, navigation and grasp operations. It combines modules of voice
interaction, environmental perception, grasp guidance, collaborative control,
and auditory/tactile feedback. In particular, the voice interaction module
receives user instructions and invokes other functional modules according to
the instructions. The environmental perception and grasp guidance module
obtains environmental information through computer vision, and feedbacks the
information to the user through auditory feedback modules (voice prompts and
spatial sound sources) and tactile feedback modules (vibration stimulation).
The prosthesis collaborative control module obtains the context information of
the grasp guidance process and completes the collaborative control of grasp
gestures and wrist angles of prosthesis in conjunction with the user's control
intention in order to achieve stable grasp of various objects. This paper
details a prototyping design (named viia-hand) and presents its preliminary
experimental verification on healthy subjects completing specific
reach-and-grasp tasks. Our results showed that, with the help of our new
design, the subjects were able to achieve a precise reach and reliable grasp of
the target objects in a relatively cluttered environment. Additionally, the
system is extremely user-friendly, as users can quickly adapt to it with
minimal training
Haptic Socks
Smart phones have been spreading faster than any other technologies and with them, the research for finding different alternate interaction techniques that will be quick and efficiently responsive. The best feedback response in terms of mobile usage has been a long debate and is actually not possible, so it is difficult to conclude which feedback will be effective in all environments.
In navigation applications, two modalities are used as feedback; visual and auditory. This thesis presents work, experiments and results on implementing the third modality i.e. haptic feedback.
The basic purpose of this work is to find out how effective wearable haptic feedback can be, than visual or auditory feedback in terms of navigation. Using hand-held GPS navigation while walking or driving a car can sometimes be dangerous if the user is focusing more on the device than on the roads.
The concept of Haptic Socks can be used as a secondary interaction technique for navigation so that user can use other interaction techniques to perform their primary tasks or perform their daily life routine work. Haptic socks will consist of actuators embedded in a certain position of human foot that will give tactile feedback, helping the user in turn by turn navigation. The device can most probably be the user’s smartphone. Haptic Socks will use wireless connection with the device which in this research study will be Bluetooth.
Furthermore, if the feedback results are positive then it will be easier to discuss how effective it can be made for people who are deaf-blind