Sensory Communication

Contains table of contents for Section 2, an introduction and reports on fourteen research projects.National Institutes of Health Grant RO1 DC00117National Institutes of Health Grant RO1 DC02032National Institutes of Health/National Institute on Deafness and Other Communication Disorders Grant R01 DC00126National Institutes of Health Grant R01 DC00270National Institutes of Health Contract N01 DC52107U.S. Navy - Office of Naval Research/Naval Air Warfare Center Contract N61339-95-K-0014U.S. Navy - Office of Naval Research/Naval Air Warfare Center Contract N61339-96-K-0003U.S. Navy - Office of Naval Research Grant N00014-96-1-0379U.S. Air Force - Office of Scientific Research Grant F49620-95-1-0176U.S. Air Force - Office of Scientific Research Grant F49620-96-1-0202U.S. Navy - Office of Naval Research Subcontract 40167U.S. Navy - Office of Naval Research/Naval Air Warfare Center Contract N61339-96-K-0002National Institutes of Health Grant R01-NS33778U.S. Navy - Office of Naval Research Grant N00014-92-J-184

Intelligent Joystick Sensing the User's Emotion and Providing Biofeedback

Development of an intelligent joystick is proposed which senses the user’s bio-signals and recognises the user’s emotion. It provides biofeedback to the user as well as the user’s emotional state information to the computer allowing human-computer interaction over sensitive environment. While the user is interacting with a computer via a joystick the bio-signals can be collected through the user’s fingers touching it. The collected bio-signals information is mapped on a two-dimensional space to find out the quality and intensity of emotion continuously and in a real-time manner. The intelligent joystick has application within several fields such as healthcare, sport and game industries. In such cases, the user can be influenced, or suffer from medical problems while under stress during interaction with the machines. The intelligent joystick will provide feedback to the user and alert alarm about unhealthy conditions through the embedded actuators and allow the machine to adapt with the users’ emotional state