Doctor of Philosophy

dissertationThe study of haptic interfaces focuses on the use of the sense of touch in human-machine interaction. This document presents a detailed investigation of lateral skin stretch at the fingertip as a means of direction communication. Such tactile communication has applications in a variety of situations where traditional audio and visual channels are inconvenient, unsafe, or already saturated. Examples include handheld consumer electronics, where tactile communication would allow a user to control a device without having to look at it, or in-car navigation systems, where the audio and visual directions provided by existing GPS devices can distract the driver's attention away from the road. Lateral skin stretch, the displacement of the skin of the fingerpad in a plane tangent to the fingerpad, is a highly effective means of communicating directional information. Users are able to correctly identify the direction of skin stretch stimuli with skin displacements as small as 0.1 mm at rates as slow as 2 mm/s. Such stimuli can be rendered by a small, portable device suitable for integration into handheld devices. The design of the device-finger interface affects the ability of the user to perceive the stimuli accurately. A properly designed conical aperture effectively constrains the motion of the finger and provides an interface that is practical for use in handheld devices. When a handheld device renders directional tactile cues on the fingerpad, the user must often mentally rotate those cues from the reference frame of the finger to the world-centered reference frame where those cues are to be applied. Such mental rotation incurs a cognitive cost, requiring additional time to mentally process the stimuli. The magnitude of these cognitive costs is a function of the angle of rotation, and of the specific orientations of the arm, wrist and finger. Even with the difficulties imposed by required mental rotations, lateral skin stretch is a promising means of communicating information using the sense of touch with potential to substantially improve certain types of human-machine interaction

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Engineering data compendium. Human perception and performance. User's guide

The concept underlying the Engineering Data Compendium was the product of a research and development program (Integrated Perceptual Information for Designers project) aimed at facilitating the application of basic research findings in human performance to the design and military crew systems. The principal objective was to develop a workable strategy for: (1) identifying and distilling information of potential value to system design from the existing research literature, and (2) presenting this technical information in a way that would aid its accessibility, interpretability, and applicability by systems designers. The present four volumes of the Engineering Data Compendium represent the first implementation of this strategy. This is the first volume, the User's Guide, containing a description of the program and instructions for its use

Firing properties of muscle spindles supplying the intrinsic muscles of the foot in unloaded and free-standing humans

Human posture and locomotion are dependent on the sensory apparatus – involving muscle spindles, cutaneous afferents and the vestibular system – that provides proprioception. In my previous work with my Bachelor of Medical Research, I investigated the relationship between galvanic vestibular stimulation and the sensitivity of muscle spindles of the long muscles of the leg. While that study showed no correlation between these systems it was limited by the lack of subject postural threat. In order to record from muscle spindles directly during unsupported free-standing, a new methodology for microneurographic recording from the posterior tibial nerve at the ankle was developed. For the first time, we have been able to identify the firing properties of muscle spindle endings in the small (intrinsic) muscles of the foot, as well as mechanoreceptors in the skin of the sole, while the participant is standing unsupported. This thesis presents this methodology along with the recordings made. In Study 1, the firing properties of 26 muscle spindles supplying the intrinsic muscles of the foot are described in unloaded conditions. Their responsiveness to stretch and related joint movements is shown to be similar to those in the short muscles in the hand and the long leg muscles. Only 27% were spontaneously active, of which there was no consistent resting firing rate or discharge variability. In Study 2, activity from 12 muscle spindles supplying the intrinsic foot muscles in unsupported free-standing conditions is described. In this group 50% were spontaneously firing and 67% had activity correlated with changes of centre of pressure recorded by a force plate, primarily (88%) along the anteroposterior axis. In Study 3, the activity of 28 multiunit cutaneous afferent recordings, as well as of 15 single-unit cutaneous afferents, supplying the sole of the foot in unsupported free standing is described. Activity of cutaneous afferents was found to be dependent on receptor type and location of receptive field. The data presented in this report is proof of this novel methodology’s suitability for detailed study into the sensory sources in the foot contributing to maintaining the upright posture

How do humans mediate with the external physical world? From perception to control of articulated objects

Many actions in our daily life involve operation with articulated tools. Despite the ubiquity of articulated objects in daily life, human ability in perceiving the properties and control of articulated objects has been merely studied. Articulated objects are composed of links and revolute or prismatic joints. Moving one part of the linkage results in the movement of the other ones. Reaching a position with the tip of a tool requires adapting the motor commands to the change of position of the endeffector different from the action of reaching the same position with the hand. The dynamic properties are complex and variant in the movement of articulated bodies. For instance, apparent mass, a quantity that measures the dynamic interaction of the articulated object, varies as a function of the changes in configuration. An actuated articulated system can generate a static, but position-dependent force field with constant torques about joints. There are evidences that internal models are involved in the perception and control of tools. In the present work, we aim to investigate several aspects of the perception and control of articulated objects and address two questions, The first question is how people perceive the kinematic and dynamic properties in the haptic interaction with articulated objects? And the second question is what effect has seeing the tool on the planning and execution of reaching movements with a complex tool? Does the visual representation of mechanism structures help in the reaching movement and how? To address these questions, 3D printed physical articulated objects and robotic systems have been designed and developed for the psychophysical studies. The present work involves three studies in different aspects of perception and control of articulated objects. We first did haptic size discrimination tasks using three different types of objects, namely, wooden boxes, actuated apparatus with two movable flat surfaces, and large-size pliers, in unimanual, bimanual grounded and bimanual free conditions. We found bimanual integration occurred in particular in the free manipulation of objects. The second study was on the visuo-motor reaching with complex tools. We found that seeing the mechanism of the tool, even briefly at the beginning of the trial, improved the reaching performance. The last study was about force perception, evidences showed that people could take use of the force field at the end-effector to induce the torque about the joints generated by the articulated system

Human operator performance of remotely controlled tasks: Teleoperator research conducted at NASA's George C. Marshal Space Flight Center

The capabilities within the teleoperator laboratories to perform remote and teleoperated investigations for a wide variety of applications are described. Three major teleoperator issues are addressed: the human operator, the remote control and effecting subsystems, and the human/machine system performance results for specific teleoperated tasks

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

Light environment - A. Visible light. B. Ultraviolet light

Visible and ultraviolet light environment as related to human performance and safety during space mission

The interplay between movement and perception: how interaction can influence sensorimotor performance and neuromotor recovery

openMovement and perception interact continuously in daily activities. Motor output changes the outside world and affect perceptual representations. Similarly, perception has consequences on movement. Nevertheless, how movement and perception influence each other and share information is still an open question. Mappings from movement to perceptual outcome and vice versa change continuously throughout life. For example, a cerebrovascular accident (stroke) elicits in the nervous system a complex series of reorganization processes at various levels and with different temporal scales. Functional recovery after a stroke seems to be mediated by use-dependent reorganization of the preserved neural circuitry. The goal of this thesis is to discuss how interaction with the environment can influence the progress of both sensorimotor performance and neuromotor recovery. I investigate how individuals develop an implicit knowledge of the ways motor outputs regularly correlate with changes in sensory inputs, by interacting with the environment and experiencing the perceptual consequences of self-generated movements. Further, I applied this paradigm to model the exercise-based neurorehabilitation in stroke survivors, which aims at gradually improving both perceptual and motor performance through repeated exercise. The scientific findings of this thesis indicate that motor learning resolve visual perceptual uncertainty and contributes to persistent changes in visual and somatosensory perception. Moreover, computational neurorehabilitation may help to identify the underlying mechanisms of both motor and perceptual recovery, and may lead to more personalized therapies.openXXXII CICLO - BIOINGEGNERIA E ROBOTICA - BIOENGINEERING AND ROBOTICS - Bioengineering and bioelectronicsSedda, Giuli

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022, held in Hamburg, Germany, in May 2022. The 36 regular papers included in this book were carefully reviewed and selected from 129 submissions. They were organized in topical sections as follows: haptic science; haptic technology; and haptic applications