Haptic Feedback Effects on Human Control of a UAV in a Remote Teleoperation Flight Task

The remote manual teleoperation of an unmanned aerial vehicle (UAV) by a human operator creates a human-in-the loop system that is of great concern. In a remote teleoperation task, a human pilot must make control decisions based upon sensory information provided by the governed system. Often, this information consists of limited visual feedback provided by onboard cameras that do not provide an operator with an accurate portrayal of their immediate surroundings compromising the safety of the mobile robot. Due to this shortfall, haptic force feedback is often provided to the human in an effort to increase their perceptual awareness of the surrounding world. To investigate the effects of this additional sensory information provided to the human op-erator, we consider two haptic force feedback strategies. They were designed to provide either an attractive force to influence control behavior towards a reference trajectory along a flight path, or a repulsive force directing operators away from obstacles to prevent collision. Subject tests were con-ducted where human operators manually operated a remote UAV through a corridor environment under the conditions of the two strategies. For comparison, the conditions of no haptic feedback and the liner combination of both attractive and repulsive strategies were included in the study. Experi-mental results dictate that haptic force feedback in general (including both attractive and repulsive force feedback) improves the average distance from surrounding obstacles up to 21%. Further statis-tical comparison of repulsive and attractive feedback modalities reveal that even though a repulsive strategy is based directly on obstacles, an attractive strategy towards a reference trajectory is more suitable across all performance metrics. To further examine the effects of haptic aides in a UAV teleoperation task, the behavior of the human system as part of the control loop was also investigated. Through a novel device placed on the end effector of the haptic device, human-haptic interaction forces were captured and further analyzed. With this information, system identification techniques were carried out to determine the plausibility of deriving a human control model for the system. By defining lateral motion as a one-dimensional compensatory tracking task the results show that general human control behavior can be identified where lead compensation in invoked to counteract second-order UAV dynamics

A SUBSYSTEM IDENTIFICATION APPROACH TO MODELING HUMAN CONTROL BEHAVIOR AND STUDYING HUMAN LEARNING

Humans learn to interact with many complex dynamic systems such as helicopters, bicycles, and automobiles. This dissertation develops a subsystem identification method to model the control strategies that human subjects use in experiments where they interact with dynamic systems. This work provides new results on the control strategies that humans learn. We present a novel subsystem identification algorithm, which can identify unknown linear time-invariant feedback and feedforward subsystems interconnected with a known linear time-invariant subsystem. These subsystem identification algorithms are analyzed in the cases of noiseless and noisy data. We present results from human-in-the-loop experiments, where human subjects in- teract with a dynamic system multiple times over several days. Each subject’s control behavior is assumed to have feedforward (or anticipatory) and feedback (or reactive) components, and is modeled using experimental data and the new subsystem identifi- cation algorithms. The best-fit models of the subjects’ behavior suggest that humans learn to control dynamic systems by approximating the inverse of the dynamic system in feedforward. This observation supports the internal model hypothesis in neuro- science. We also examine the impact of system zeros on a human’s ability to control a dynamic system, and on the control strategies that humans employ

THE EFFECTS OF SYSTEM CHARACTERISTICS, REFERENCE COMMAND, AND COMMAND-FOLLOWING OBJECTIVES ON HUMAN-IN-THE-LOOP CONTROL BEHAVIOR

Humans learn to interact with many complex physical systems. For example, humans learn to fly aircraft, operate drones, and drive automobiles. We present results from human-in-the-loop (HITL) experiments, where human subjects interact with dynamic systems while performing command-following tasks multiple times over a one-week period. We use a new subsystem identification (SSID) algorithm to estimate the control strategies (feedforward, feedforward delay, feedback, and feedback delay) that human subjects use during their trials. We use experimental and SSID results to examine the effects of system characteristics (e.g., system zeros, relative degree, system order, phase lag, time delay), reference command, and command-following objectives on humans command-following performance and on the control strategies that the humans learn. Results suggest that nonminimum-phase zeros, relative degree, phase lag, and time delay tend to make dynamic systems difficult for human to control. Subjects can generalize their control strategies from one task to another and use prediction of the reference command to improve their command-following performance. However, this dissertation also provides evidence that humans can learn to improve performance without prediction. This dissertation also presents a new SSID algorithm to model the control strategies that human subjects use in HITL experiments where they interact with dynamic systems. This SSID algorithm uses a two-candidate-pool multi-convex-optimization approach to identify feedback-and-feedforward subsystems with time delay that are interconnected in closed loop with a known subsystem. This SSID method is used to analyze the human control behavior in the HITL experiments discussed above