Automatic LQR Tuning Based on Gaussian Process Global Optimization

This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined performance objective evaluated from experimental data. The underlying Bayesian optimization algorithm is Entropy Search, which represents the latent objective as a Gaussian process and constructs an explicit belief over the location of the objective minimum. This is used to maximize the information gain from each experimental evaluation. Thus, this framework shall yield improved controllers with fewer evaluations compared to alternative approaches. A seven-degree-of-freedom robot arm balancing an inverted pole is used as the experimental demonstrator. Results of a two- and four-dimensional tuning problems highlight the method's potential for automatic controller tuning on robotic platforms.Comment: 8 pages, 5 figures, to appear in IEEE 2016 International Conference on Robotics and Automation. Video demonstration of the experiments available at https://am.is.tuebingen.mpg.de/publications/marco_icra_201

Effects of Control Stick Parameters on Human Controller Response

A fixed base laboratory tracking study was conducted to determine the effects of stick displacement and stick force characteristics on human tracking performance. Three different levels of control stick force/displacement characteristics and stick electrical gain were varied to observe their influence on RMS (Root Mean Square) tracking error and RMS control activity (stick output). The results indicated that both RMS tracking error and RMS control activity were influenced by the three different levels of control stick force/displacement characteristics and stick electrical gain. The human neuromotor time constant was affected by the electrical control gain of the stick while the spring stiffness of the stick influenced the time delay characteristics of the human response behavior

A quasi-Newton procedure for identifying pilot-related parameters of the optimal control model

The development and application of a quasi-Newton gradient search procedure for identifying independent pilot related parameters of the optimal control model for pilot/vehicle systems is reported. A sensitivity analysis procedure which determines whether a given model parameter is required to match a specific experimental result, and which experimentally induced parameter changes are required to account for behavioral and performance differences, is described. Application of the identification scheme to training effects in a manual control task is described

Digital adaptive flight controller development

A design study of adaptive control logic suitable for implementation in modern airborne digital flight computers was conducted. Two designs are described for an example aircraft. Each of these designs uses a weighted least squares procedure to identify parameters defining the dynamics of the aircraft. The two designs differ in the way in which control law parameters are determined. One uses the solution of an optimal linear regulator problem to determine these parameters while the other uses a procedure called single stage optimization. Extensive simulation results and analysis leading to the designs are presented

MIT Space Engineering Research Center

The Space Engineering Research Center (SERC) at MIT, started in Jul. 1988, has completed two years of research. The Center is approaching the operational phase of its first testbed, is midway through the construction of a second testbed, and is in the design phase of a third. We presently have seven participating faculty, four participating staff members, ten graduate students, and numerous undergraduates. This report reviews the testbed programs, individual graduate research, other SERC activities not funded by the Center, interaction with non-MIT organizations, and SERC milestones. Published papers made possible by SERC funding are included at the end of the report

Preference-Based Learning for Exoskeleton Gait Optimization

This paper presents a personalized gait optimization framework for lower-body exoskeletons. Rather than optimizing numerical objectives such as the mechanical cost of transport, our approach directly learns from user preferences, e.g., for comfort. Building upon work in preference-based interactive learning, we present the CoSpar algorithm. CoSpar prompts the user to give pairwise preferences between trials and suggest improvements; as exoskeleton walking is a non-intuitive behavior, users can provide preferences more easily and reliably than numerical feedback. We show that CoSpar performs competitively in simulation and demonstrate a prototype implementation of CoSpar on a lower-body exoskeleton to optimize human walking trajectory features. In the experiments, CoSpar consistently found user-preferred parameters of the exoskeleton’s walking gait, which suggests that it is a promising starting point for adapting and personalizing exoskeletons (or other assistive devices) to individual users