2 research outputs found
Control-Oriented Learning on the Fly
This paper focuses on developing a strategy for control of systems whose
dynamics are almost entirely unknown. This situation arises naturally in a
scenario where a system undergoes a critical failure. In that case, it is
imperative to retain the ability to satisfy basic control objectives in order
to avert an imminent catastrophe. A prime example of such an objective is the
reach-avoid problem, where a system needs to move to a certain state in a
constrained state space. To deal with limitations on our knowledge of system
dynamics, we develop a theory of myopic control. The primary goal of myopic
control is to, at any given time, optimize the current direction of the system
trajectory, given solely the information obtained about the system until that
time. We propose an algorithm that uses small perturbations in the control
effort to learn local dynamics while simultaneously ensuring that the system
moves in a direction that appears to be nearly optimal, and provide hard bounds
for its suboptimality. We additionally verify the usefulness of the algorithm
on a simulation of a damaged aircraft seeking to avoid a crash, as well as on
an example of a Van der Pol oscillator.Comment: Extended version of M. Ornik, A. Israel, U. Topcu, "Myopic Control of
Systems with Unknown Dynamics". Detailed list of differences from that paper
given within the manuscript. Changes in v2 include a discussion of myopic
control in an LTL context and a correction of the bound for suboptimality of
the algorith
Guaranteed Reachability for Systems with Unknown Dynamics
The problem of computing the reachable set for a given system is a
quintessential question in nonlinear control theory. While previous work has
yielded a plethora of approximate and analytical methods for determining such a
set, these methods naturally require the knowledge of the controlled system
dynamics throughout the state space. In contrast to such classical methods,
this paper considers the question of estimating the reachable set of a control
system using only the knowledge of local system dynamics at a single point and
a bound on the rate of change of dynamics. Namely, motivated by the need for
safety-critical planning for systems with unknown dynamics, we consider the
problem of describing the guaranteed reachability set: the set of all states
that are guaranteed to be reachable regardless of the true system dynamics,
given the current knowledge about the system. We show that such a set can be
underapproximated by a reachable set of a related known system whose dynamics
at every state depend on the velocity vectors that are guaranteed to all
control systems consistent with the assumed knowledge. Complementing the
theory, numerical examples of a single-dimensional control system and a simple
model of an aircraft in distress verify that such an underapproximation is
meaningful in practice, and may indeed equal the desired guaranteed
reachability set.Comment: v3: fixed error in Figures 1, 3, 4; all consequential material
remains unchange