10 research outputs found
A Population-Level Analysis of Neural Dynamics in Robust Legged Robots
Recurrent neural network-based reinforcement learning systems are capable of
complex motor control tasks such as locomotion and manipulation, however, much
of their underlying mechanisms still remain difficult to interpret. Our aim is
to leverage computational neuroscience methodologies to understanding the
population-level activity of robust robot locomotion controllers. Our
investigation begins by analyzing topological structure, discovering that
fragile controllers have a higher number of fixed points with unstable
directions, resulting in poorer balance when instructed to stand in place.
Next, we analyze the forced response of the system by applying targeted neural
perturbations along directions of dominant population-level activity. We find
evidence that recurrent state dynamics are structured and low-dimensional
during walking, which aligns with primate studies. Additionally, when recurrent
states are perturbed to zero, fragile agents continue to walk, which is
indicative of a stronger reliance on sensory input and weaker recurrence
Rethink the Adversarial Scenario-based Safety Testing of Robots: the Comparability and Optimal Aggressiveness
This paper studies the class of scenario-based safety testing algorithms in
the black-box safety testing configuration. For algorithms sharing the same
state-action set coverage with different sampling distributions, it is commonly
believed that prioritizing the exploration of high-risk state-actions leads to
a better sampling efficiency. Our proposal disputes the above intuition by
introducing an impossibility theorem that provably shows all safety testing
algorithms of the aforementioned difference perform equally well with the same
expected sampling efficiency. Moreover, for testing algorithms covering
different sets of state-actions, the sampling efficiency criterion is no longer
applicable as different algorithms do not necessarily converge to the same
termination condition. We then propose a testing aggressiveness definition
based on the almost safe set concept along with an unbiased and efficient
algorithm that compares the aggressiveness between testing algorithms.
Empirical observations from the safety testing of bipedal locomotion
controllers and vehicle decision-making modules are also presented to support
the proposed theoretical implications and methodologies
Recommended from our members
Agile Bipedal Locomotion via Hierarchical Control by Incorporating Physical Principles, Learning, and Optimization
Robotic Bipedal locomotion holds the potential for efficient, robust traversal of difficult terrain. The difficulty lies in the dynamics of locomotion which complicate control and motion planning. Bipedal locomotion dynamics are dimensionally large problems, extremely nonlinear, and operate on the limits of actuator capabilities, which limit the performance of generic methods of control. This thesis presents an approach to the problem of agile legged locomotion founded on a first principles understanding of gait dynamics. This approach is built on the perspective that an understanding of locomotion is vital to the successful application of modern control and planning tools. We present 1) a ground-up analysis of legged locomotion as a dynamical phenomenon, 2) approaches that utilize dynamically meaningful reduced order models of locomotion, and 3) applications to the hardware robot Cassie via reinforcement learning