301 research outputs found
Mobility of bodies in contact. I. A 2nd-order mobility index formultiple-finger grasps
Using a configuration-space approach, the paper develops a 2nd-order mobility theory for rigid bodies in contact. A major component of this theory is a coordinate invariant 2nd-order mobility index for a body, B, in frictionless contact with finger bodies A1,...A k. The index is an integer that captures the inherent mobility of B in an equilibrium grasp due to second order, or surface curvature, effects. It differentiates between grasps which are deemed equivalent by classical 1st-order theories, but are physically different. We further show that 2nd-order effects can be used to lower the effective mobility of a grasped object, and discuss implications of this result for achieving new lower bounds on the number of contacting finger bodies needed to immobilize an object. Physical interpretation and stability analysis of 2nd-order effects are taken up in the companion pape
Mobility of bodies in contact. II. How forces are generated bycurvature effects
For part I, see ibid., p.696-708. The paper considers how forces are produced by compliance and surface curvature effects in systems where an object a is kinematically immobilized to second-order by finger bodies Al,...,Ak. A class of configuration-space based elastic deformation models is introduced. Using these elastic deformation models, it is shown that any object which is kinematically immobilized to first or second-order is also dynamically locally asymptotically stable with respect to perturbations. Moreover, it is shown that for preloaded grasps kinematic immobility implies that the stiffness matrix of the grasp is positive definite. The stability result provides physical justification for using second-order effects for purposes of immobilization in practical applications. Simulations illustrate the concepts
Meta Inverse Reinforcement Learning via Maximum Reward Sharing for Human Motion Analysis
This work handles the inverse reinforcement learning (IRL) problem where only
a small number of demonstrations are available from a demonstrator for each
high-dimensional task, insufficient to estimate an accurate reward function.
Observing that each demonstrator has an inherent reward for each state and the
task-specific behaviors mainly depend on a small number of key states, we
propose a meta IRL algorithm that first models the reward function for each
task as a distribution conditioned on a baseline reward function shared by all
tasks and dependent only on the demonstrator, and then finds the most likely
reward function in the distribution that explains the task-specific behaviors.
We test the method in a simulated environment on path planning tasks with
limited demonstrations, and show that the accuracy of the learned reward
function is significantly improved. We also apply the method to analyze the
motion of a patient under rehabilitation.Comment: arXiv admin note: text overlap with arXiv:1707.0939
A control algorithm for autonomous optimization of extracellular recordings
This paper develops a control algorithm that can autonomously position an electrode so as to find and then maintain an optimal extracellular recording position. The algorithm was developed and tested in a two-neuron computational model representative of the cells found in cerebral cortex. The algorithm is based on a stochastic optimization of a suitably defined signal quality metric and is shown capable of finding the optimal recording position along representative sampling directions, as well as maintaining the optimal signal quality in the face of modeled tissue movements. The application of the algorithm to acute neurophysiological recording experiments and its potential implications to chronic recording electrode arrays are discussed
Spike detection using the continuous wavelet transform
This paper combines wavelet transforms with basic detection theory to develop a new unsupervised method for robustly detecting and localizing spikes in noisy neural recordings. The method does not require the construction of templates, or the supervised setting of thresholds. We present extensive Monte Carlo simulations, based on actual extracellular recordings, to show that this technique surpasses other commonly used methods in a wide variety of recording conditions. We further demonstrate that falsely detected spikes corresponding to our method resemble actual spikes more than the false positives of other techniques such as amplitude thresholding. Moreover, the simplicity of the method allows for nearly real-time execution
Learning Hybrid System Models for Supervisory Decoding of Discrete State, with applications to the Parietal Reach Region
Based on Gibbs sampling, a novel method to identify mathematical models of neural activity in response to temporal changes of behavioral or cognitive state is presented. This work is motivated by the developing field of neural prosthetics, where a supervisory controller is required to classify activity of a brain region into suitable discrete modes. Here, neural activity in each discrete mode is modeled with nonstationary point processes, and transitions between modes are modeled as hidden Markov models. The effectiveness of this framework is first demonstrated on a simulated example. The identification algorithm is then applied to extracellular neural activity recorded from multi-electrode arrays in the parietal reach region of a rhesus monkey, and the results demonstrate the ability to decode discrete changes even from small data sets
Inverse Reinforcement Learning in Large State Spaces via Function Approximation
This paper introduces a new method for inverse reinforcement learning in
large-scale and high-dimensional state spaces. To avoid solving the
computationally expensive reinforcement learning problems in reward learning,
we propose a function approximation method to ensure that the Bellman
Optimality Equation always holds, and then estimate a function to maximize the
likelihood of the observed motion. The time complexity of the proposed method
is linearly proportional to the cardinality of the action set, thus it can
handle large state spaces efficiently. We test the proposed method in a
simulated environment, and show that it is more accurate than existing methods
and significantly better in scalability. We also show that the proposed method
can extend many existing methods to high-dimensional state spaces. We then
apply the method to evaluating the effect of rehabilitative stimulations on
patients with spinal cord injuries based on the observed patient motions.Comment: Experiment update
Controllability of kinematic control systems on stratified configuration spaces
This paper considers nonlinear kinematic controllability of a class of systems called stratified. Roughly speaking, such stratified systems have a configuration space which can be decomposed into submanifolds upon which the system has different sets of equations of motion. For such systems, considering controllability is difficult because of the discontinuous form of the equations of motion. The main result in this paper is a controllability test, analogous to Chow's theorem, is based upon a construction involving distributions, and the extension thereof to robotic gaits
The kinematics of hyper-redundant robot locomotion
This paper considers the kinematics of hyper-redundant (or “serpentine”) robot locomotion over uneven solid terrain, and presents algorithms to implement a variety of “gaits”. The analysis and algorithms are based on a continuous backbone curve model which captures the robot's macroscopic geometry. Two classes of gaits, based on stationary waves and traveling waves of mechanism deformation, are introduced for hyper-redundant robots of both constant and variable length. We also illustrate how the locomotion algorithms can be used to plan the manipulation of objects which are grasped in a tentacle-like manner. Several of these gaits and the manipulation algorithm have been implemented on a 30 degree-of-freedom hyper-redundant robot. Experimental results are presented to demonstrate and validate these concepts and our modeling assumptions
- …