Shock propagation in locally driven granular systems

We study shock propagation in a system of initially stationary hard-spheres that is driven by a continuous injection of particles at the origin. The disturbance created by the injection of energy spreads radially outwards through collision between particles. Using scaling arguments, we determine the exponent characterizing the power law growth of this disturbance in all dimensions. The scaling functions describing the various physical quantities are determined using large scale event driven simulations in two and three dimensions for both the elastic and the inelastic system. The results are shown to describe well the data from two different experiments on granular systems that are similarly driven.Comment: 8 pages, 9 figure

Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes

A fundamental problem faced by animals is learning to select actions based on noisy sensory information and incomplete knowledge of the world. It has been suggested that the brain engages in Bayesian inference during perception but how such probabilistic representations are used to select actions has remained unclear. Here we propose a neural model of action selection and decision making based on the theory of partially observable Markov decision processes (POMDPs). Actions are selected based not on a single “optimal” estimate of state but on the posterior distribution over states (the “belief” state). We show how such a model provides a unified framework for explaining experimental results in decision making that involve both information gathering and overt actions. The model utilizes temporal difference (TD) learning for maximizing expected reward. The resulting neural architecture posits an active role for the neocortex in belief computation while ascribing a role to the basal ganglia in belief representation, value computation, and action selection. When applied to the random dots motion discrimination task, model neurons representing belief exhibit responses similar to those of LIP neurons in primate neocortex. The appropriate threshold for switching from information gathering to overt actions emerges naturally during reward maximization. Additionally, the time course of reward prediction error in the model shares similarities with dopaminergic responses in the basal ganglia during the random dots task. For tasks with a deadline, the model learns a decision making strategy that changes with elapsed time, predicting a collapsing decision threshold consistent with some experimental studies. The model provides a new framework for understanding neural decision making and suggests an important role for interactions between the neocortex and the basal ganglia in learning the mapping between probabilistic sensory representations and actions that maximize rewards