Searching for rewards in graph-structured spaces

How do people generalize and explore structured spaces? We study human behavior on a multi-armed bandit task, where rewards are influenced by the connectivity structure of a graph. A detailed predictive model comparison shows that a Gaussian Process regression model using a diffusion kernel is able to best describe participant choices, and also predict judgments about expected reward and confidence. This model unifies psychological models of function learning with the Successor Representation used in reinforcement learning, thereby building a bridge between different models of generalization

Aquilegia, Vol. 16 No. 6, November-December 1992: Newsletter of the Colorado Native Plant Society

https://epublications.regis.edu/aquilegia/1065/thumbnail.jp

Generation of optimal trajectories for Earth hybrid pole sitters

A pole-sitter orbit is a closed path that is constantly above one of the Earth's poles, by means of continuous low thrust. This work proposes to hybridize solar sail propulsion and solar electric propulsion (SEP) on the same spacecraft, to enable such a pole-sitter orbit. Locally-optimal control laws are found with a semi-analytical inverse method, starting from a trajectory that satisfies the pole-sitter condition in the Sun-Earth circular restricted three-body problem. These solutions are subsequently used as first guess to find optimal orbits, using a direct method based on pseudospectral transcription. The orbital dynamics of both the pure SEP case and the hybrid case are investigated and compared. It is found that the hybrid spacecraft allows savings on propellant mass fraction. Finally, it is shown that for sufficiently long missions, a hybrid pole-sitter, based on mid-term technology, enables a consistent reduction in the launch mass for a given payload, with respect to a pure SEP spacecraft

Fast Ion Isotropization by Current Sheet Scattering in Magnetic Reconnection Jets

We present a statistical analysis of ion distributions in magnetic reconnection jets using data from the Magnetospheric Multiscale spacecraft. Compared with the quiet plasma in which the jet propagates, we often find anisotropic and non-Maxwellian ion distributions in the plasma jets. We observe magnetic field fluctuations associated with unstable ion distributions, but the wave amplitudes are not large enough to scatter ions during the observed travel time of the jet. We estimate that the phase-space diffusion due to chaotic and quasi-adiabatic ion motion in the current sheet is sufficiently fast to be the primary process leading to isotropization