Aerospace medicine and biology: A continuing bibliography with indexes (supplement 349)

This bibliography lists 149 reports, articles and other documents introduced into the NASA Scientific and Technical Information System during April, 1991. Subject coverage includes: aerospace medicine and psychology, life support systems and controlled environments, safety equipment, exobiology and extraterrestrial life, and flight crew behavior and performance

Behavioural robustness and the distributed mechanisms hypothesis

A current challenge in neuroscience and systems biology is to better understand properties that allow organisms to exhibit and sustain appropriate behaviours despite the effects of perturbations (behavioural robustness). There are still significant theoretical difficulties in this endeavour, mainly due to the context-dependent nature of the problem. Biological robustness, in general, is considered in the literature as a property that emerges from the internal structure of organisms, rather than being a dynamical phenomenon involving agent-internal controls, the organism body, and the environment. Our hypothesis is that the capacity for behavioural robustness is rooted in dynamical processes that are distributed between agent ‘brain’, body, and environment, rather than warranted exclusively by organisms’ internal mechanisms. Distribution is operationally defined here based on perturbation analyses. Evolutionary Robotics (ER) techniques are used here to construct four computational models to study behavioural robustness from a systemic perspective. Dynamical systems theory provides the conceptual framework for these investigations. The first model evolves situated agents in a goalseeking scenario in the presence of neural noise perturbations. Results suggest that evolution implicitly selects neural systems that are noise-resistant during coupling behaviour by concentrating search in regions of the fitness landscape that retain functionality for goal approaching. The second model evolves situated, dynamically limited agents exhibiting minimalcognitive behaviour (categorization task). Results indicate a small but significant tendency toward better performance under most types of perturbations by agents showing further cognitivebehavioural dependency on their environments. The third model evolves experience-dependent robust behaviour in embodied, one-legged walking agents. Evidence suggests that robustness is rooted in both internal and external dynamics, but robust motion emerges always from the systemin-coupling. The fourth model implements a historically dependent, mobile-object tracking task under sensorimotor perturbations. Results indicate two different modes of distribution, one in which inner controls necessarily depend on a set of specific environmental factors to exhibit behaviour, then these controls will be more vulnerable to perturbations on that set, and another for which these factors are equally sufficient for behaviours. Vulnerability to perturbations depends on the particular distribution. In contrast to most existing approaches to the study of robustness, this thesis argues that behavioural robustness is better understood in the context of agent-environment dynamical couplings, not in terms of internal mechanisms. Such couplings, however, are not always the full determinants of robustness. Challenges and limitations of our approach are also identified for future studies

Adaptive patch foraging in deep reinforcement learning agents

Patch foraging is one of the most heavily studied behavioral optimization challenges in biology. However, despite its importance to biological intelligence, this behavioral optimization problem is understudied in artificial intelligence research. Patch foraging is especially amenable to study given that it has a known optimal solution, which may be difficult to discover given current techniques in deep reinforcement learning. Here, we investigate deep reinforcement learning agents in an ecological patch foraging task. For the first time, we show that machine learning agents can learn to patch forage adaptively in patterns similar to biological foragers, and approach optimal patch foraging behavior when accounting for temporal discounting. Finally, we show emergent internal dynamics in these agents that resemble single-cell recordings from foraging non-human primates, which complements experimental and theoretical work on the neural mechanisms of biological foraging. This work suggests that agents interacting in complex environments with ecologically valid pressures arrive at common solutions, suggesting the emergence of foundational computations behind adaptive, intelligent behavior in both biological and artificial agents.Comment: Published in Transactions on Machine Learning Research (TMLR). See: https://openreview.net/pdf?id=a0T3nOP9s

Role of the hippocampus in goal representation : Insights from behavioural and electrophysiological approaches

The hippocampus plays an important role in spatial cognition, as supported by the location-specific firing of hippocampal place cells. In random foraging tasks, each place cell fires at a specific position (‘place field’) while other hippocampal pyramidal neurons remain silent. A recent study evidenced a reliable extra-field activity in most CA1 place cells of rats waiting for reward delivery in an uncued goal zone. While the location-specific activity of place cells is thought to underlie a flexible representation of space, the nature of this goal-related signal remains unclear. To test whether hippocampal goal-related activity reflects a representation of goal location or a reward-related signal, we designed a two-goal navigation task in which rats were free to choose between two uncued spatial goals to receive a reward. The magnitude of reward associated to each goal zone was modulated, therefore changing the goal value. We recorded CA1 and CA3 unit activity from rats performing this task. Behaviourally, rats were able to remember each goal location and flexibly adapt their choices to goal values. Electrophysiological data showed that a large majority of CA1-CA3 place and silent cells expressed goal-related activity. This activity was independent from goal value and rats’ behavioural choices. Importantly, a large proportion of cells expressed a goal-related activity at one goal zone only. Altogether, our findings suggest that the hippocampus processes and stores relevant information about the spatial characteristics of the goal. This goal representation could be used in cooperation with structures involved in decision-making to optimise goal-directed navigation