236 research outputs found
Fingerprinting Agent-Environment Interaction via Information Theory
In this paper, we investigate by means of statistical and information-theoretic measures, to what extent sensory-motor coordinated activity can generate and structure information in the sensory channels of a simulated agent interacting with its surrounding environment. We show how the usage of correlation, entropy, and mutual information can be employed (a) to segment an observed behavior into distinct behavioral states, (b) to quantify (fingerprint) the agent-environment interaction, and (c) to analyze the informational relationship between the different components of the sensory-motor apparatus. We hypothesize that a deeper understanding of the information-theoretic implications of sensory-motor coordination can help us endow our robots with better sensory morphologies, and with better strategies for exploring their surrounding environment
Empowerment for Continuous Agent-Environment Systems
This paper develops generalizations of empowerment to continuous states.
Empowerment is a recently introduced information-theoretic quantity motivated
by hypotheses about the efficiency of the sensorimotor loop in biological
organisms, but also from considerations stemming from curiosity-driven
learning. Empowemerment measures, for agent-environment systems with stochastic
transitions, how much influence an agent has on its environment, but only that
influence that can be sensed by the agent sensors. It is an
information-theoretic generalization of joint controllability (influence on
environment) and observability (measurement by sensors) of the environment by
the agent, both controllability and observability being usually defined in
control theory as the dimensionality of the control/observation spaces. Earlier
work has shown that empowerment has various interesting and relevant
properties, e.g., it allows us to identify salient states using only the
dynamics, and it can act as intrinsic reward without requiring an external
reward. However, in this previous work empowerment was limited to the case of
small-scale and discrete domains and furthermore state transition probabilities
were assumed to be known. The goal of this paper is to extend empowerment to
the significantly more important and relevant case of continuous vector-valued
state spaces and initially unknown state transition probabilities. The
continuous state space is addressed by Monte-Carlo approximation; the unknown
transitions are addressed by model learning and prediction for which we apply
Gaussian processes regression with iterated forecasting. In a number of
well-known continuous control tasks we examine the dynamics induced by
empowerment and include an application to exploration and online model
learning
Integrated information increases with fitness in the evolution of animats
One of the hallmarks of biological organisms is their ability to integrate
disparate information sources to optimize their behavior in complex
environments. How this capability can be quantified and related to the
functional complexity of an organism remains a challenging problem, in
particular since organismal functional complexity is not well-defined. We
present here several candidate measures that quantify information and
integration, and study their dependence on fitness as an artificial agent
("animat") evolves over thousands of generations to solve a navigation task in
a simple, simulated environment. We compare the ability of these measures to
predict high fitness with more conventional information-theoretic processing
measures. As the animat adapts by increasing its "fit" to the world,
information integration and processing increase commensurately along the
evolutionary line of descent. We suggest that the correlation of fitness with
information integration and with processing measures implies that high fitness
requires both information processing as well as integration, but that
information integration may be a better measure when the task requires memory.
A correlation of measures of information integration (but also information
processing) and fitness strongly suggests that these measures reflect the
functional complexity of the animat, and that such measures can be used to
quantify functional complexity even in the absence of fitness data.Comment: 27 pages, 8 figures, one supplementary figure. Three supplementary
video files available on request. Version commensurate with published text in
PLoS Comput. Bio
On directed information theory and Granger causality graphs
Directed information theory deals with communication channels with feedback.
When applied to networks, a natural extension based on causal conditioning is
needed. We show here that measures built from directed information theory in
networks can be used to assess Granger causality graphs of stochastic
processes. We show that directed information theory includes measures such as
the transfer entropy, and that it is the adequate information theoretic
framework needed for neuroscience applications, such as connectivity inference
problems.Comment: accepted for publications, Journal of Computational Neuroscienc
Some Experiments on the influence of Problem Hardness in Morphological Development based Learning of Neural Controllers
Natural beings undergo a morphological development process of their bodies
while they are learning and adapting to the environments they face from infancy
to adulthood. In fact, this is the period where the most important learning
pro-cesses, those that will support learning as adults, will take place.
However, in artificial systems, this interaction between morphological
development and learning, and its possible advantages, have seldom been
considered. In this line, this paper seeks to provide some insights into how
morphological development can be harnessed in order to facilitate learning in
em-bodied systems facing tasks or domains that are hard to learn. In
particular, here we will concentrate on whether morphological development can
really provide any advantage when learning complex tasks and whether its
relevance towards learning in-creases as tasks become harder. To this end, we
present the results of some initial experiments on the application of
morpho-logical development to learning to walk in three cases, that of a
quadruped, a hexapod and that of an octopod. These results seem to confirm that
as task learning difficulty increases the application of morphological
development to learning becomes more advantageous.Comment: 10 pages, 4 figure
Robot life: simulation and participation in the study of evolution and social behavior.
This paper explores the case of using robots to simulate evolution, in particular the case of Hamilton's Law. The uses of robots raises several questions that this paper seeks to address. The first concerns the role of the robots in biological research: do they simulate something (life, evolution, sociality) or do they participate in something? The second question concerns the physicality of the robots: what difference does embodiment make to the role of the robot in these experiments. Thirdly, how do life, embodiment and social behavior relate in contemporary biology and why is it possible for robots to illuminate this relation? These questions are provoked by a strange similarity that has not been noted before: between the problem of simulation in philosophy of science, and Deleuze's reading of Plato on the relationship of ideas, copies and simulacra
A Theory of Cheap Control in Embodied Systems
We present a framework for designing cheap control architectures for embodied
agents. Our derivation is guided by the classical problem of universal
approximation, whereby we explore the possibility of exploiting the agent's
embodiment for a new and more efficient universal approximation of behaviors
generated by sensorimotor control. This embodied universal approximation is
compared with the classical non-embodied universal approximation. To exemplify
our approach, we present a detailed quantitative case study for policy models
defined in terms of conditional restricted Boltzmann machines. In contrast to
non-embodied universal approximation, which requires an exponential number of
parameters, in the embodied setting we are able to generate all possible
behaviors with a drastically smaller model, thus obtaining cheap universal
approximation. We test and corroborate the theory experimentally with a
six-legged walking machine. The experiments show that the sufficient controller
complexity predicted by our theory is tight, which means that the theory has
direct practical implications. Keywords: cheap design, embodiment, sensorimotor
loop, universal approximation, conditional restricted Boltzmann machineComment: 27 pages, 10 figure
The Transfer of Evolved Artificial Immune System Behaviours between Small and Large Scale Robotic Platforms
This paper demonstrates that a set of behaviours evolved in simulation on a
miniature robot (epuck) can be transferred to a much larger scale platform (a
virtual Pioneer P3-DX) that also differs in shape, sensor type, sensor
configuration and programming interface. The chosen architecture uses a
reinforcement learning-assisted genetic algorithm to evolve the epuck
behaviours, which are encoded as a genetic sequence. This sequence is then used
by the Pioneers as part of an adaptive, idiotypic artificial immune system
(AIS) control architecture. Testing in three different simulated worlds shows
that the Pioneer can use these behaviours to navigate and solve object-tracking
tasks successfully, as long as its adaptive AIS mechanism is in place.Comment: 12 pages, 3 figures, 2 tables, 9th International Conference on
Artificial Evolution (EA 09)
Evaluation of the Performance of Information Theory-Based Methods and Cross-Correlation to Estimate the Functional Connectivity in Cortical Networks
Functional connectivity of in vitro neuronal networks was estimated by applying different statistical algorithms on data collected by Micro-Electrode Arrays (MEAs). First we tested these âconnectivity methodsâ on neuronal network models at an increasing level of complexity and evaluated the performance in terms of ROC (Receiver Operating Characteristic) and PPC (Positive Precision Curve), a new defined complementary method specifically developed for functional links identification. Then, the algorithms better estimated the actual connectivity of the network models, were used to extract functional connectivity from cultured cortical networks coupled to MEAs. Among the proposed approaches, Transfer Entropy and Joint-Entropy showed the best results suggesting those methods as good candidates to extract functional links in actual neuronal networks from multi-site recordings
Cellular automata modelling of slime mould actin network signalling
© 2016, The Author(s). Actin is a cytoskeletal protein which forms dense, highly interconnected networks within eukaryotic cells. A growing body of evidence suggests that actin-mediated intra- and extracellular signalling is instrumental in facilitating organism-level emergent behaviour patterns which, crucially, may be characterised as natural expressions of computation. We use excitable cellular automata modelling to simulate signal transmission through cell arrays whose topology was extracted from images of Watershed transformation-derived actin network reconstructions; the actin networks sampled were from laboratory experimental observations of a model organism, slime mould Physarum polycephalum. Our results indicate that actin networks support directional transmission of generalised energetic phenomena, the amplification and trans-network speed of which of which is proportional to network density (whose primary determinant is the anatomical location of the network sampled). Furthermore, this model also suggests the ability of such networks for supporting signal-signal interactions which may be characterised as Boolean logical operations, thus indicating that a cellâs actin network may function as a nanoscale data transmission and processing network. We conclude by discussing the role of the cytoskeleton in facilitating intracellular computing, how computation can be implemented in such a network and practical considerations for designing âusefulâ actin circuitry
- âŠ