A Tale of Two Animats: What does it take to have goals?

What does it take for a system, biological or not, to have goals? Here, this question is approached in the context of in silico artificial evolution. By examining the informational and causal properties of artificial organisms ('animats') controlled by small, adaptive neural networks (Markov Brains), this essay discusses necessary requirements for intrinsic information, autonomy, and meaning. The focus lies on comparing two types of Markov Brains that evolved in the same simple environment: one with purely feedforward connections between its elements, the other with an integrated set of elements that causally constrain each other. While both types of brains 'process' information about their environment and are equally fit, only the integrated one forms a causally autonomous entity above a background of external influences. This suggests that to assess whether goals are meaningful for a system itself, it is important to understand what the system is, rather than what it does.Comment: This article is a contribution to the FQXi 2016-2017 essay contest "Wandering Towards a Goal

Integrated Information in Discrete Dynamical Systems: Motivation and Theoretical Framework

This paper introduces a time- and state-dependent measure of integrated information, φ, which captures the repertoire of causal states available to a system as a whole. Specifically, φ quantifies how much information is generated (uncertainty is reduced) when a system enters a particular state through causal interactions among its elements, above and beyond the information generated independently by its parts. Such mathematical characterization is motivated by the observation that integrated information captures two key phenomenological properties of consciousness: (i) there is a large repertoire of conscious experiences so that, when one particular experience occurs, it generates a large amount of information by ruling out all the others; and (ii) this information is integrated, in that each experience appears as a whole that cannot be decomposed into independent parts. This paper extends previous work on stationary systems and applies integrated information to discrete networks as a function of their dynamics and causal architecture. An analysis of basic examples indicates the following: (i) φ varies depending on the state entered by a network, being higher if active and inactive elements are balanced and lower if the network is inactive or hyperactive. (ii) φ varies for systems with identical or similar surface dynamics depending on the underlying causal architecture, being low for systems that merely copy or replay activity states. (iii) φ varies as a function of network architecture. High φ values can be obtained by architectures that conjoin functional specialization with functional integration. Strictly modular and homogeneous systems cannot generate high φ because the former lack integration, whereas the latter lack information. Feedforward and lattice architectures are capable of generating high φ but are inefficient. (iv) In Hopfield networks, φ is low for attractor states and neutral states, but increases if the networks are optimized to achieve tension between local and global interactions. These basic examples appear to match well against neurobiological evidence concerning the neural substrates of consciousness. More generally, φ appears to be a useful metric to characterize the capacity of any physical system to integrate information

Cognition as Embodied Morphological Computation

Cognitive science is considered to be the study of mind (consciousness and thought) and intelligence in humans. Under such definition variety of unsolved/unsolvable problems appear. This article argues for a broad understanding of cognition based on empirical results from i.a. natural sciences, self-organization, artificial intelligence and artificial life, network science and neuroscience, that apart from the high level mental activities in humans, includes sub-symbolic and sub-conscious processes, such as emotions, recognizes cognition in other living beings as well as extended and distributed/social cognition. The new idea of cognition as complex multiscale phenomenon evolved in living organisms based on bodily structures that process information, linking cognitivists and EEEE (embodied, embedded, enactive, extended) cognition approaches with the idea of morphological computation (info-computational self-organisation) in cognizing agents, emerging in evolution through interactions of a (living/cognizing) agent with the environment

Repetitive Transcranial Magnetic Stimulation Affects behavior by Biasing Endogenous Cortical Oscillations

A governing assumption about repetitive transcranial magnetic stimulation (rTMS) has been that it interferes with task-related neuronal activity – in effect, by “injecting noise” into the brain – and thereby disrupts behavior. Recent reports of rTMS-produced behavioral enhancement, however, call this assumption into question. We investigated the neurophysiological effects of rTMS delivered during the delay period of a visual working memory task by simultaneously recording brain activity with electroencephalography (EEG). Subjects performed visual working memory for locations or for shapes, and in half the trials a 10-Hz train of rTMS was delivered to the superior parietal lobule (SPL) or a control brain area. The wide range of individual differences in the effects of rTMS on task accuracy, from improvement to impairment, was predicted by individual differences in the effect of rTMS on power in the alpha-band of the EEG (∼10 Hz): a decrease in alpha-band power corresponded to improved performance, whereas an increase in alpha-band power corresponded to the opposite. The EEG effect was localized to cortical sources encompassing the frontal eye fields and the intraparietal sulcus, and was specific to task (location, but not object memory) and to rTMS target (SPL, not control area). Furthermore, for the same task condition, rTMS-induced changes in cross-frequency phase synchrony between alpha- and gamma-band (>40 Hz) oscillations predicted changes in behavior. These results suggest that alpha-band oscillations play an active role cognitive processes and do not simply reflect absence of processing. Furthermore, this study shows that the complex effects of rTMS on behavior can result from biasing endogenous patterns of network-level oscillations

Complexity of multi-dimensional spontaneous EEG decreases during propofol induced general anaesthesia

Emerging neural theories of consciousness suggest a correlation between a specific type of neural dynamical complexity and the level of consciousness: When awake and aware, causal interactions between brain regions are both integrated (all regions are to a certain extent connected) and differentiated (there is inhomogeneity and variety in the interactions). In support of this, recent work by Casali et al (2013) has shown that Lempel-Ziv complexity correlates strongly with conscious level, when computed on the EEG response to transcranial magnetic stimulation. Here we investigated complexity of spontaneous high-density EEG data during propofol-induced general anaesthesia. We consider three distinct measures: (i) Lempel-Ziv complexity, which is derived from how compressible the data are; (ii) amplitude coalition entropy, which measures the variability in the constitution of the set of active channels; and (iii) the novel synchrony coalition entropy (SCE), which measures the variability in the constitution of the set of synchronous channels. After some simulations on Kuramoto oscillator models which demonstrate that these measures capture distinct ‘flavours’ of complexity, we show that there is a robustly measurable decrease in the complexity of spontaneous EEG during general anaesthesia

Integrated information increases with fitness in the evolution of animats

One of the hallmarks of biological organisms is their ability to integrate disparate information sources to optimize their behavior in complex environments. How this capability can be quantified and related to the functional complexity of an organism remains a challenging problem, in particular since organismal functional complexity is not well-defined. We present here several candidate measures that quantify information and integration, and study their dependence on fitness as an artificial agent ("animat") evolves over thousands of generations to solve a navigation task in a simple, simulated environment. We compare the ability of these measures to predict high fitness with more conventional information-theoretic processing measures. As the animat adapts by increasing its "fit" to the world, information integration and processing increase commensurately along the evolutionary line of descent. We suggest that the correlation of fitness with information integration and with processing measures implies that high fitness requires both information processing as well as integration, but that information integration may be a better measure when the task requires memory. A correlation of measures of information integration (but also information processing) and fitness strongly suggests that these measures reflect the functional complexity of the animat, and that such measures can be used to quantify functional complexity even in the absence of fitness data.Comment: 27 pages, 8 figures, one supplementary figure. Three supplementary video files available on request. Version commensurate with published text in PLoS Comput. Bio

The Minimal Complexity of Adapting Agents Increases with Fitness

What is the relationship between the complexity and the fitness of evolved organisms, whether natural or artificial? It has been asserted, primarily based on empirical data, that the complexity of plants and animals increases as their fitness within a particular environment increases via evolution by natural selection. We simulate the evolution of the brains of simple organisms living in a planar maze that they have to traverse as rapidly as possible. Their connectome evolves over 10,000s of generations. We evaluate their circuit complexity, using four information-theoretical measures, including one that emphasizes the extent to which any network is an irreducible entity. We find that their minimal complexity increases with their fitness

Overnight changes in waking auditory evoked potential amplitude reflect altered sleep homeostasis in major depression

Objective: Sleep homeostasis is altered in major depressive disorder (MDD). Pre- to postsleep decline in waking auditory evoked potential (AEP) amplitude has been correlated with sleep slow wave activity (SWA), suggesting that overnight changes in waking AEP amplitude are homeostatically regulated in healthy individuals. This study investigated whether the overnight change in waking AEP amplitude and its relation to SWA is altered in MDD. Method: Using 256-channel high-density electroencephalography, all-night sleep polysomnography and single-tone waking AEPs pre- and postsleep were collected in 15 healthy controls (HC) and 15 non-medicated individuals with MDD. Results: N1 and P2 amplitudes of the waking AEP declined after sleep in the HC group, but not in MDD. The reduction in N1 amplitude also correlated with fronto-central SWA in the HC group, but a comparable relationship was not found in MDD, despite equivalent SWA between groups. No pre- to postsleep differences were found for N1 or P2 latencies in either group. These findings were not confounded by varying levels of alertness or differences in sleep variables between groups. Conclusion: MDD involves altered sleep homeostasis as measured by the overnight change in waking AEP amplitude. Future research is required to determine the clinical implications of these findings

Repetitive transcranial magnetic stimulation dissociates working memory manipulation from retention functions in the prefrontal, but not posterior parietal, cortex

Understanding the contributions of the prefrontal cortex (PFC) to working memory is central to understanding the neural bases of high-level cognition. One question that remains controversial is whether the same areas of the dorsolateral PFC (dlPFC) that participate in the manipulation of information in working memory also contribute to its short-term retention (STR). We evaluated this question by first identifying, with functional magnetic resonance imaging (fMRI), brain areas involved in manipulation. Next, these areas were targeted with repetitive transcranial magnetic stimulation (rTMS) while subjects performed tasks requiring only the STR or the STR plus manipulation of information in working memory. fMRI indicated that manipulation-related activity was independent of retention-related activity in both the PFC and superior parietal lobule (SPL). rTMS, however, yielded a different pattern of results. Although rTMS of the dlPFC selectively disrupted manipulation, rTMS of the SPL disrupted manipulation and STR to the same extent. rTMS of the postcentral gyrus (a control region) had no effect on performance. The implications of these results are twofold. In the PFC, they are consistent with the view that this region contributes more importantly to the control of information in working memory than to its STR. In the SPL, they illustrate the importance of supplementing the fundamentally correlational data from neuroimaging with a disruptive method, which affords stronger inference about structure-function relations

Analysis of the Temporal Organization of Sleep Spindles in the Human Sleep EEG Using a Phenomenological Modeling Approach

The sleep electroencephalogram (EEG) is characterized by typical oscillatory patterns such as sleep spindles and slow waves. Recently, we proposed a method to detect and analyze these patterns using linear autoregressive models for short (≈ 1 s) data segments. We analyzed the temporal organization of sleep spindles and discuss to what extent the observed interevent intervals correspond to properties of stationary stochastic processes and whether additional slow processes, such as slow oscillations, have to be assumed. We have found evidence for such an additional slow process, most pronounced in sleep stage 2