Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks

Recurrent neural networks (RNNs) are widely used in computational neuroscience and machine learning applications. In an RNN, each neuron computes its output as a nonlinear function of its integrated input. While the importance of RNNs, especially as models of brain processing, is undisputed, it is also widely acknowledged that the computations in standard RNN models may be an over-simplification of what real neuronal networks compute. Here, we suggest that the RNN approach may be made both neurobiologically more plausible and computationally more powerful by its fusion with Bayesian inference techniques for nonlinear dynamical systems. In this scheme, we use an RNN as a generative model of dynamic input caused by the environment, e.g. of speech or kinematics. Given this generative RNN model, we derive Bayesian update equations that can decode its output. Critically, these updates define a 'recognizing RNN' (rRNN), in which neurons compute and exchange prediction and prediction error messages. The rRNN has several desirable features that a conventional RNN does not have, for example, fast decoding of dynamic stimuli and robustness to initial conditions and noise. Furthermore, it implements a predictive coding scheme for dynamic inputs. We suggest that the Bayesian inversion of recurrent neural networks may be useful both as a model of brain function and as a machine learning tool. We illustrate the use of the rRNN by an application to the online decoding (i.e. recognition) of human kinematics

Brain-actuated functional electrical stimulation elicits lasting arm motor recovery after stroke

Brain-computer interfaces (BCI) are used in stroke rehabilitation to translate brain signals into intended movements of the paralyzed limb. However, the efficacy and mechanisms of BCI-based therapies remain unclear. Here we show that BCI coupled to functional electrical stimulation (FES) elicits significant, clinically relevant, and lasting motor recovery in chronic stroke survivors more effectively than sham FES. Such recovery is associated to quantitative signatures of functional neuroplasticity. BCI patients exhibit a significant functional recovery after the intervention, which remains 6–12 months after the end of therapy. Electroencephalography analysis pinpoints significant differences in favor of the BCI group, mainly consisting in an increase in functional connectivity between motor areas in the affected hemisphere. This increase is significantly correlated with functional improvement. Results illustrate how a BCI–FES therapy can drive significant functional recovery and purposeful plasticity thanks to contingent activation of body natural efferent and afferent pathways

Decision, Sensation, and Habituation: A Multi-Layer Dynamic Field Model for Inhibition of Return

Inhibition of Return (IOR) is one of the most consistent and widely studied effects in experimental psychology. The effect refers to a delayed response to visual stimuli in a cued location after initial priming at that location. This article presents a dynamic field model for IOR. The model describes the evolution of three coupled activation fields. The decision field, inspired by the intermediate layer of the superior colliculus, receives endogenous input and input from a sensory field. The sensory field, inspired by earlier sensory processing, receives exogenous input. Habituation of the sensory field is implemented by a reciprocal coupling with a third field, the habituation field. The model generates IOR because, due to the habituation of the sensory field, the decision field receives a reduced target-induced input in cue-target-compatible situations. The model is consistent with single-unit recordings of neurons of monkeys that perform IOR tasks. Such recordings have revealed that IOR phenomena parallel the activity of neurons in the intermediate layer of the superior colliculus and that neurons in this layer receive reduced input in cue-target-compatible situations. The model is also consistent with behavioral data concerning temporal expectancy effects. In a discussion, the multi-layer dynamic field account of IOR is used to illustrate the broader view that behavior consists of a tuning of the organism to the environment that continuously and concurrently takes place at different spatiotemporal scales

A parsimonious oscillatory model of handwriting

International audienceWe propose an oscillatory model that is theoretically parsimonious, empirically efficient and biologically plausible. Building on Hollerbach’s (Biol Cybern 39:139–156, 1981) model, our Parsimonious Oscillatory Model of Handwriting (POMH) overcomes the latter’s main shortcomings by making it possible to extract its parameters from the trace itself and by reinstating symmetry between the x and y coordinates. The benefit is a capacity to autonomously generate a smooth continuous trace that reproduces the dynamics of the handwriting movements through an extremely sparse model, whose efficiency matches that of other, more computationally expensive optimizing methods. Moreover, the model applies to 2D trajectories, irrespective of their shape, size, orientation and length. It is also independent of the endeffectors mobilized and of the writing direction

A user-centred approach to unlock the potential of non-invasive BCIs: an unprecedented international translational effort

Non-invasive Mental Task-based Brain-Computer Interfaces (MT-BCIs) enable their users to interact with the environment through their brain activity alone (measured using electroencephalography for example), by performing mental tasks such as mental calculation or motor imagery. Current developments in technology hint at a wide range of possible applications, both in the clinical and non-clinical domains. MT-BCIs can be used to control (neuro)prostheses or interact with video games, among many other applications. They can also be used to restore cognitive and motor abilities for stroke rehabilitation, or even improve athletic performance.Nonetheless, the expected transfer of MT-BCIs from the lab to the marketplace will be greatly impeded if all resources are allocated to technological aspects alone. We cannot neglect the Human End-User that sits in the centre of the loop. Indeed, self-regulating one’s brain activity through mental tasks to interact is an acquired skill that requires appropriate training. Yet several studies have shown that current training procedures do not enable MT-BCI users to reach adequate levels of performance. Therefore, one significant challenge for the community is that of improving end-user training.To do so, another fundamental challenge must be taken into account: we need to understand the processes that underlie MT-BCI performance and user learning. It is currently estimated that 10 to 30% of people cannot control an MT-BCI. These people are often referred to as “BCI inefficient”. But the concept of “BCI inefficiency” is debated. Does it really exist? Or, are low performances due to insufficient training, training procedures that are unsuited to these users or is the BCI data processing not sensitive enough? The currently available literature does not allow for a definitive answer to these questions as most published studies either include a limited number of participants (i.e., 10 to 20 participants) and/or training sessions (i.e., 1 or 2). We still have very little insight into what the MT-BCI learning curve looks like, and into which factors (including both user-related and machine-related factors) influence this learning curve. Finding answers will require a large number of experiments, involving a large number of participants taking part in multiple training sessions. It is not feasible for one research lab or even a small consortium to undertake such experiments alone. Therefore, an unprecedented coordinated effort from the research community is necessary.We are convinced that combining forces will allow us to characterise in detail MT-BCI user learning, and thereby provide a mandatory step toward transferring BCIs “out of the lab”. This is why we gathered an international, interdisciplinary consortium of BCI researchers from more than 20 different labs across Europe and Japan, including pioneers in the field. This collaboration will enable us to collect considerable amounts of data (at least 100 participants for 20 training sessions each) and establish a large open database. Based on this precious resource, we could then lead sound analyses to answer the previously mentioned questions. Using this data, our consortium could offer solutions on how to improve MT-BCI training procedures using innovative approaches (e.g., personalisation using intelligent tutoring systems) and technologies (e.g., virtual reality). The CHIST-ERA programme represents a unique opportunity to conduct this ambitious project, which will foster innovation in our field and strengthen our community

Time Scale Hierarchies in the Functional Organization of Complex Behaviors

Traditional approaches to cognitive modelling generally portray cognitive events in terms of ‘discrete’ states (point attractor dynamics) rather than in terms of processes, thereby neglecting the time structure of cognition. In contrast, more recent approaches explicitly address this temporal dimension, but typically provide no entry points into cognitive categorization of events and experiences. With the aim to incorporate both these aspects, we propose a framework for functional architectures. Our approach is grounded in the notion that arbitrary complex (human) behaviour is decomposable into functional modes (elementary units), which we conceptualize as low-dimensional dynamical objects (structured flows on manifolds). The ensemble of modes at an agent’s disposal constitutes his/her functional repertoire. The modes may be subjected to additional dynamics (termed operational signals), in particular, instantaneous inputs, and a mechanism that sequentially selects a mode so that it temporarily dominates the functional dynamics. The inputs and selection mechanisms act on faster and slower time scales then that inherent to the modes, respectively. The dynamics across the three time scales are coupled via feedback, rendering the entire architecture autonomous. We illustrate the functional architecture in the context of serial behaviour, namely cursive handwriting. Subsequently, we investigate the possibility of recovering the contributions of functional modes and operational signals from the output, which appears to be possible only when examining the output phase flow (i.e., not from trajectories in phase space or time)

Complex Processes from Dynamical Architectures with Time-Scale Hierarchy

The idea that complex motor, perceptual, and cognitive behaviors are composed of smaller units, which are somehow brought into a meaningful relation, permeates the biological and life sciences. However, no principled framework defining the constituent elementary processes has been developed to this date. Consequently, functional configurations (or architectures) relating elementary processes and external influences are mostly piecemeal formulations suitable to particular instances only. Here, we develop a general dynamical framework for distinct functional architectures characterized by the time-scale separation of their constituents and evaluate their efficiency. Thereto, we build on the (phase) flow of a system, which prescribes the temporal evolution of its state variables. The phase flow topology allows for the unambiguous classification of qualitatively distinct processes, which we consider to represent the functional units or modes within the dynamical architecture. Using the example of a composite movement we illustrate how different architectures can be characterized by their degree of time scale separation between the internal elements of the architecture (i.e. the functional modes) and external interventions. We reveal a tradeoff of the interactions between internal and external influences, which offers a theoretical justification for the efficient composition of complex processes out of non-trivial elementary processes or functional modes