From Computation to Clinic

Theory-driven and data-driven computational approaches to psychiatry have enormous potential for elucidating mechanism of disease and providing translational linkages between basic science findings and the clinic. These approaches have already demonstrated utility in providing clinically relevant understanding, primarily via back translation from clinic to computation, revealing how specific disorders or symptoms map onto specific computational processes. Nonetheless, forward translation, from computation to clinic, remains rare. In addition, consensus regarding specific barriers to forward translation—and on the best strategies to overcome these barriers—is limited. This perspective review brings together expert basic and computationally trained researchers and clinicians to 1) identify challenges specific to preclinical model systems and clinical translation of computational models of cognition and affect, and 2) discuss practical approaches to overcoming these challenges. In doing so, we highlight recent evidence for the ability of computational approaches to predict treatment responses in psychiatric disorders and discuss considerations for maximizing the clinical relevance of such models (e.g., via longitudinal testing) and the likelihood of stakeholder adoption (e.g., via cost-effectiveness analyses)

Policy Adjustment in a Dynamic Economic Game

Making sequential decisions to harvest rewards is a notoriously difficult problem. One difficulty is that the real world is not stationary and the reward expected from a contemplated action may depend in complex ways on the history of an animal's choices. Previous functional neuroimaging work combined with principled models has detected brain responses that correlate with computations thought to guide simple learning and action choice. Those works generally employed instrumental conditioning tasks with fixed action-reward contingencies. For real-world learning problems, the history of reward-harvesting choices can change the likelihood of rewards collected by the same choices in the near-term future. We used functional MRI to probe brain and behavioral responses in a continuous decision-making task where reward contingency is a function of both a subject's immediate choice and his choice history. In these more complex tasks, we demonstrated that a simple actor-critic model can account for both the subjects' behavioral and brain responses, and identified a reward prediction error signal in ventral striatal structures active during these non-stationary decision tasks. However, a sudden introduction of new reward structures engages more complex control circuitry in the prefrontal cortex (inferior frontal gyrus and anterior insula) and is not captured by a simple actor-critic model. Taken together, these results extend our knowledge of reward-learning signals into more complex, history-dependent choice tasks. They also highlight the important interplay between striatum and prefrontal cortex as decision-makers respond to the strategic demands imposed by non-stationary reward environments more reminiscent of real-world tasks

Habitat structure: a fundamental concept and framework for urban soil ecology

Habitat structure is defined as the composition and arrangement of physical matter at a location. Although habitat structure is the physical template underlying ecological patterns and processes, the concept is relatively unappreciated and underdeveloped in ecology. However, it provides a fundamental concept for urban ecology because human activities in urban ecosystems are often targeted toward management of habitat structure. In addition, the concept emphasizes the fine-scale, on-the-ground perspective needed in the study of urban soil ecology. To illustrate this, urban soil ecology research is summarized from the perspective of habitat structure effects. Among the key conclusions emerging from the literature review are: (1) habitat structure provides a unifying theme for multivariate research about urban soil ecology; (2) heterogeneous urban habitat structures influence soil ecological variables in different ways; (3) more research is needed to understand relationships among sociological variables, habitat structure patterns and urban soil ecology. To stimulate urban soil ecology research, a conceptual framework is presented to show the direct and indirect relationships among habitat structure and ecological variables. Because habitat structure serves as a physical link between sociocultural and ecological systems, it can be used as a focus for interdisciplinary and applied research (e.g., pest management) about the multiple, interactive effects of urbanization on the ecology of soils

Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

An Integrated Decision Making Approach for Adaptive Shared Control of Mobility Assistance Robots

© 2016, Springer Science+Business Media Dordrecht. Mobility assistance robots provide support to elderly or patients during walking. The design of a safe and intuitive assistance behavior is one of the major challenges in this context. We present an integrated approach for the context-specific, on-line adaptation of the assistance level of a rollator-type mobility assistance robot by gain-scheduling of low-level robot control parameters. A human-inspired decision-making model, the drift-diffusion Model, is introduced as the key principle to gain-schedule parameters and with this to adapt the provided robot assistance in order to achieve a human-like assistive behavior. The mobility assistance robot is designed to provide (a) cognitive assistance to help the user following a desired path towards a predefined destination as well as (b) sensorial assistance to avoid collisions with obstacles while allowing for an intentional approach of them. Further, the robot observes the user long-term performance and fatigue to adapt the overall level of (c) physical assistance provided. For each type of assistance a decision-making problem is formulated that affects different low-level control parameters. The effectiveness of the proposed approach is demonstrated in technical validation experiments. Moreover, the proposed approach is evaluated in a user study with 35 elderly persons. Obtained results indicate that the proposed gain-scheduling technique incorporating ideas of human decision-making models shows a general high potential for the application in adaptive shared control of mobility assistance robots

Genome sequencing of the extinct Eurasian wild aurochs, Bos primigenius, illuminates the phylogeography and evolution of cattle

Background Domestication of the now-extinct wild aurochs, Bos primigenius, gave rise to the two major domestic extant cattle taxa, B. taurus and B. indicus. While previous genetic studies have shed some light on the evolutionary relationships between European aurochs and modern cattle, important questions remain unanswered, including the phylogenetic status of aurochs, whether gene flow from aurochs into early domestic populations occurred, and which genomic regions were subject to selection processes during and after domestication. Here, we address these questions using whole-genome sequencing data generated from an approximately 6,750-year-old British aurochs bone and genome sequence data from 81 additional cattle plus genome-wide single nucleotide polymorphism data from a diverse panel of 1,225 modern animals. Results Phylogenomic analyses place the aurochs as a distinct outgroup to the domestic B. taurus lineage, supporting the predominant Near Eastern origin of European cattle. Conversely, traditional British and Irish breeds share more genetic variants with this aurochs specimen than other European populations, supporting localized gene flow from aurochs into the ancestors of modern British and Irish cattle, perhaps through purposeful restocking by early herders in Britain. Finally, the functions of genes showing evidence for positive selection in B. taurus are enriched for neurobiology, growth, metabolism and immunobiology, suggesting that these biological processes have been important in the domestication of cattle. Conclusions This work provides important new information regarding the origins and functional evolution of modern cattle, revealing that the interface between early European domestic populations and wild aurochs was significantly more complex than previously thought

Synergizing expectation and execution for stroke communities of practice innovations

<p>Abstract</p> <p>Background</p> <p>Regional networks have been recognized as an interesting model to support interdisciplinary and inter-organizational interactions that lead to meaningful care improvements. Existing communities of practice within the a regional network, the Montreal Stroke Network (MSN) offers a compelling structure to better manage the exponential growth of knowledge and to support care providers to better manage the complex cases they must deal with in their practices. This research project proposes to examine internal and external factors that influence individual and organisational readiness to adopt national stroke best practices and to assess the impact of an e-collaborative platform in facilitating knowledge translation activities.</p> <p>Methods</p> <p>We will develop an e-collaborative platform that will include various social networking and collaborative tools. We propose to create online brainstorming sessions ('jams') around each best practice recommendation. Jam postings will be analysed to identify emergent themes. Syntheses of these analyses will be provided to members to help them identify priority areas for practice change. Discussions will be moderated by clinical leaders, whose role will be to accelerate crystallizing of ideas around 'how to' implement selected best practices. All clinicians (~200) involved in stroke care among the MSN will be asked to participate. Activities during face-to-face meetings and on the e-collaborative platform will be documented. Content analysis of all activities will be performed using an observation grid that will use as outcome indicators key elements of communities of practice and of the knowledge creation cycle developed by Nonaka. Semi-structured interviews will be conducted among users of the e-collaborative platform to collect information on variables of the knowledge-to-action framework. All participants will be asked to complete three questionnaires: the typology questionnaire, which classifies individuals into one of four mutually exclusive categories of information seeking; the e-health state of readiness, which covers ten domains of the readiness to change; and a community of practice evaluation survey.</p> <p>Summary</p> <p>This project is expected to enhance our understanding of collaborative work across disciplines and organisations in accelerating implementation of best practices along the continuum of care, and how e-technologies influence access, sharing, creation, and application of knowledge.</p

Towards a General Theory of Neural Computation Based on Prediction by Single Neurons

Although there has been tremendous progress in understanding the mechanics of the nervous system, there has not been a general theory of its computational function. Here I present a theory that relates the established biophysical properties of single generic neurons to principles of Bayesian probability theory, reinforcement learning and efficient coding. I suggest that this theory addresses the general computational problem facing the nervous system. Each neuron is proposed to mirror the function of the whole system in learning to predict aspects of the world related to future reward. According to the model, a typical neuron receives current information about the state of the world from a subset of its excitatory synaptic inputs, and prior information from its other inputs. Prior information would be contributed by synaptic inputs representing distinct regions of space, and by different types of non-synaptic, voltage-regulated channels representing distinct periods of the past. The neuron's membrane voltage is proposed to signal the difference between current and prior information (“prediction error” or “surprise”). A neuron would apply a Hebbian plasticity rule to select those excitatory inputs that are the most closely correlated with reward but are the least predictable, since unpredictable inputs provide the neuron with the most “new” information about future reward. To minimize the error in its predictions and to respond only when excitation is “new and surprising,” the neuron selects amongst its prior information sources through an anti-Hebbian rule. The unique inputs of a mature neuron would therefore result from learning about spatial and temporal patterns in its local environment, and by extension, the external world. Thus the theory describes how the structure of the mature nervous system could reflect the structure of the external world, and how the complexity and intelligence of the system might develop from a population of undifferentiated neurons, each implementing similar learning algorithms

Super-Resolution Dynamic Imaging of Dendritic Spines Using a Low-Affinity Photoconvertible Actin Probe

The actin cytoskeleton of dendritic spines plays a key role in morphological aspects of synaptic plasticity. The detailed analysis of the spine structure and dynamics in live neurons, however, has been hampered by the diffraction-limited resolution of conventional fluorescence microscopy. The advent of nanoscopic imaging techniques thus holds great promise for the study of these processes. We implemented a strategy for the visualization of morphological changes of dendritic spines over tens of minutes at a lateral resolution of 25 to 65 nm. We have generated a low-affinity photoconvertible probe, capable of reversibly binding to actin and thus allowing long-term photoactivated localization microscopy of the spine cytoskeleton. Using this approach, we resolve structural parameters of spines and record their long-term dynamics at a temporal resolution below one minute. Furthermore, we have determined changes in the spine morphology in response to pharmacologically induced synaptic activity and quantified the actin redistribution underlying these changes. By combining PALM imaging with quantum dot tracking, we could also simultaneously visualize the cytoskeleton and the spine membrane, allowing us to record complementary information on the morphological changes of the spines at super-resolution