A biologically motivated synthesis of accumulator and reinforcement-learning models for describing adaptive decision-making

Cognitive process models, such as reinforcement learning (RL) and accumulator models of decision-making, have proven to be highly insightful tools for studying adaptive behaviors as well as their underlying neural substrates. Currently, however, two major barriers exist preventing these models from being applied in more complex settings: 1) the assumptions of most accumulator models break down for decisions involving more than two alternatives; 2) RL and accumulator models currently exist as separate frameworks, with no clear mapping between trial-to-trial learning and the dynamics of the decision process. Recently I showed how a modified accumulator model, premised off of the architecture of cortico-basal ganglia pathways, both predicts human decisions in uncertain situations and evoked activity in cortical and subcortical control circuits. Here I present a synthesis of RL and accumulator models that is motivated by recent evidence that the basal ganglia acts as a site for integrating trial-wise feedback from midbrain dopaminergic neurons with accumulating evidence from sensory and associative cortices. I show how this hybrid model can explain both adaptive go/no-go decisions and multi-alternative decisions in a computationally efficient manner. More importantly, by parameterizing the model to conform to various underlying assumptions about the architecture and physiology of basal ganglia pathways, model predictions can be rigorously tested against observed patterns in behavior as well as neural recordings. The result is a biologically-constrained and behaviorally tractable description of trial-to-trial learning effects on decision-making among multiple alternatives

On the neurobiology of apathy and depression in cerebral small vessel disease

Cerebral small vessel disease (SVD) is a cerebrovascular pathology that affects the small vessels of the brain, resulting in heterogeneous brain tissue changes. These can lead to neuropsychiatric symptoms such as apathy, a loss of motivation, and depression, which is characterised by low mood and a loss of pleasure. Apathy and depression are both prevalent symptoms in SVD, but an understanding of the relationship between underlying disease processes and the expression of these neuropsychiatric symptoms remains poor. This thesis uses magnetic resonance imaging techniques to examine the neurobiological basis of apathy and depression in SVD. We show that apathy is related to focal grey matter damage and distributed white matter microstructural change. These microstructural changes underlie large-scale white matter network disruption, which is related to apathy, but not depression. We then show that depression, as a construct, can be dissociated into distinct symptoms which are associated with overlapping and distinct areas of cortical atrophy over time. This suggests that depression as a general syndrome may be characterised by atrophy in core structures, while different symptoms are associated with atrophy in more specialised areas. Consistent with these patterns of overarching tissue damage, we find that apathy, but not depression, predicts conversion to dementia in patients with SVD. Our findings suggest that different types of SVD-related pathology lead to apathy and depression. Diffuse white matter damage may lead to widespread network disruption, resulting in apathy and cognitive impairment. In contrast, depressive symptoms are associated with focal patterns of grey matter atrophy over time. This highlights the importance of differentiating neuropsychiatric symptoms, and paves the way for targeted treatment approaches.Cambridge International Scholarship (Cambridge Trust)

Arousal, exploration and the locus coeruleus-norepinephrine system

The studies described in this thesis address a range of topics related to arousal, exploration, temporal attention, and the locus coeruleus-norepinephrine (LC-NE) system. Chapters 2 and 3 report two studies that investigated a recent theory about the role of the LC-NE system in the regulation of the exploration-exploitation trade-off. Chapter 4 reports a study on neurocognitive function in patients with dopamine-β-hydroxylase (DβH) deficiency. Chapter 5 reports an fMRI study on the neural correlates of perceptual curiosity. Chapter 6 and 7 reported several experiments investigating the effects of ‘accessory stimuli’ and temporal certainty on information processing, using scalp electrophysiology and sequential-sampling models of decision making. Taken together, the studies reported in this thesis suggest that arousal, exploration and temporal attention are closely related, which is likely due to a shared neural basis.LEI Universiteit LeidenFSW - Action Control - Ou

Fundamental Approaches to Software Engineering

This open access book constitutes the proceedings of the 25th International Conference on Fundamental Approaches to Software Engineering, FASE 2022, which was held during April 4-5, 2022, in Munich, Germany, as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2022. The 17 regular papers presented in this volume were carefully reviewed and selected from 64 submissions. The proceedings also contain 3 contributions from the Test-Comp Competition. The papers deal with the foundations on which software engineering is built, including topics like software engineering as an engineering discipline, requirements engineering, software architectures, software quality, model-driven development, software processes, software evolution, AI-based software engineering, and the specification, design, and implementation of particular classes of systems, such as (self-)adaptive, collaborative, AI, embedded, distributed, mobile, pervasive, cyber-physical, or service-oriented applications

An Overview of Approaches and Challenges for Retrieving Marine Inherent Optical Properties from Ocean Color Remote Sensing

Ocean color measured from satellites provides daily global, synoptic views of spectral water-leaving reflectances that can be used to generate estimates of marine inherent optical properties (IOPs). These reflectances, namely the ratio of spectral upwelled radiances to spectral downwelled irradiances, describe the light exiting a water mass that defines its color. IOPs are the spectral absorption and scattering characteristics of ocean water and its dissolved and particulate constituents. Because of their dependence on the concentration and composition of marine constituents, IOPs can be used to describe the contents of the upper ocean mixed layer. This information is critical to further our scientific understanding of biogeochemical oceanic processes, such as organic carbon production and export, phytoplankton dynamics, and responses to climatic disturbances. Given their importance, the international ocean color community has invested significant effort in improving the quality of satellite-derived IOP products, both regionally and globally. Recognizing the current influx of data products into the community and the need to improve current algorithms in anticipation of new satellite instruments (e.g., the global, hyperspectral spectroradiometer of the NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission), we present a synopsis of the current state of the art in the retrieval of these core optical properties. Contemporary approaches for obtaining IOPs from satellite ocean color are reviewed and, for clarity, separated based their inversion methodology or the type of IOPs sought. Summaries of known uncertainties associated with each approach are provided, as well as common performance metrics used to evaluate them. We discuss current knowledge gaps and make recommendations for future investment for upcoming missions whose instrument characteristics diverge sufficiently from heritage and existing sensors to warrant reassessing current approaches

An Overview of Approaches and Challenges for Retrieving Marine Inherent Optical Properties from Ocean Color Remote Sensing

Ocean color measured from satellites provides daily global, synoptic views of spectral water-leaving reflectancesthat can be used to generate estimates of marine inherent optical properties (IOPs). These reflectances, namelythe ratio of spectral upwelled radiances to spectral downwelled irradiances, describe the light exiting a watermass that defines its color. IOPs are the spectral absorption and scattering characteristics of ocean water and itsdissolved and particulate constituents. Because of their dependence on the concentration and composition ofmarine constituents, IOPs can be used to describe the contents of the upper ocean mixed layer. This informationis critical to further our scientific understanding of biogeochemical oceanic processes, such as organic carbonproduction and export, phytoplankton dynamics, and responses to climatic disturbances. Given their im-portance, the international ocean color community has invested significant effort in improving the quality of satellite-derived IOP products, both regionally and globally. Recognizing the current influx of data products intothe community and the need to improve current algorithms in anticipation of new satellite instruments (e.g., theglobal, hyperspectral spectroradiometer of the NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mis-sion), we present a synopsis of the current state of the art in the retrieval of these core optical properties.Contemporary approaches for obtaining IOPs from satellite ocean color are reviewed and, for clarity, separatedbased their inversion methodology or the type of IOPs sought. Summaries of known uncertainties associated witheach approach are provided, as well as common performance metrics used to evaluate them. We discuss currentknowledge gaps and make recommendations for future investment for upcoming missions whose instrumentcharacteristics diverge sufficiently from heritage and existing sensors to warrant reassessing current approaches

Fundamental Approaches to Software Engineering

This open access book constitutes the proceedings of the 25th International Conference on Fundamental Approaches to Software Engineering, FASE 2022, which was held during April 4-5, 2022, in Munich, Germany, as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2022. The 17 regular papers presented in this volume were carefully reviewed and selected from 64 submissions. The proceedings also contain 3 contributions from the Test-Comp Competition. The papers deal with the foundations on which software engineering is built, including topics like software engineering as an engineering discipline, requirements engineering, software architectures, software quality, model-driven development, software processes, software evolution, AI-based software engineering, and the specification, design, and implementation of particular classes of systems, such as (self-)adaptive, collaborative, AI, embedded, distributed, mobile, pervasive, cyber-physical, or service-oriented applications