Theory of disk accretion onto supermassive black holes

Accretion onto supermassive black holes produces both the dramatic phenomena associated with active galactic nuclei and the underwhelming displays seen in the Galactic Center and most other nearby galaxies. I review selected aspects of the current theoretical understanding of black hole accretion, emphasizing the role of magnetohydrodynamic turbulence and gravitational instabilities in driving the actual accretion and the importance of the efficacy of cooling in determining the structure and observational appearance of the accretion flow. Ongoing investigations into the dynamics of the plunging region, the origin of variability in the accretion process, and the evolution of warped, twisted, or eccentric disks are summarized.Comment: Mostly introductory review, to appear in "Supermassive black holes in the distant Universe", ed. A.J. Barger, Kluwer Academic Publishers, in pres

An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals

Serotonin has widespread, but computationally obscure, modulatory effects on learning and cognition. Here, we studied the impact of optogenetic stimulation of dorsal raphe serotonin neurons in mice performing a non-stationary, reward-driven decision-making task. Animals showed two distinct choice strategies. Choices after short inter-trial-intervals (ITIs) depended only on the last trial outcome and followed a win-stay-lose-switch pattern. In contrast, choices after long ITIs reflected outcome history over multiple trials, as described by reinforcement learning models. We found that optogenetic stimulation during a trial significantly boosted the rate of learning that occurred due to the outcome of that trial, but these effects were only exhibited on choices after long ITIs. This suggests that serotonin neurons modulate reinforcement learning rates, and that this influence is masked by alternate, unaffected, decision mechanisms. These results provide insight into the role of serotonin in treating psychiatric disorders, particularly its modulation of neural plasticity and learning.info:eu-repo/semantics/publishedVersio

First Impressions of HIV Risk: It Takes Only Milliseconds to Scan a Stranger

Research indicates that many people do not use condoms consistently but instead rely on intuition to identify sexual partners high at risk for HIV infection. The present studies examined neural correlates for first impressions of HIV risk and determined the association of perceived HIV risk with other trait characteristics. Participants were presented with 120 self-portraits retrieved from a popular online photo-sharing community (www.flickr.com). Factor analysis of various explicit ratings of trait characteristics yielded two orthogonal factors: (1) a ‘valence-approach’ factor encompassing perceived attractiveness, healthiness, valence, and approach tendencies, and (2) a ‘safeness’ factor, entailing judgments of HIV risk, trustworthiness, and responsibility. These findings suggest that HIV risk ratings systematically relate to cardinal features of a high-risk HIV stereotype. Furthermore, event-related brain potential recordings revealed neural correlates of first impressions about HIV risk. Target persons perceived as risky elicited a differential brain response in a time window from 220–340 ms and an increased late positive potential in a time window from 350–700 ms compared to those perceived as safe. These data suggest that impressions about HIV risk can be formed in a split second and despite a lack of information about the actual risk profile. Findings of neural correlates of risk impressions and their relationship to key features of the HIV risk stereotype are discussed in the context of the ‘risk as feelings’ theory

Non-Linear Population Firing Rates and Voltage Sensitive Dye Signals in Visual Areas 17 and 18 to Short Duration Stimuli

Visual stimuli of short duration seem to persist longer after the stimulus offset than stimuli of longer duration. This visual persistence must have a physiological explanation. In ferrets exposed to stimuli of different durations we measured the relative changes in the membrane potentials with a voltage sensitive dye and the action potentials of populations of neurons in the upper layers of areas 17 and 18. For durations less than 100 ms, the timing and amplitude of the firing and membrane potentials showed several non-linear effects. The ON response became truncated, the OFF response progressively reduced, and the timing of the OFF responses progressively delayed the shorter the stimulus duration. The offset of the stimulus elicited a sudden and strong negativity in the time derivative of the dye signal. All these non-linearities could be explained by the stimulus offset inducing a sudden inhibition in layers II–III as indicated by the strongly negative time derivative of the dye signal. Despite the non-linear behavior of the layer II–III neurons the sum of the action potentials, integrated from the peak of the ON response to the peak of the OFF response, was almost linearly related to the stimulus duration

Correlates of Cooperation in a One-Shot High-Stakes Televised Prisoners' Dilemma

Explaining cooperation between non-relatives is a puzzle for both evolutionary biology and the social sciences. In humans, cooperation is often studied in a laboratory setting using economic games such as the prisoners' dilemma. However, such experiments are sometimes criticized for being played for low stakes and by misrepresentative student samples. Golden balls is a televised game show that uses the prisoners' dilemma, with a diverse range of participants, often playing for very large stakes. We use this non-experimental dataset to investigate the factors that influence cooperation when “playing” for considerably larger stakes than found in economic experiments. The game show has earlier stages that allow for an analysis of lying and voting decisions. We found that contestants were sensitive to the stakes involved, cooperating less when the stakes were larger in both absolute and relative terms. We also found that older contestants were more likely to cooperate, that liars received less cooperative behavior, but only if they told a certain type of lie, and that physical contact was associated with reduced cooperation, whereas laughter and promises were reliable signals or cues of cooperation, but were not necessarily detected

Translating upwards: linking the neural and social sciences via neuroeconomics

The social and neural sciences share a common interest in understanding the mechanisms that underlie human behaviour. However, interactions between neuroscience and social science disciplines remain strikingly narrow and tenuous. We illustrate the scope and challenges for such interactions using the paradigmatic example of neuroeconomics. Using quantitative analyses of both its scientific literature and the social networks in its intellectual community, we show that neuroeconomics now reflects a true disciplinary integration, such that research topics and scientific communities with interdisciplinary span exert greater influence on the field. However, our analyses also reveal key structural and intellectual challenges in balancing the goals of neuroscience with those of the social sciences. To address these challenges, we offer a set of prescriptive recommendations for directing future research in neuroeconomics

Process account of curiosity and interest: a reward-learning perspective

Previous studies suggested roles for curiosity and interest in knowledge acquisition and exploration, but there has been a long-standing debate about how to define these concepts and whether they are related or different. In this paper, we address the definition issue by arguing that there is inherent difficulty in defining curiosity and interest, because both curiosity and interest are naïve concepts, which are not supposed to have a priori scientific definitions. We present a reward-learning framework of autonomous knowledge acquisition and use this framework to illustrate the importance of process account as an alternative to advance our understanding of curiosity and interest without being troubled by their definitions. The framework centers on the role of rewarding experience associated with knowledge acquisition and learning and posits that the acquisition of new knowledge strengthens the value of further information. Critically, we argue that curiosity and interest are the concepts that they subjectively construe through this knowledge-acquisition process. Finally, we discuss the implications of the reward-learning framework for education and empirical research in educational psychology

An Imperfect Dopaminergic Error Signal Can Drive Temporal-Difference Learning

An open problem in the field of computational neuroscience is how to link synaptic plasticity to system-level learning. A promising framework in this context is temporal-difference (TD) learning. Experimental evidence that supports the hypothesis that the mammalian brain performs temporal-difference learning includes the resemblance of the phasic activity of the midbrain dopaminergic neurons to the TD error and the discovery that cortico-striatal synaptic plasticity is modulated by dopamine. However, as the phasic dopaminergic signal does not reproduce all the properties of the theoretical TD error, it is unclear whether it is capable of driving behavior adaptation in complex tasks. Here, we present a spiking temporal-difference learning model based on the actor-critic architecture. The model dynamically generates a dopaminergic signal with realistic firing rates and exploits this signal to modulate the plasticity of synapses as a third factor. The predictions of our proposed plasticity dynamics are in good agreement with experimental results with respect to dopamine, pre- and post-synaptic activity. An analytical mapping from the parameters of our proposed plasticity dynamics to those of the classical discrete-time TD algorithm reveals that the biological constraints of the dopaminergic signal entail a modified TD algorithm with self-adapting learning parameters and an adapting offset. We show that the neuronal network is able to learn a task with sparse positive rewards as fast as the corresponding classical discrete-time TD algorithm. However, the performance of the neuronal network is impaired with respect to the traditional algorithm on a task with both positive and negative rewards and breaks down entirely on a task with purely negative rewards. Our model demonstrates that the asymmetry of a realistic dopaminergic signal enables TD learning when learning is driven by positive rewards but not when driven by negative rewards

Recurrent, Robust and Scalable Patterns Underlie Human Approach and Avoidance

BACKGROUND. Approach and avoidance behavior provide a means for assessing the rewarding or aversive value of stimuli, and can be quantified by a keypress procedure whereby subjects work to increase (approach), decrease (avoid), or do nothing about time of exposure to a rewarding/aversive stimulus. To investigate whether approach/avoidance behavior might be governed by quantitative principles that meet engineering criteria for lawfulness and that encode known features of reward/aversion function, we evaluated whether keypress responses toward pictures with potential motivational value produced any regular patterns, such as a trade-off between approach and avoidance, or recurrent lawful patterns as observed with prospect theory. METHODOLOGY/PRINCIPAL FINDINGS. Three sets of experiments employed this task with beautiful face images, a standardized set of affective photographs, and pictures of food during controlled states of hunger and satiety. An iterative modeling approach to data identified multiple law-like patterns, based on variables grounded in the individual. These patterns were consistent across stimulus types, robust to noise, describable by a simple power law, and scalable between individuals and groups. Patterns included: (i) a preference trade-off counterbalancing approach and avoidance, (ii) a value function linking preference intensity to uncertainty about preference, and (iii) a saturation function linking preference intensity to its standard deviation, thereby setting limits to both. CONCLUSIONS/SIGNIFICANCE. These law-like patterns were compatible with critical features of prospect theory, the matching law, and alliesthesia. Furthermore, they appeared consistent with both mean-variance and expected utility approaches to the assessment of risk. Ordering of responses across categories of stimuli demonstrated three properties thought to be relevant for preference-based choice, suggesting these patterns might be grouped together as a relative preference theory. Since variables in these patterns have been associated with reward circuitry structure and function, they may provide a method for quantitative phenotyping of normative and pathological function (e.g., psychiatric illness).National Institute on Drug Abuse (14118, 026002, 026104, DABK39-03-0098, DABK39-03-C-0098); The MGH Phenotype Genotype Project in Addiction and Mood Disorder from the Office of National Drug Control Policy - Counterdrug Technology Assessment Center; MGH Department of Radiology; the National Center for Research Resources (P41RR14075); National Institute of Neurological Disorders and Stroke (34189, 05236