Sequence classification with human attention

Learning attention functions requires large volumes of data, but many NLP tasks simulate human behavior, and in this paper, we show that human attention really does provide a good inductive bias on many attention functions in NLP. Specifically, we use estimated human attention derived from eye-tracking corpora to regularize attention functions in recurrent neural networks. We show substantial improvements across a range of tasks, including sentiment analysis, grammatical error detection, and detection of abusive language

Exchange and correlation near the nucleus in density functional theory

The near nucleus behavior of the exchange-correlation potential $v_{xc}({\bf r})$ in Hohenberg-Kohn-Sham density functional theory is investigated. It is shown that near the nucleus the linear term of $O(r)$ of the spherically averaged exchange-correlation potential ${\bar v}_{xc}(r)$ is nonzero, and that it arises purely from the difference between the kinetic energy density at the nucleus of the interacting system and the noninteracting Kohn-Sham system. An analytical expression for the linear term is derived. Similar results for the exchange $v_{x}({\bf r})$ and correlation $v_{c}({\bf r})$ potentials are also obtained separately. It is further pointed out that the linear term in $v_{xc}({\bf r})$ arising mainly from $v_{c}({\bf r})$ is rather small, and $v_{xc}({\bf r})$ therefore has a nearly quadratic structure near the nucleus. Implications of the results for the construction of the Kohn-Sham system are discussed with examples.Comment: 10 page

Large Angle Transient Dynamics (LATDYN) user's manual

A computer code for modeling the large angle transient dynamics (LATDYN) of structures was developed to investigate techniques for analyzing flexible deformation and control/structure interaction problems associated with large angular motions of spacecraft. This type of analysis is beyond the routine capability of conventional analytical tools without simplifying assumptions. In some instances, the motion may be sufficiently slow and the spacecraft (or component) sufficiently rigid to simplify analyses of dynamics and controls by making pseudo-static and/or rigid body assumptions. The LATDYN introduces a new approach to the problem by combining finite element structural analysis, multi-body dynamics, and control system analysis in a single tool. It includes a type of finite element that can deform and rotate through large angles at the same time, and which can be connected to other finite elements either rigidly or through mechanical joints. The LATDYN also provides symbolic capabilities for modeling control systems which are interfaced directly with the finite element structural model. Thus, the nonlinear equations representing the structural model are integrated along with the equations representing sensors, processing, and controls as a coupled system

Rethinking psychopharmacotherapy: The role of treatment context and brain plasticity in antidepressant and antipsychotic interventions

AbstractEmerging evidence indicates that treatment context profoundly affects psychopharmacological interventions. We review the evidence for the interaction between drug application and the context in which the drug is given both in human and animal research. We found evidence for this interaction in the placebo response in clinical trials, in our evolving knowledge of pharmacological and environmental effects on neural plasticity, and in animal studies analyzing environmental influences on psychotropic drug effects. Experimental placebo research has revealed neurobiological trajectories of mechanisms such as patients’ treatment expectations and prior treatment experiences. Animal research confirmed that “enriched environments” support positive drug effects, while unfavorable environments (low sensory stimulation, low rates of social contacts) can even reverse the intended treatment outcome. Finally we provide recommendations for context conditions under which psychotropic drugs should be applied. Drug action should be steered by positive expectations, physical activity, and helpful social and physical environmental stimulation. Future drug trials should focus on fully controlling and optimizing such drug×environment interactions to improve trial sensitivity and treatment outcome

Pain-specific modulation of hippocampal activity and functional connectivity during visual encoding

Acute and chronic pain automatically attract attention and thus interfere with cognitive functioning. Impaired memory is a prominent complaint of patients with chronic pain that substantially contributes to pain-related disability. In this fMRI study, we investigated the specific influence of pain on neural processes of memory encoding in healthy human volunteers using a visual task. To investigate the specificity of the interruptive effect of pain on the encoding of visual objects, objects were presented (1) alone, (2) with painful heat stimuli, or (3) with auditory stimuli that were matched for unpleasantness to the heat stimuli. The interruptive effect of concomitant aversive stimulation on behavioral measures and neural processing was assessed in a categorization task during encoding and in a subsequent recognition task. Pain interfered with object processing and encoding of visual stimuli. On the behavioral level, this resulted in slower reaction times during the categorization task for pain compared with auditory stimuli and in a lower recognition rate in the pain condition but not in the tone condition. Pain catastrophizing amplified this interruptive effect of pain. On the neural level, this pain-related disruption of encoding was associated with reduced activity in the right anterior hippocampus during encoding. Moreover, the hippocampus exhibited reduced functional connectivity with extrastriate regions during painful stimulation relative to auditory stimulation. In summary, our results show a pain-related disruption of visual encoding over and above the unpleasantness of a stimulus, suggesting a pain-specific interruptive mechanism that interferes with an early stage of memory formation.</jats:p

Constraint-based, Single-point Approximate Kinetic Energy Functionals

We present a substantial extension of our constraint-based approach for development of orbital-free (OF) kinetic-energy (KE) density functionals intended for the calculation of quantum-mechanical forces in multi-scale molecular dynamics simulations. Suitability for realistic system simulations requires that the OF-KE functional yield accurate forces on the nuclei yet be relatively simple. We therefore require that the functionals be based on DFT constraints, local, dependent upon a small number of parameters fitted to a training set of limited size, and applicable beyond the scope of the training set. Our previous "modified conjoint" generalized-gradient-type functionals were constrained to producing a positive-definite Pauli potential. Though distinctly better than several published GGA-type functionals in that they gave semi-quantitative agreement with Born-Oppenheimer forces from full Kohn-Sham results, those modified conjoint functionals suffer from unphysical singularities at the nuclei. Here we show how to remove such singularities by introducing higher-order density derivatives. We give a simple illustration of such a functional used for the dissociation energy as a function of bond length for selected molecules.Comment: 16 pages, 9 figures, 2 tables, submitted to Phys. Rev.

An optimized imaging protocol for [99mTc]Tc-DPD scintigraphy and SPECT/CT quantification in cardiac transthyretin (ATTR) amyloidosis

Background: In [(99)mTc]Tc-DPD scintigraphy for myocardial ATTR amyloidosis, planar images 3 hour p.i. and SPECT/CT acquisition in L-mode are recommended. This study investigated if earlier planar images (1 hour p.i.) are beneficial and if SPECT/CT acquisition should be preferred in H-mode (180 degrees detector angle) or L-mode (90 degrees). Methods: In SPECT/CT phantom measurements (NaI cameras, N = 2; CZT, N = 1), peak contrast recovery (CRpeak) was derived from sphere inserts or myocardial insert (cardiac phantom; signal-to-background ratio [SBR], 10:1 or 5:1). In 25 positive and 38 negative patients reference: endomyocardial biopsy or clinical diagnosis), Perugini scores and heart-to-contralateral (H/CL) count ratios were derived from planar images 1 hour and 3 hour p.i. Results: In phantom measurements, accuracy of myocardial CRpeak at SBR 10:1 (H-mode, 0.95-0.99) and reproducibility at 5:1 (H-mode, 1.02-1.14) was comparable for H-mode and L-mode. However, L-mode showed higher variability of background counts and sphere CRpeak throughout the field of view than H-mode. In patients, sensitivity/specificity were >= 95% for H/CL ratios at both time points and visual scoring 3 hour. At 1 hour, visual scores showed specificity of 89% and reduced reader's confidence. Conclusions: Early DPD images provided no additional value for visual scoring or H/CL ratios. In SPECT/CT, H-mode is preferred over L-mode, especially if quantification is applied apart from the myocardium

The Effect of Opioid Receptor Blockade on the Neural Processing of Thermal Stimuli

The endogenous opioid system represents one of the principal systems in the modulation of pain. This has been demonstrated in studies of placebo analgesia and stress-induced analgesia, where anti-nociceptive activity triggered by pain itself or by cognitive states is blocked by opioid antagonists. The aim of this study was to characterize the effect of opioid receptor blockade on the physiological processing of painful thermal stimulation in the absence of cognitive manipulation. We therefore measured BOLD (blood oxygen level dependent) signal responses and intensity ratings to non-painful and painful thermal stimuli in a double-blind, cross-over design using the opioid receptor antagonist naloxone. On the behavioral level, we observed an increase in intensity ratings under naloxone due mainly to a difference in the non-painful stimuli. On the neural level, painful thermal stimulation was associated with a negative BOLD signal within the pregenual anterior cingulate cortex, and this deactivation was abolished by naloxone

Meta-analysis of neural systems underlying placebo analgesia from individual participant fMRI data

The brain systems underlying placebo analgesia are insufficiently understood. Here we performed a systematic, participant-level meta-analysis of experimental functional neuroimaging studies of evoked pain under stimulus-intensity-matched placebo and control conditions, encompassing 603 healthy participants from 20 (out of 28 eligible) studies. We find that placebo vs. control treatments induce small, widespread reductions in pain-related activity, particularly in regions belonging to ventral attention (including mid-insula) and somatomotor networks (including posterior insula). Behavioral placebo analgesia correlates with reduced pain-related activity in these networks and the thalamus, habenula, mid-cingulate, and supplementary motor area. Placebo-associated activity increases occur mainly in frontoparietal regions, with high between-study heterogeneity. We conclude that placebo treatments affect pain-related activity in multiple brain areas, which may reflect changes in nociception and/or other affective and decision-making processes surrounding pain. Between-study heterogeneity suggests that placebo analgesia is a multi-faceted phenomenon involving multiple cerebral mechanisms that differ across studies