Bandit Models of Human Behavior: Reward Processing in Mental Disorders

Drawing an inspiration from behavioral studies of human decision making, we propose here a general parametric framework for multi-armed bandit problem, which extends the standard Thompson Sampling approach to incorporate reward processing biases associated with several neurological and psychiatric conditions, including Parkinson's and Alzheimer's diseases, attention-deficit/hyperactivity disorder (ADHD), addiction, and chronic pain. We demonstrate empirically that the proposed parametric approach can often outperform the baseline Thompson Sampling on a variety of datasets. Moreover, from the behavioral modeling perspective, our parametric framework can be viewed as a first step towards a unifying computational model capturing reward processing abnormalities across multiple mental conditions.Comment: Conference on Artificial General Intelligence, AGI-1

Normal Form and Nekhoroshev stability for nearly-integrable Hamiltonian systems with unconditionally slow aperiodic time dependence

The aim of this paper is to extend the results of Giorgilli and Zehnder for aperiodic time dependent systems to a case of general nearly-integrable convex analytic Hamiltonians. The existence of a normal form and then a stability result are shown in the case of a slow aperiodic time dependence that, under some smallness conditions, is independent on the size of the perturbation.Comment: Corrected typo in the title and statement of Lemma 3.

Light-Cone Quantization and Hadron Structure

In this talk, I review the use of the light-cone Fock expansion as a tractable and consistent description of relativistic many-body systems and bound states in quantum field theory and as a frame-independent representation of the physics of the QCD parton model. Nonperturbative methods for computing the spectrum and LC wavefunctions are briefly discussed. The light-cone Fock state representation of hadrons also describes quantum fluctuations containing intrinsic gluons, strangeness, and charm, and, in the case of nuclei, "hidden color". Fock state components of hadrons with small transverse size, such as those which dominate hard exclusive reactions, have small color dipole moments and thus diminished hadronic interactions; i.e., "color transparency". The use of light-cone Fock methods to compute loop amplitudes is illustrated by the example of the electron anomalous moment in QED. In other applications, such as the computation of the axial, magnetic, and quadrupole moments of light nuclei, the QCD relativistic Fock state description provides new insights which go well beyond the usual assumptions of traditional hadronic and nuclear physics.Comment: LaTex 36 pages, 3 figures. To obtain a copy, send e-mail to [email protected]

Stemming the tide: progress towards resolving the causes of decline and implementing management responses for the disappearing mammal fauna of northern Australia

Introduction: Recent studies at sites in northern Australia have reported severe and rapid decline of several native mammal species, notwithstanding an environmental context (small human population size, limited habitat loss, substantial reservation extent) that should provide relative conservation security. All of the more speciose taxonomic groups of mammals in northern Australia have some species for which their conservation status has been assessed as threatened, with 53 % of dasyurid, 47 % of macropod and potoroid, 33 % of bandicoot and bilby, 33 % of possum, 30 % of rodent, and 24 % of bat species being assessed as extinct, threatened or near threatened. However, the geographical extent and timing of declines, and their causes, remain poorly resolved, limiting the application of remedial management actions.\ud \ud Material and methods: Focusing on the tropical savannas of northern Australia, this paper reviews disparate recent and ongoing studies that provide information on population trends across a broader geographic scope than the previously reported sites, and examines the conservation status and trends for mammal groups (bats, macropods) not well sampled in previous monitoring studies. It describes some diverse approaches of studies seeking to document conservation status and trends, and of the factors that may be contributing to observed patterns of decline.\ud \ud Results and Discussion: Current trends and potential causal factors for declines. The studies reported demonstrate that the extent and timing of impacts and threats have been variable across the region, although there is a general gradational pattern of earlier and more severe decline from inland lower rainfall areas to higher rainfall coastal regions. Some small isolated areas appear to have retained their mammal species, as have many islands which remain critical refuges. There is now some compelling evidence that predation by feral cats is implicated in the observed decline, with those impacts likely to be exacerbated by prevailing fire regimes (frequent, extensive and intense fire), by reduction in ground vegetation cover due to livestock and, in some areas, by 'control' of dingoes. However the impacts of dingoes may be complex, and are not yet well resolved in this area. The relative impacts of these individual factors vary spatially (with most severe impacts in higher rainfall and more rugged areas) and between different mammal species, with some species responding idiosyncratically: the most notable example is the rapid decline of the northern quoll (Dasyurus hallucatus) due to poisoning by the introduced cane toad (Rhinella marina), which continues to spread extensively across northern Australia. The impact of disease, if any, remains unresolved.\ud \ud Conservation Management Responses. Recovery of the native mammal fauna may be impossible in some areas. However, there are now examples of rapid recovery following threat management. Priority conservation actions include: enhanced biosecurity for important islands, establishment of a network of feral predator exclosures, intensive fire management (aimed at increasing the extent of longer-unburnt habitat and in delivering fine scale patch burning), reduction in feral stock in conservation reserves, and acquisition for conservation purposes of some pastoral lands in areas that are significant for mammal conservation

Impaired decisional impulsivity in pathological videogamers

Abstract Background Pathological gaming is an emerging and poorly understood problem. Impulsivity is commonly impaired in disorders of behavioural and substance addiction, hence we sought to systematically investigate the different subtypes of decisional and motor impulsivity in a well-defined pathological gaming cohort. Methods Fifty-two pathological gaming subjects and age-, gender- and IQ-matched healthy volunteers were tested on decisional impulsivity (Information Sampling Task testing reflection impulsivity and delay discounting questionnaire testing impulsive choice), and motor impulsivity (Stop Signal Task testing motor response inhibition, and the premature responding task). We used stringent diagnostic criteria highlighting functional impairment. Results In the Information Sampling Task, pathological gaming participants sampled less evidence prior to making a decision and scored fewer points compared with healthy volunteers. Gaming severity was also negatively correlated with evidence gathered and positively correlated with sampling error and points acquired. In the delay discounting task, pathological gamers made more impulsive choices, preferring smaller immediate over larger delayed rewards. Pathological gamers made more premature responses related to comorbid nicotine use. Greater number of hours played also correlated with a Motivational Index. Greater frequency of role playing games was associated with impaired motor response inhibition and strategy games with faster Go reaction time. Conclusions We show that pathological gaming is associated with impaired decisional impulsivity with negative consequences in task performance. Decisional impulsivity may be a potential target in therapeutic management

WNT signalling in prostate cancer

Genome sequencing and gene expression analyses of prostate tumours have highlighted the potential importance of genetic and epigenetic changes observed in WNT signalling pathway components in prostate tumours-particularly in the development of castration-resistant prostate cancer. WNT signalling is also important in the prostate tumour microenvironment, in which WNT proteins secreted by the tumour stroma promote resistance to therapy, and in prostate cancer stem or progenitor cells, in which WNT-β-catenin signals promote self-renewal or expansion. Preclinical studies have demonstrated the potential of inhibitors that target WNT receptor complexes at the cell membrane or that block the interaction of β-catenin with lymphoid enhancer-binding factor 1 and the androgen receptor, in preventing prostate cancer progression. Some WNT signalling inhibitors are in phase I trials, but they have yet to be tested in patients with prostate cancer

Mating dynamics in a nematode with three sexes and its evolutionary implications

Nematodes have diverse reproductive strategies, which make them ideal subjects for comparative studies to address how mating systems evolve. Here we present the sex ratios and mating dynamics of the free-living nematode Rhabditis sp. SB347, in which males, females and hermaphrodites co-exist. The three sexes are produced by both selfing and outcrossing, and females tend to appear early in a mother’s progeny. Males prefer mating with females over hermaphrodites, which our results suggest is related to the female-specific production of the sex pheromones ascr#1 and ascr#9. We discuss the parallels between this system and that of parasitic nematodes that exhibit alternation between uniparental and biparental reproduction

Cost-effective scat-detection dogs: unleashing a powerful new tool for international mammalian conservation biology

Recently, detection dogs have been utilized to collect fecal samples from cryptic and rare mammals. Despite the great promise of this technique for conservation biology, its broader application has been limited by the high cost (tens to hundreds of thousands of dollars) and logistical challenges of employing a scat-detection dog team while conducting international, collaborative research. Through an international collaboration of primatologists and the Chinese Ministry of Public Security, we trained and used a detection dog to find scat from three species of unhabituated, free-ranging primates, for less than $3,000. We collected 137 non-human primate fecal samples that we confirmed by sequencing taxonomically informative genetic markers. Our detection dog team had a 92% accuracy rate, significantly outperforming our human-only team. Our results demonstrate that detection dogs can locate fecal samples from unhabituated primates with variable diets, locomotion, and grouping patterns, despite challenging field conditions. We provide a model for in-country training, while also building local capacity for conservation and genetic monitoring. Unlike previous efforts, our approach will allow for the wide adoption of scat-detection dogs in international conservation biology

Host-guest and guest-guest interactions between xylene isomers confined in the MIL-47(V) pore system

The porous MIL-47 material shows a selective adsorption behavior for para-, ortho-, and meta-isomers of xylenes, making the material a serious candidate for separation applications. The origin of the selectivity lies in the differences in interactions (energetic) and confining (entropic). This paper investigates the xylene-framework interactions and the xylene-xylene interactions with quantum mechanical calculations, using a dispersion-corrected density functional and periodic boundary conditions to describe the crystal. First, the strength and geometrical characteristics of the optimal xylene-xylene interactions are quantified by studying the pure and mixed pairs in gas phase. An extended set of initial structures is created and optimized to sample as many relative orientations and distances as possible. Next, the pairs are brought in the pores of MIL-47. The interaction with the terephthalic linkers and other xylenes increases the stacking energy in gas phase (-31.7 kJ/mol per pair) by roughly a factor four in the fully loaded state (-58.3 kJ/mol per xylene). Our decomposition of the adsorption energy shows various trends in the contributing xylene-xylene interactions. The absence of a significant difference in energetics between the isomers indicates that entropic effects must be mainly responsible for the separation behavior