114 research outputs found

    STEVE-1: A Generative Model for Text-to-Behavior in Minecraft

    Full text link
    Constructing AI models that respond to text instructions is challenging, especially for sequential decision-making tasks. This work introduces an instruction-tuned Video Pretraining (VPT) model for Minecraft called STEVE-1, demonstrating that the unCLIP approach, utilized in DALL-E 2, is also effective for creating instruction-following sequential decision-making agents. STEVE-1 is trained in two steps: adapting the pretrained VPT model to follow commands in MineCLIP's latent space, then training a prior to predict latent codes from text. This allows us to finetune VPT through self-supervised behavioral cloning and hindsight relabeling, bypassing the need for costly human text annotations. By leveraging pretrained models like VPT and MineCLIP and employing best practices from text-conditioned image generation, STEVE-1 costs just $60 to train and can follow a wide range of short-horizon open-ended text and visual instructions in Minecraft. STEVE-1 sets a new bar for open-ended instruction following in Minecraft with low-level controls (mouse and keyboard) and raw pixel inputs, far outperforming previous baselines. We provide experimental evidence highlighting key factors for downstream performance, including pretraining, classifier-free guidance, and data scaling. All resources, including our model weights, training scripts, and evaluation tools are made available for further research

    The Neurokinin 1 Receptor Antagonist, Ezlopitant, Reduces Appetitive Responding for Sucrose and Ethanol

    Get PDF
    Abstract Background: The current obesity epidemic is thought to be partly driven by over-consumption of sugar-sweetened diets and soft drinks. Loss-of-control over eating and addiction to drugs of abuse share overlapping brain mechanisms including changes in motivational drive, such that stimuli that are often no longer ‘liked’ are still intensely ‘wanted’ [7,8]. The neurokinin 1 (NK1) receptor system has been implicated in both learned appetitive behaviors and addiction to alcohol and opioids; however, its role in natural reward seeking remains unknown. Methodology/Principal Findings: We sought to determine whether the NK1-receptor system plays a role in the reinforcing properties of sucrose using a novel selective and clinically safe NK1-receptor antagonist, ezlopitant (CJ-11,974), in three animal models of sucrose consumption and seeking. Furthermore, we compared the effect of ezlopitant on ethanol consumption and seeking in rodents. The NK1-receptor antagonist, ezlopitant decreased appetitive responding for sucrose more potently than for ethanol using an operant self-administration protocol without affecting general locomotor activity. To further evaluate the selectivity of the NK1-receptor antagonist in decreasing consumption of sweetened solutions, we compared the effects of ezlopitant on water, saccharin-, and sodium chloride (NaCl) solution consumption. Ezlopitant decreased intake of saccharin but had no effect on water or salty solution consumption. Conclusions/Significance: The present study indicates that the NK1-receptor may be a part of a common pathway regulating the self-administration, motivational and reinforcing aspects of sweetened solutions, regardless of caloric value, and those of substances of abuse. Additionally, these results indicate that the NK1-receptor system may serve as a therapeutic target for obesity induced by over-consumption of natural reinforcers

    On improvement in ejection fraction with iron chelation in thalassemia major and the risk of future heart failure

    Get PDF
    <p>Abstract</p> <p>Background</p> <p>Trials of iron chelator regimens have increased the treatment options for cardiac siderosis in beta-thalassemia major (TM) patients. Treatment effects with improved left ventricular (LV) ejection fraction (EF) have been observed in patients without overt heart failure, but it is unclear whether these changes are clinically meaningful.</p> <p>Methods</p> <p>This retrospective study of a UK database of TM patients modelled the change in EF between serial scans measured by cardiovascular magnetic resonance (CMR) to the relative risk (RR) of future development of heart failure over 1 year. Patients were divided into 2 strata by baseline LVEF of 56-62% (below normal for TM) and 63-70% (lower half of the normal range for TM).</p> <p>Results</p> <p>A total of 315 patients with 754 CMR scans were analyzed. A 1% absolute increase in EF from baseline was associated with a statistically significant reduction in the risk of future development of heart failure for both the lower EF stratum (EF 56-62%, RR 0.818, p < 0.001) and the higher EF stratum (EF 63-70%, RR 0.893 p = 0.001).</p> <p>Conclusion</p> <p>These data show that during treatment with iron chelators for cardiac siderosis, small increases in LVEF in TM patients are associated with a significantly reduced risk of the development of heart failure. Thus the iron chelator induced improvements in LVEF of 2.6% to 3.1% that have been observed in randomized controlled trials, are associated with risk reductions of 25.5% to 46.4% for the development of heart failure over 12 months, which is clinically meaningful. In cardiac iron overload, heart mitochondrial dysfunction and its relief by iron chelation may underlie the changes in LV function.</p

    Cocaine Is Low on the Value Ladder of Rats: Possible Evidence for Resilience to Addiction

    Get PDF
    International audienceBACKGROUND:Assessing the relative value of cocaine and how it changes with chronic drug use represents a long-standing goal in addiction research. Surprisingly, recent experiments in rats--by far the most frequently used animal model in this field--suggest that the value of cocaine is lower than previously thought.METHODOLOGY/PRINCIPAL FINDINGS:Here we report a series of choice experiments that better define the relative position of cocaine on the value ladder of rats (i.e., preference rank-ordering of different rewards). Rats were allowed to choose either taking cocaine or drinking water sweetened with saccharin--a nondrug alternative that is not biologically essential. By systematically varying the cost and concentration of sweet water, we found that cocaine is low on the value ladder of the large majority of rats, near the lowest concentrations of sweet water. In addition, a retrospective analysis of all experiments over the past 5 years revealed that no matter how heavy was past cocaine use most rats readily give up cocaine use in favor of the nondrug alternative. Only a minority, fewer than 15% at the heaviest level of past cocaine use, continued to take cocaine, even when hungry and offered a natural sugar that could relieve their need of calories.CONCLUSIONS/SIGNIFICANCE:This pattern of results (cocaine abstinence in most rats; cocaine preference in few rats) maps well onto the epidemiology of human cocaine addiction and suggests that only a minority of rats would be vulnerable to cocaine addiction while the large majority would be resilient despite extensive drug use. Resilience to drug addiction has long been suspected in humans but could not be firmly established, mostly because it is difficult to control retrospectively for differences in drug self-exposure and/or availability in human drug users. This conclusion has important implications for preclinical research on the neurobiology of cocaine addiction and for future medication development

    Effects of traumatic brain injury and posttraumatic stress disorder on Alzheimer's disease in veterans, using the Alzheimer's Disease Neuroimaging Initiative

    Get PDF
    Both traumatic brain injury (TBI) and posttraumatic stress disorder (PTSD) are common problems resulting from military service, and both have been associated with increased risk of cognitive decline and dementia resulting from Alzheimer's disease (AD) or other causes. This study aims to use imaging techniques and biomarker analysis to determine whether traumatic brain injury (TBI) and/or PTSD resulting from combat or other traumas increase the risk for AD and decrease cognitive reserve in Veteran subjects, after accounting for age. Using military and Department of Veterans Affairs records, 65 Vietnam War veterans with a history of moderate or severe TBI with or without PTSD, 65 with ongoing PTSD without TBI, and 65 control subjects are being enrolled in this study at 19 sites. The study aims to select subject groups that are comparable in age, gender, ethnicity, and education. Subjects with mild cognitive impairment (MCI) or dementia are being excluded. However, a new study just beginning, and similar in size, will study subjects with TBI, subjects with PTSD, and control subjects with MCI. Baseline measurements of cognition, function, blood, and cerebrospinal fluid biomarkers; magnetic resonance images (structural, diffusion tensor, and resting state blood-level oxygen dependent (BOLD) functional magnetic resonance imaging); and amyloid positron emission tomographic (PET) images with florbetapir are being obtained. One-year follow-up measurements will be collected for most of the baseline procedures, with the exception of the lumbar puncture, the PET imaging, and apolipoprotein E genotyping. To date, 19 subjects with TBI only, 46 with PTSD only, and 15 with TBI and PTSD have been recruited and referred to 13 clinics to undergo the study protocol. It is expected that cohorts will be fully recruited by October 2014. This study is a first step toward the design and statistical powering of an AD prevention trial using at-risk veterans as subjects, and provides the basis for a larger, more comprehensive study of dementia risk factors in veterans

    Severe traumatic injury during long duration spaceflight: Light years beyond ATLS

    Get PDF
    Traumatic injury strikes unexpectedly among the healthiest members of the human population, and has been an inevitable companion of exploration throughout history. In space flight beyond the Earth's orbit, NASA considers trauma to be the highest level of concern regarding the probable incidence versus impact on mission and health. Because of limited resources, medical care will have to focus on the conditions most likely to occur, as well as those with the most significant impact on the crew and mission. Although the relative risk of disabling injuries is significantly higher than traumatic deaths on earth, either issue would have catastrophic implications during space flight. As a result this review focuses on serious life-threatening injuries during space flight as determined by a NASA consensus conference attended by experts in all aspects of injury and space flight

    Neuroinflammation and psychiatric illness

    Get PDF
    corecore