Characterization of Neural Network Backpropagation on Chiplet-based GPU Architectures

Advances in parallel computing architectures (e.g., Graphics Processing Units (GPUs)) have had great success in helping meet the performance and energy-efficiency demands of many high-performance computing (HPC) applications. DRAM bandwidth is generally a critical performance bottleneck for many of such applications. With the advances in memory technology, the DRAM bandwidth bottleneck is shifting towards other parts of the system hierarchy (e.g., interconnects). We identify neural network backpropagation as one application where the interconnect network is one of the biggest performance bottlenecks. We show that the interconnect bottleneck for backpropagation can be significantly alleviated if computing cores and caching units are carefully tiled (an architecture commonly known as ``chiplet ) and organized on the interconnect fabric. To simulate a chiplet design, we augment an existing, well-documented GPU simulator, GPGPU-Sim. Our modifications add an additional level of cache between on-chip L1s and an interconnect network-on-chip. This additional layer of cache reduces demand on the interconnect by localizing memory traffic to individual chiplets. We show that under a fixed core budget with additional cache, a chiplet architecture can increase Instruction Per Cycle (IPC) counts for important CUDA kernels by up to 20% during the training phase

A Method for Psychosocial Stress-Induced Reinstatement of Cocaine Seeking in Rats

We describe a novel preclinical model of stress-induced relapse to cocaine use in rats using social defeat stress, an ethologically valid psychosocial stressor in rodents that closely resembles stressors that promote craving and relapse in humans. Rats self-administered cocaine for 20 days. On days 11, 14, 17, and 20, animals were subjected to social defeat stress or a nonstressful control condition following the session, with discrete environmental stimuli signaling the impending event. After extinction training, reinstatement was assessed following re-exposure to these discrete cues. Animals re-exposed to psychosocial stress-predictive cues exhibited increased serum corticosterone and significantly greater reinstatement of cocaine seeking than the control group, and active coping behaviors during social defeat episodes were associated with subsequent reinstatement magnitude. These studies are the first to describe an operant model of psychosocial stress-induced relapse in rodents and lay the foundation for future work investigating its neurobiological underpinnings

The DREADD Agonist Clozapine N -oxide (CNO) is Reverse-Metabolized to Clozapine and Produces Clozapine-Like Interoceptive Stimulus Effects in Rats and Mice

Clozapine-N-oxide (CNO) has long been the ligand of choice for selectively activating Designer Receptors Exclusively Activated by Designer Drugs (DREADDs). However, recent studies have challenged the long-held assertion that CNO is otherwise pharmacologically inert. The present study aimed to 1) determine whether CNO is reverse-metabolized to its parent compound clozapine in mice (as has recently been reported in rats), and 2) determine whether CNO exerts clozapine-like interoceptive stimulus effects in rats and/or mice. Following administration of 10.0 mg/kg CNO, pharmacokinetic analyses replicated recent reports of back-conversion to clozapine in rats and revealed that this phenomenon also occurs in mice. In rats and mice trained to discriminate 1.25 mg/kg clozapine from vehicle, CNO (1.0-20.0 mg/kg) produced partial substitution for the clozapine stimulus on average, with full substitution being detected in some individual animals of both species at doses frequently used to activate DREADDs. The present demonstration that CNO is converted to clozapine and exerts clozapine-like behavioral effects in both mice and rats further emphasizes the need for appropriate control groups in studies employing DREADDs, and highlights the utility of the drug discrimination procedure as a tool with which to screen the off-target effects of novel DREADD agonists

Analysis of brain adrenergic receptors in dopamine-β-hydroxylase knockout mice

The biosynthesis of norepinephrine occurs through a multi-enzymatic pathway that includes the enzyme dopamine-β-hydroxylase (DBH). Mice with a homozygous deletion of DBH (Dbh−/−) have a selective and complete absence of norepinephrine. The purpose of this study was to assess the expression of alpha-1, alpha-2 and beta adrenergic receptors (α1-AR, α2-AR and β-AR) in the postnatal absence of norepinephrine by comparing noradrenergic receptors in Dbh−/− mice with those in Dbh heterozygotes (Dbh+/−), which have normal levels of norepinephrine throughout life. The densities of α1-AR, α2-AR and β-AR were assayed with [3H]prazosin, [3H]RX21002 and [125I]-iodo-pindolol autoradiography, respectively. The α2-AR agonist high affinity state was examined with [125I]-paraiodoclonidine autoradiography and α2-AR functionality by α2-AR agonist-stimulated [35S] GTPγS autoradiography. The density of α1-AR in Dbh−/− mice was similar to Dbh+/− mice in most brain regions, with an up-regulation in the hippocampus. Modest decreases in α2-AR were found in septum, hippocampus and amygdala, but these were not reflected in α2-AR functionality. The density of β-AR was up-regulated to varying degrees in many brain regions of Dbh−/− mice compared to the heterozygotes. These findings indicate that regulation of noradrenergic receptors by endogenous norepinephrine depends on receptor type and neuroanatomical region

PRTFDC1 Is a Genetic Modifier of HPRT-Deficiency in the Mouse

Lesch-Nyhan disease (LND) is a severe X-linked neurological disorder caused by a deficiency of hypoxanthine phosphoribosyltransferase (HPRT). In contrast, HPRT-deficiency in the mouse does not result in the profound phenotypes such as self-injurious behavior observed in humans, and the genetic basis for this phenotypic disparity between HPRT-deficient humans and mice is unknown. To test the hypothesis that HPRT deficiency is modified by the presence/absence of phosphoribosyltransferase domain containing 1 (PRTFDC1), a paralog of HPRT that is a functional gene in humans but an inactivated pseudogene in mice, we created transgenic mice that express human PRTFDC1 in wild-type and HPRT-deficient backgrounds. Male mice expressing PRTFDC1 on either genetic background were viable and fertile. However, the presence of PRTFDC1 in the HPRT-deficient, but not wild-type mice, increased aggression as well as sensitivity to a specific amphetamine-induced stereotypy, both of which are reminiscent of the increased aggressive and self-injurious behavior exhibited by patients with LND. These results demonstrate that PRTFDC1 is a genetic modifier of HPRT-deficiency in the mouse and could therefore have important implications for unraveling the molecular etiology of LND

Genetic or pharmacological blockade of noradrenaline synthesis enhances the neurochemical, behavioral, and neurotoxic effects of methamphetamine

N-(2-chloroethyl)-N-ethyl-2-bromobenzylamine (DSP-4) lesions of the locus coeruleus, the major brain noradrenergic nucleus, exacerbate the damage to nigrostriatal dopamine (DA) terminals caused by the psychostimulant methamphetamine (METH). However, because noradrenergic terminals contain other neuromodulators and the noradrenaline (NA) transporter, which may act as a neuroprotective buffer, it was unclear whether this enhancement of METH neurotoxicity was caused by the loss of noradrenergic innervation or the loss of NA itself. We addressed the specific role of NA by comparing the effects of METH in mice with noradrenergic lesions (DSP-4) and those with intact noradrenergic terminals but specifically lacking NA (genetic or acute pharmacological blockade of the NA biosynthetic enzyme dopamine beta-hydroxylase; DBH). We found that genetic deletion of DBH (DBH-/- mice) and acute treatment of wild-type mice with a DBH inhibitor (fusaric acid) recapitulated the effects of DSP-4 lesions on METH responses. All three methods of NA depletion enhanced striatal DA release, extracellular oxidative stress (as measured by in vivo microdialysis of DA and 2,3-dihydroxybenzoic acid), and behavioral stereotypies following repeated METH administration. These effects accompanied a worsening of the striatal DA neuron terminal damage and ultrastructural changes to medium spiny neurons. We conclude that NA itself is neuroprotective and plays a fundamental role in the sensitivity of striatal DA terminals to the neurochemical, behavioral, and neurotoxic effects of METH

The multiple sclerosis risk sharing scheme monitoring study - early results and lessons for the future

Background: Risk sharing schemes represent an innovative and important approach to the problems of rationing and achieving cost-effectiveness in high cost or controversial health interventions. This study aimed to assess the feasibility of risk sharing schemes, looking at long term clinical outcomes, to determine the price at which high cost treatments would be acceptable to the NHS. Methods: This case study of the first NHS risk sharing scheme, a long term prospective cohort study of beta interferon and glatiramer acetate in multiple sclerosis ( MS) patients in 71 specialist MS centres in UK NHS hospitals, recruited adults with relapsing forms of MS, meeting Association of British Neurologists (ABN) criteria for disease modifying therapy. Outcome measures were: success of recruitment and follow up over the first three years, analysis of baseline and initial follow up data and the prospect of estimating the long term cost-effectiveness of these treatments. Results: Centres consented 5560 patients. Of the 4240 patients who had been in the study for a least one year, annual review data were available for 3730 (88.0%). Of the patients who had been in the study for at least two years and three years, subsequent annual review data were available for 2055 (78.5%) and 265 (71.8%) patients respectively. Baseline characteristics and a small but statistically significant progression of disease were similar to those reported in previous pivotal studies. Conclusion: Successful recruitment, follow up and early data analysis suggest that risk sharing schemes should be able to deliver their objectives. However, important issues of analysis, and political and commercial conflicts of interest still need to be addressed

Selective loss of noradrenaline exacerbates early cognitive dysfunction and synaptic deficits in APP/PS1 mice.

Background: Degeneration of the locus coeruleus (LC), the major noradrenergic nucleus in the brain, occurs early and is ubiquitous in Alzheimer’s disease (AD). Experimental lesions to the LC exacerbate AD-like neuropathology and cognitive deficits in several transgenic mouse models of AD. Because the LC contains multiple neuromodulators known to affect amyloid toxicity and cognitive function, the specific role of noradrenaline (NA) in AD is not well understood. Methods: To determine the consequences of selective NA deficiency in an AD mouse model, we crossed dopamine -hydroxylase (DBH) knockout mice with amyloid precursor protein (APP)/presenilin-1 (PS1) mice overexpressing mutant APP and PS1. Dopamine -hydroxylase (/) mice are unable to synthesize NA but otherwise have normal LC neurons and co-transmitters. Spatial memory, hippocampal long-term potentiation, and synaptic protein levels were assessed. Results: The modest impairments in spatial memory and hippocampal long-term potentiation displayed by young APP/PS1 or DBH (/) single mutant mice were augmented in DBH (/)/APP/PS1 double mutant mice. Deficits were associated with reduced levels of total calcium/calmodulin-dependent protein kinase II and N-methyl-D-aspartate receptor 2A and increased N-methyl-D-aspartate receptor 2B levels and were independent of amyloid accumulation. Spatial memory performance was partly improved by treatment with the NA precursor drug L-threo-dihydroxyphenylserine. Conclusions: These results indicate that early LC degeneration and subsequentNAdeficiency inADmay contribute to cognitive deficits via altered levels of calcium/calmodulin-dependent protein kinase II and N-methyl-D-aspartate receptors and suggest that NA supplementation could be beneficial in early AD

Cost of managing an episode of relapse in multiple sclerosis in the United States

BACKGROUND: The purpose of this study was to determine the direct medical US cost of managing multiple sclerosis relapses. METHODS: Direct data analysis and cost modeling were employed to derive typical resource use profiles and costs in 2002 US dollars, from the perspective of a third-party payer responsible for comprehensive health-care. The location and scope of health care services provided over a 90-day period were used to define three levels of relapse management. Hospitalization and resulting subsequent care was defined as high intensity management. A medium level of intervention was defined as either use of the emergency room, an observational unit, or administration of acute treatments, such as intravenous methylprednisolone in an outpatient or home setting. The lowest intensity of care comprised physician office visits and symptom-related medications. Data were obtained from many sources including all payer inpatient, ambulatory and emergency room databases from several states, fee schedules, government reports, and literature. All charges were adjusted using cost-to-charge ratios. RESULTS: Average cost per person for high management level was $12,870, based on analysis of 4,634 hospital cases (mean age 48 years, 73$1,847 and mild episode $243. CONCLUSIONS: Management strategies leading to a reduction in the frequency and severity of a relapse, less reliance on inpatient care, or increased access to steroid infusions in the home, would have a substantial impact on the economic consequences of managing relapses

Disruption of the leptomeningeal blood barrier in neuromyelitis optica spectrum disorder

OBJECTIVE: To describe leptomeningeal blood-barrier impairment reflected by MRI gadolinium-enhanced lesions in patients with aquaporin-4 immunoglobulin G (AQP4-IgG)-positive neuromyelitis optica spectrum disorder (NMOSD). METHODS: A retrospective case series of 11 AQP4-IgG-positive NMOSD patients with leptomeningeal enhancement (LME) were collected from 5 centers. External neuroradiologists, blinded to the clinical details, evaluated MRIs. RESULTS: LME was demonstrated on postcontrast T1-weighted and fluid-attenuated inversion recovery images as a sign of leptomeningeal blood-barrier disruption and transient leakage of contrast agent into the subarachnoid space in 11 patients, 6 in the brain and 6 in the spinal cord. The patterns of LME were linear or extensive and were accompanied by periependymal enhancement in 5 cases and intraparenchymal enhancement in all cases. The location of LME in the spinal cord was adjacent to intraparenchymal contrast enhancement with involvement of a median number of 12 (range 5-17) vertebral segments. At the time of LME on MRI, all patients had a clinical attack such as encephalopathy (36%) and/or myelopathy (70%) with median interval between symptom onset and LME of 12 days (range 2-30). LME occurred in association with an initial area postrema attack (44%), signs of systemic infection (33%), or AQP4-IgG in CSF (22%) followed by clinical progression. LME was found at initial clinical presentation in 5 cases and at clinical relapses leading to a diagnosis of NMOSD in 6 cases. CONCLUSION: This study suggests that altered leptomeningeal blood barrier may be accompanied by intraparenchymal blood-brain barrier breakdown in patients with AQP4-IgG-positive NMOSD during relapses