Memory Aware Synapses: Learning what (not) to forget

Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten by new incoming information while important, frequently used knowledge is prevented from being erased. In artificial learning systems, lifelong learning so far has focused mainly on accumulating knowledge over tasks and overcoming catastrophic forgetting. In this paper, we argue that, given the limited model capacity and the unlimited new information to be learned, knowledge has to be preserved or erased selectively. Inspired by neuroplasticity, we propose a novel approach for lifelong learning, coined Memory Aware Synapses (MAS). It computes the importance of the parameters of a neural network in an unsupervised and online manner. Given a new sample which is fed to the network, MAS accumulates an importance measure for each parameter of the network, based on how sensitive the predicted output function is to a change in this parameter. When learning a new task, changes to important parameters can then be penalized, effectively preventing important knowledge related to previous tasks from being overwritten. Further, we show an interesting connection between a local version of our method and Hebb's rule,which is a model for the learning process in the brain. We test our method on a sequence of object recognition tasks and on the challenging problem of learning an embedding for predicting $$ triplets. We show state-of-the-art performance and, for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on test conditions.Comment: ECCV 201

Unilateral, trifocal, diaphyseal fracture of the radius with ipsilateral mid-shaft ulna fracture in an adult: a case report

<p>Abstract</p> <p>Introduction</p> <p>To the best of our knowledge, a trifocal, diaphyseal fracture of the radius associated with ipsilateral mid-shaft fracture of the ulna in an adult has not been reported in the literature to date. The AO classification system does not include such a fracture configuration.</p> <p>Case presentation</p> <p>We report a case of trifocal, diaphyseal fracture of the radius with a mid-diaphyseal fracture of the ulna in a 53-year-old Caucasian, British, right-hand dominant woman involved in a head-on collision with another vehicle. The management of this rare fracture configuration is described and alternative treatment options discussed.</p> <p>Conclusions</p> <p>We describe an unusual, complex fracture, which with prompt surgical treatment resulted in a rapid, full and satisfactory functional recovery for our patient.</p

Liquid-gas phase transition in nuclear multifragmentation

The equation of state of nuclear matter suggests that at suitable beam energies the disassembling hot system formed in heavy ion collisions will pass through a liquid-gas coexistence region. Searching for the signatures of the phase transition has been a very important focal point of experimental endeavours in heavy ion collisions, in the last fifteen years. Simultaneously theoretical models have been developed to provide information about the equation of state and reaction mechanisms consistent with the experimental observables. This article is a review of this endeavour.Comment: 63 pages, 27 figures, submitted to Adv. Nucl. Phys. Some typos corrected, minor text change

The influence of task demands, verbal ability and executive functions on item and source memory in Autism Spectrum Disorder

Autism Spectrum Disorder (ASD) is generally associated with difficulties in contextual source memory but not single item memory. There are surprising inconsistencies in the literature, however, that the current study seeks to address by examining item and source memory in age and ability matched groups of 22 ASD and 21 comparison adults. Results show that group differences in source memory are moderated by task demands but not by individual differences in verbal ability, executive function or item memory. By contrast, unexpected group differences in item memory could largely be explained by individual differences in source memory. These observations shed light on the factors underlying inconsistent findings in the memory literature in ASD, which has important implications for theory and practice

Using classification and regression tree modelling to investigate response shift patterns in dentine hypersensitivity

BACKGROUND: Dentine hypersensitivity (DH) affects people's quality of life (QoL). However changes in the internal meaning of QoL, known as Response shift (RS) may undermine longitudinal assessment of QoL. This study aimed to describe patterns of RS in people with DH using Classification and Regression Trees (CRT) and to explore the convergent validity of CRT with the then-test and ideals approaches. METHODS: Data from an 8-week clinical trial of mouthwashes for dentine hypersensitivity (n = 75) using the Dentine Hypersensitivity Experience Questionnaire (DHEQ) as the outcome measure, were analysed. CRT was used to examine 8-week changes in DHEQ total score as a dependent variable with clinical status for DH and each DHEQ subscale score (restrictions, coping, social, emotional and identity) as independent variables. Recalibration was inferred when the clinical change was not consistent with the DHEQ change score using a minimally important difference for DHEQ of 22 points. Reprioritization was inferred by changes in the relative importance of each subscale to the model over time. RESULTS: Overall, 50.7% of participants experienced a clinical improvement in their DH after treatment and 22.7% experienced an important improvement in their quality of life. Thirty-six per cent shifted their internal standards downward and 14.7% upwards, suggesting recalibration. Reprioritization occurred over time among the social and emotional impacts of DH. CONCLUSIONS: CRT was a useful method to reveal both, the types and nature of RS in people with a mild health condition and demonstrated convergent validity with design based approaches to detect RS

Physics of Neutron Star Crusts

The physics of neutron star crusts is vast, involving many different research fields, from nuclear and condensed matter physics to general relativity. This review summarizes the progress, which has been achieved over the last few years, in modeling neutron star crusts, both at the microscopic and macroscopic levels. The confrontation of these theoretical models with observations is also briefly discussed.Comment: 182 pages, published version available at <http://www.livingreviews.org/lrr-2008-10

Interpreting outcome following foot surgery in people with rheumatoid arthritis

BACKGROUND: Foot surgery is common in RA but the current lack of understanding of how patients interpret outcomes inhibits evaluation of procedures in clinical and research settings. This study aimed to explore which factors are important to people with RA when they evaluate the outcome of foot and ankle surgery. METHODS AND RESULTS: Semi structured interviews with 11 RA participants who had mixed experiences of foot surgery were conducted and analysed using thematic analysis. Responses showed that while participants interpreted surgical outcome in respect to a multitude of factors, five major themes emerged: functional ability, participation, appearance of feet and footwear, surgeons' opinion, and pain. Participants interpreted levels of physical function in light of other aspects of their disease, reflecting on relative change from their preoperative state more than absolute levels of ability. Appearance was important to almost all participants: physical appearance, foot shape, and footwear were closely interlinked, yet participants saw these as distinct concepts and frequently entered into a defensive repertoire, feeling the need to justify that their perception of outcome was not about cosmesis. Surgeons' post-operative evaluation of the procedure was highly influential and made a lasting impression, irrespective of how the outcome compared to the participants' initial goals. Whilst pain was important to almost all participants, it had the greatest impact upon them when it interfered with their ability to undertake valued activities. CONCLUSIONS: People with RA interpret the outcome of foot surgery using multiple interrelated factors, particularly functional ability, appearance and surgeons' appraisal of the procedure. While pain was often noted, this appeared less important than anticipated. These factors can help clinicians in discussing surgical options in patients

Acute Insulin Stimulation Induces Phosphorylation of the Na-Cl Cotransporter in Cultured Distal mpkDCT Cells and Mouse Kidney

The NaCl cotransporter (NCC) is essential for sodium reabsorption at the distal convoluted tubules (DCT), and its phosphorylation increases its transport activity and apical membrane localization. Although insulin has been reported to increase sodium reabsorption in the kidney, the linkage between insulin and NCC phosphorylation has not yet been investigated. This study examined whether insulin regulates NCC phosphorylation. In cultured mpkDCT cells, insulin increased phosphorylation of STE20/SPS1-related proline-alanine-rich kinase (SPAK) and NCC in a dose-dependent manner. This insulin-induced phosphorylation of NCC was suppressed in WNK4 and SPAK knockdown cells. In addition, Ly294002, a PI3K inhibitor, decreased the insulin effect on SPAK and NCC phosphorylation, indicating that insulin induces phosphorylation of SPAK and NCC through PI3K and WNK4 in mpkDCT cells. Moreover, acute insulin administration to mice increased phosphorylation of oxidative stress-responsive kinase-1 (OSR1), SPAK and NCC in the kidney. Time-course experiments in mpkDCT cells and mice suggested that SPAK is upstream of NCC in this insulin-induced NCC phosphorylation mechanism, which was confirmed by the lack of insulin-induced NCC phosphorylation in SPAK knockout mice. Moreover, insulin administration to WNK4 hypomorphic mice did not increase phosphorylation of OSR1, SPAK and NCC in the kidney, suggesting that WNK4 is also involved in the insulin-induced OSR1, SPAK and NCC phosphorylation mechanism in vivo. The present results demonstrated that insulin is a potent regulator of NCC phosphorylation in the kidney, and that WNK4 and SPAK are involved in this mechanism of NCC phosphorylation by insulin

“Medically unexplained” symptoms and symptom disorders in primary care: prognosis-based recognition and classification

Background: Many patients consult their GP because they experience bodily symptoms. In a substantial proportion of cases, the clinical picture does not meet the existing diagnostic criteria for diseases or disorders. This may be because symptoms are recent and evolving or because symptoms are persistent but, either by their character or the negative results of clinical investigation cannot be attributed to disease: so-called “medically unexplained symptoms” (MUS). MUS are inconsistently recognised, diagnosed and managed in primary care. The specialist classification systems for MUS pose several problems in a primary care setting. The systems generally require great certainty about presence or absence of physical disease, they tend to be mind-body dualistic, and they view symptoms from a narrow specialty determined perspective. We need a new classification of MUS in primary care; a classification that better supports clinical decision-making, creates clearer communication and provides scientific underpinning of research to ensure effective interventions. Discussion: We propose a classification of symptoms that places greater emphasis on prognostic factors. Prognosis-based classification aims to categorise the patient’s risk of ongoing symptoms, complications, increased healthcare use or disability because of the symptoms. Current evidence suggests several factors which may be used: symptom characteristics such as: number, multi-system pattern, frequency, severity. Other factors are: concurrent mental disorders, psychological features and demographic data. We discuss how these characteristics may be used to classify symptoms into three groups: self-limiting symptoms, recurrent and persistent symptoms, and symptom disorders. The middle group is especially relevant in primary care; as these patients generally have reduced quality of life but often go unrecognised and are at risk of iatrogenic harm. The presented characteristics do not contain immediately obvious cut-points, and the assessment of prognosis depends on a combination of several factors. Conclusion: Three criteria (multiple symptoms, multiple systems, multiple times) may support the classification into good, intermediate and poor prognosis when dealing with symptoms in primary care. The proposed new classification specifically targets the patient population in primary care and may provide a rational framework for decision-making in clinical practice and for epidemiologic and clinical research of symptoms

Dose finding of melatonin for chronic idiopathic childhood sleep onset insomnia: an RCT

Contains fulltext : 86695.pdf (publisher's version ) (Open Access)Rationale Pharmacokinetics of melatonin in children might differ from that in adults. Objectives This study aims to establish a dose–response relationship for melatonin in advancing dim light melatonin onset (DLMO), sleep onset (SO), and reducing sleep onset latency (SOL) in children between 6 and 12 years with chronic sleep onset insomnia (CSOI). Methods The method used for this study is the randomized, placebo-controlled double-blind trial. Children with CSOI (n=72) received either melatonin 0.05, 0.1, and 0.15 mg/kg or placebo during 1 week. Sleep was assessed with log and actigraphy during this week and the week before. Outcomes were the shifts in DLMO, SO, and SOL. Results Treatment with melatonin significantly advanced SO and DLMO by approximately 1 h and decreased SOL by 35 min. Within the three melatonin groups, effect size was not different, but the circadian time of administration (TOA) correlated significantly with treatment effect on DLMO (rs=-0.33, p=0.022) and SO (rs=-0.38, p=0.004), whereas clock TOA was correlated with SO shift (r=-0.35, p=0.006) and not with DLMO shift. Conclusions No dose–response relationship of melatonin with SO, SOL, and DLMO is found within a dosage range of 0.05–0.15 mg/kg. The effect of exogenous melatonin on SO, SOL, and DLMO increases with an earlier circadian TOA. The soporific effects of melatonin enhance the SO shift. This study demonstrates that melatonin for treatment of CSOI in children is effective in a dosage of 0.05 mg/kg given at least 1 to 2 h before DLMO and before desired bedtime.13 p