Adding New Tasks to a Single Network with Weight Transformations using Binary Masks

Visual recognition algorithms are required today to exhibit adaptive abilities. Given a deep model trained on a specific, given task, it would be highly desirable to be able to adapt incrementally to new tasks, preserving scalability as the number of new tasks increases, while at the same time avoiding catastrophic forgetting issues. Recent work has shown that masking the internal weights of a given original conv-net through learned binary variables is a promising strategy. We build upon this intuition and take into account more elaborated affine transformations of the convolutional weights that include learned binary masks. We show that with our generalization it is possible to achieve significantly higher levels of adaptation to new tasks, enabling the approach to compete with fine tuning strategies by requiring slightly more than 1 bit per network parameter per additional task. Experiments on two popular benchmarks showcase the power of our approach, that achieves the new state of the art on the Visual Decathlon Challenge

Rotation and Spin in Physics

We delineate the role of rotation and spin in physics, discussing in order Newtonian classical physics, special relativity, quantum mechanics, quantum electrodynamics and general relativity. In the latter case, we discuss the generalization of the Kepler formula to post-Newtonian order $(c^{-2}$) including spin effects and two-body effects. Experiments which verify the theoretical results for general relativistic spin-orbit effects are discussed as well as efforts being made to verify the spin-spin effects

Mechanistic model of natural killer cell proliferative response to IL-15 receptor stimulation

Natural killer (NK) cells are innate lymphocytes that provide early host defense against intracellular pathogens, such as viruses. Although NK cell development, homeostasis, and proliferation are regulated by IL-15, the influence of IL-15 receptor (IL-15R)-mediated signaling at the cellular level has not been quantitatively characterized. We developed a mathematical model to analyze the kinetic interactions that control the formation and localization of IL-15/IL-15R complexes. Our computational results demonstrated that IL-15/IL-15R complexes on the cell surface were a key determinant of the magnitude of the IL-15 proliferative signal and that IL-15R occupancy functioned as an effective surrogate measure of receptor signaling. Ligand binding and receptor internalization modulated IL-15R occupancy. Our work supports the hypothesis that the total number and duration of IL-15/IL-15R complexes on the cell surface crosses a quantitative threshold prior to the initiation of NK cell division. Furthermore, our model predicted that the upregulation of IL-15Rα on NK cells substantially increased IL-15R complex formation and accelerated the expansion of dividing NK cells with the greatest impact at low IL-15 concentrations. Model predictions of the threshold requirement for NK cell recruitment to the cell cycle and the subsequent exponential proliferation correlated well with experimental data. In summary, our modeling analysis provides quantitative insight into the regulation of NK cell proliferation at the receptor level and provides a framework for the development of IL-15 based immunotherapies to modulate NK cell proliferation

Root phenotyping pipeline for cereal plants

The proposed system for the phenotypic analysis of root traits that is presented here enables the precise description of the root growth kinetics of cereal plants. The designed pipeline is composed of a drip irrigation system to supplement plants with a medium, a high-resolution root system scanning facility and a method for comprehensive image analysis. The system enables low-effort, accurate and highly repeatable analysis of features of the root system of cereal seedlings and young plants until the early tillering stage. This system employs an automatic drip irrigation line, which is controlled remotely by a programmable logic controller (PLC). The PLC adapter used facilitates the automated control of all system modules, thus allowing the rate of the medium flow to be adjusted for the supplementation of plants. The system employs measuring sensors for the continuous monitoring of the parameters of the culture medium. This continuous sensing of medium parameters can be applicable for mineral nutrition studies and abiotic stress response testing. The installed drip lines are injected into transparent acrylic tubes (500 mm high, 32/30 mm in outer and inner diameter, with a circular opening in the bottom of 3 mm in diameter) that are filled with glass beads. The acrylic tubes are placed in opaque cover tubes that permit the non-destructive observation of the growth of the root system. Enhanced imaging quality contributes to an increase in the precision of the results that are obtained in the course of the analysis of root parameters using specialised root scanners coupled with the WinRHIZO system. This novel phenotyping pipeline permits noninvasive observation of root system growth adjusted for the subsequent root image acquisition with a reduced background noise. The method combines automated control of plant growth conditions with good imaging quality and high replicability of growth parameters

The challenges of communicating research evidence in practice: perspectives from UK health visitors and practice nurses

<p>Background: Health practitioners play a pivotal role in providing patients with up-to-date evidence and health information. Evidence-based practice and patient-centred care are transforming the delivery of healthcare in the UK. Health practitioners are increasingly balancing the need to provide evidence-based information against that of facilitating patient choice, which may not always concur with the evidence base. There is limited research exploring how health practitioners working in the UK, and particularly those more autonomous practitioners such as health visitors and practice nurses working in community practice settings, negotiate this challenge. This research provides a descriptive account of how health visitors and practice nurses negotiate the challenges of communicating health information and research evidence in practice.</p> <p>Methods: A total of eighteen in-depth telephone interviews were conducted in the UK between September 2008 and May 2009. The participants comprised nine health visitors and nine practice nurses, recruited via adverts on a nursing website, posters at a practitioner conference and through recommendation. Thematic analysis, with a focus on constant comparative method, was used to analyse the data.</p> <p>Results: The data were grouped into three main themes: communicating evidence to the critically-minded patient; confidence in communicating evidence; and maintaining the integrity of the patient-practitioner relationship. These findings highlight some of the daily challenges that health visitors and practice nurses face with regard to the complex and dynamic nature of evidence and the changing attitudes and expectations of patients. The findings also highlight the tensions that exist between differing philosophies of evidence-based practice and patient-centred care, which can make communicating about evidence a daunting task.</p> <p>Conclusions: If health practitioners are to be effective at communicating research evidence, we suggest that more research and resources need to be focused on contextual factors, such as how research evidence is negotiated, appraised and communicated within the dynamic patient-practitioner relationship.</p&gt

Online Continual Learning on Sequences

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial for agents and robots operating in changing environments and required to acquire, fine-tune, and transfer increasingly complex representations from non-i.i.d. input distributions. Machine learning models that address OCL must alleviate \textit{catastrophic forgetting} in which hidden representations are disrupted or completely overwritten when learning from streams of novel input. In this chapter, we summarize and discuss recent deep learning models that address OCL on sequential input through the use (and combination) of synaptic regularization, structural plasticity, and experience replay. Different implementations of replay have been proposed that alleviate catastrophic forgetting in connectionists architectures via the re-occurrence of (latent representations of) input sequences and that functionally resemble mechanisms of hippocampal replay in the mammalian brain. Empirical evidence shows that architectures endowed with experience replay typically outperform architectures without in (online) incremental learning tasks.Comment: L. Oneto et al. (eds.), Recent Trends in Learning From Data, Studies in Computational Intelligence 89

Supervolcanoes Within an Ancient Volcanic Province in Arabia Terra, Mars

Several irregularly shaped craters located within Arabia Terra, Mars represent a new type of highland volcanic construct and together constitute a previously unrecognized martian igneous province. Similar to terrestrial supervolcanoes, these low-relief paterae display a range of geomorphic features related to structural collapse, effusive volcanism, and explosive eruptions. Extruded lavas contributed to the formation of enigmatic highland ridged plains in Arabia Terra. Outgassed sulfur and erupted fine-grained pyroclastics from these calderas likely fed the formation of altered, layered sedimentary rocks and fretted terrain found throughout the equatorial region. Discovery of a new type of volcanic construct in the Arabia volcanic province fundamentally changes the picture of ancient volcanism and climate evolution on Mars. Other eroded topographic basins in the ancient Martian highlands that have been dismissed as degraded impact craters should be reconsidered as possible volcanic constructs formed in an early phase of widespread, disseminated magmatism on Mars

Using theory to improve low back pain care in Australian Aboriginal primary care: a mixed method single cohort pilot study

Background: Low back pain (LBP) care is frequently discordant with research evidence. This pilot study evaluated changes in LBP care following a systematic, theory informed intervention in a rural Australian Aboriginal Health Service. We aimed to improve three aspects of care; reduce inappropriate LBP radiological imaging referrals, increase psychosocial oriented patient assessment and, increase the provision of LBP self-management information to patients. Methods: Three interventions to improve care were developed using a four-step systematic implementation approach. A mixed methods pre/post cohort design evaluated changes in the three behaviours using a clinical audit of LBP care in a six month period prior to the intervention and then following implementation. In-depth interviews elicited the perspectives of involved General Practitioners (GPs). Qualitative analysis was guided by the theoretical domains framework. Results: The proportion of patients who received guideline inconsistent imaging referrals (GICI) improved from 4.1 GICI per 10 patients to 0.4 (95 % CI for decrease in rate: 1.6 to 5.6) amongst GPs involved in the intervention. Amongst non-participating GPs (locum/part-time GPs who commenced post-interventions) the rate of GICI increased from 1.5 to 4.4 GICI per 10 patients (95 % CI for increase in rate: .5 to 5.3). There was a modest increase in the number of patients who received LBP self-management information from participating GPs and no substantial changes to psychosocial oriented patient assessments by any participants; however GPs qualitatively reported that their behaviours had changed. Knowledge and beliefs about consequences were important behavioural domains related to changes. Environmental and resource factors including protocols for locum staff and clinical tools embedded in patient management software were future strategies identified. Conclusions: A systematic intervention model resulted in partial improvements in LBP care. Determinants of practice change amongst GPs were increased knowledge of clinical guidelines, education delivered by someone considered a trusted source of information, and awareness of the negative consequences of inappropriate practices, especially radiological imaging on patient outcomes. Inconsistent and non-evidence based practices amongst locum GPs was an issue that emerged and will be a significant future challenge. The systematic approach utilised is applicable to other services interested in improving LBP care

Community Health Environment Scan Survey (CHESS): a novel tool that captures the impact of the built environment on lifestyle factors

Background: Novel1 1This study was performed on behalf of the Community Interventions for Health (CIH) collaboration. efforts and accompanying tools are needed to tackle the global burden of chronic disease. This paper presents an approach to describe the environments in which people live, work, and play. Community Health Environment Scan Survey (CHESS) is an empirical assessment tool that measures the availability and accessibility, of healthy lifestyle options lifestyle options. CHESS reveals existing community assets as well as opportunities for change, shaping community intervention planning efforts by focusing on community-relevant opportunities to address the three key risk factors for chronic disease (i.e. unhealthy diet, physical inactivity, and tobacco use). Methods: The CHESS tool was developed following a review of existing auditing tools and in consultation with experts. It is based on the social-ecological model and is adaptable to diverse settings in developed and developing countries throughout the world. Results: For illustrative purposes, baseline results from the Community Interventions for Health (CIH) Mexico site are used, where the CHESS tool assessed 583 food stores and 168 restaurants. Comparisons between individual-level survey data from schools and community-level CHESS data are made to demonstrate the utility of the tool in strategically guiding intervention activities. Conclusion: The environments where people live, work, and play are key factors in determining their diet, levels of physical activity, and tobacco use. CHESS is the first tool of its kind that systematically and simultaneously examines how built environments encourage/discourage healthy eating, physical activity, and tobacco use. CHESS can help to design community interventions to prevent chronic disease and guide healthy urban planning

Beverage patterns and trends among school-aged children in the US, 1989-2008

<p>Abstract</p> <p>Background</p> <p>High intake of sugar-sweetened beverages in childhood is linked to increased risk of obesity and type II diabetes later in life. Using three nationally representative surveys of dietary intake, we investigated beverage patterns and trends among US school-aged children from 1989/91 to 2007/08.</p> <p>Methods</p> <p>3, 583 participants ages 6-11 y old were included. We reported per capita trends in beverage consumption, percent consuming, and amount per consumer for the following categories of beverages: sugar-sweetened beverages (SSB), caloric nutritional beverages (CNB) and low calorie beverages (LCB). Statistically significant differences were tested using the Student's t test in Stata 11.</p> <p>Results</p> <p>While per capita kcal contribution from total beverages remained constant over the study period, per capita consumption of SSBs increased and CNBs decreased in similar magnitude. The substantial increase in consumption of certain SSBs, such as fruit drinks and soda, high fat high sugar milk, and sports drinks, coupled with the decrease in consumption of high fat low sugar milk was responsible for this shift. The percent consuming SSBs as well as the amount per consumer increased significantly over time. Per capita intake of total milk declined, but the caloric contribution from high fat high sugar milk increased substantially. Among ethnicities, important differences in consumption trends of certain SSBs and 100% juice indicate the complexity in determining strategies for children's beverage calorie reduction.</p> <p>Conclusions</p> <p>As upward trends of SSB consumption parallel increases in childhood obesity, educational and policy interventions should be considered.</p