The dynamics of matrix momentum

We analyse the matrix momentum algorithm, which provides an efficient approximation to on-line Newton's method, by extending a recent statistical mechanics framework to include second order algorithms. We study the efficacy of this method when the Hessian is available and also consider a practical implementation which uses a single example estimate of the Hessian. The method is shown to provide excellent asymptotic performance, although the single example implementation is sensitive to the choice of training parameters. We conjecture that matrix momentum could provide efficient matrix inversion for other second order algorithms

Functional Federated Learning in Erlang (ffl-erl)

The functional programming language Erlang is well-suited for concurrent and distributed applications. Numerical computing, however, is not seen as one of its strengths. The recent introduction of Federated Learning, a concept according to which client devices are leveraged for decentralized machine learning tasks, while a central server updates and distributes a global model, provided the motivation for exploring how well Erlang is suited to that problem. We present ffl-erl, a framework for Federated Learning, written in Erlang, and explore how well it performs in two scenarios: one in which the entire system has been written in Erlang, and another in which Erlang is relegated to coordinating client processes that rely on performing numerical computations in the programming language C. There is a concurrent as well as a distributed implementation of each case. Erlang incurs a performance penalty, but for certain use cases this may not be detrimental, considering the trade-off between conciseness of the language and speed of development (Erlang) versus performance (C). Thus, Erlang may be a viable alternative to C for some practical machine learning tasks.Comment: 16 pages, accepted for publication in the WFLP 2018 conference proceedings; final post-prin

Transients and asymptotics of natural gradient learning

We analyse natural gradient learning in a two-layer feed-forward neural network using a statistical mechanics framework which is appropriate for large input dimension. We find significant improvement over standard gradient descent in both the transient and asymptotic phases of learning

Two NAD-linked redox shuttles maintain the peroxisomal redox balance in Saccharomyces cerevisiae

In Saccharomyces cerevisiae, peroxisomes are the sole site of fatty acid β-oxidation. During this process, NAD(+) is reduced to NADH. When cells are grown on oleate medium, peroxisomal NADH is reoxidised to NAD(+) by malate dehydrogenase (Mdh3p) and reduction equivalents are transferred to the cytosol by the malate/oxaloacetate shuttle. The ultimate step in lysine biosynthesis, the NAD(+)-dependent dehydrogenation of saccharopine to lysine, is another NAD(+)-dependent reaction performed inside peroxisomes. We have found that in glucose grown cells, both the malate/oxaloacetate shuttle and a glycerol-3-phosphate dehydrogenase 1(Gpd1p)-dependent shuttle are able to maintain the intraperoxisomal redox balance. Single mutants in MDH3 or GPD1 grow on lysine-deficient medium, but an mdh3/gpd1Δ double mutant accumulates saccharopine and displays lysine bradytrophy. Lysine biosynthesis is restored when saccharopine dehydrogenase is mislocalised to the cytosol in mdh3/gpd1Δ cells. We conclude that the availability of intraperoxisomal NAD(+) required for saccharopine dehydrogenase activity can be sustained by both shuttles. The extent to which each of these shuttles contributes to the intraperoxisomal redox balance may depend on the growth medium. We propose that the presence of multiple peroxisomal redox shuttles allows eukaryotic cells to maintain the peroxisomal redox status under different metabolic conditions

Systematic Dissection and Trajectory-Scanning Mutagenesis of the Molecular Interface That Ensures Specificity of Two-Component Signaling Pathways

Two-component signal transduction systems enable bacteria to sense and respond to a wide range of environmental stimuli. Sensor histidine kinases transmit signals to their cognate response regulators via phosphorylation. The faithful transmission of information through two-component pathways and the avoidance of unwanted cross-talk require exquisite specificity of histidine kinase-response regulator interactions to ensure that cells mount the appropriate response to external signals. To identify putative specificity-determining residues, we have analyzed amino acid coevolution in two-component proteins and identified a set of residues that can be used to rationally rewire a model signaling pathway, EnvZ-OmpR. To explore how a relatively small set of residues can dictate partner selectivity, we combined alanine-scanning mutagenesis with an approach we call trajectory-scanning mutagenesis, in which all mutational intermediates between the specificity residues of EnvZ and another kinase, RstB, were systematically examined for phosphotransfer specificity. The same approach was used for the response regulators OmpR and RstA. Collectively, the results begin to reveal the molecular mechanism by which a small set of amino acids enables an individual kinase to discriminate amongst a large set of highly-related response regulators and vice versa. Our results also suggest that the mutational trajectories taken by two-component signaling proteins following gene or pathway duplication may be constrained and subject to differential selective pressures. Only some trajectories allow both the maintenance of phosphotransfer and the avoidance of unwanted cross-talk

Genetic Architecture of Hybrid Male Sterility in Drosophila: Analysis of Intraspecies Variation for Interspecies Isolation

Background: The genetic basis of postzygotic isolation is a central puzzle in evolutionary biology. Evolutionary forces causing hybrid sterility or inviability act on the responsible genes while they still are polymorphic, thus we have to study these traits as they arise, before isolation is complete. Methodology/Principal Findings: Isofemale strains of D. mojavensis vary significantly in their production of sterile F 1 sons when females are crossed to D. arizonae males. We took advantage of the intraspecific polymorphism, in a novel design, to perform quantitative trait locus (QTL) mapping analyses directly on F1 hybrid male sterility itself. We found that the genetic architecture of the polymorphism for hybrid male sterility (HMS) in the F1 is complex, involving multiple QTL, epistasis, and cytoplasmic effects. Conclusions/Significance: The role of extensive intraspecific polymorphism, multiple QTL, and epistatic interactions in HMS in this young species pair shows that HMS is arising as a complex trait in this system. Directional selection alone would be unlikely to maintain polymorphism at multiple loci, thus we hypothesize that directional selection is unlikely to be the only evolutionary force influencing postzygotic isolation

Progressive GAA·TTC Repeat Expansion in Human Cell Lines

Trinucleotide repeat expansion is the genetic basis for a sizeable group of inherited neurological and neuromuscular disorders. Friedreich ataxia (FRDA) is a relentlessly progressive neurodegenerative disorder caused by GAA·TTC repeat expansion in the first intron of the FXN gene. The expanded repeat reduces FXN mRNA expression and the length of the repeat tract is proportional to disease severity. Somatic expansion of the GAA·TTC repeat sequence in disease-relevant tissues is thought to contribute to the progression of disease severity during patient aging. Previous models of GAA·TTC instability have not been able to produce substantial levels of expansion within an experimentally useful time frame, which has limited our understanding of the molecular basis for this expansion. Here, we present a novel model for studying GAA·TTC expansion in human cells. In our model system, uninterrupted GAA·TTC repeat sequences display high levels of genomic instability, with an overall tendency towards progressive expansion. Using this model, we characterize the relationship between repeat length and expansion. We identify the interval between 88 and 176 repeats as being an important length threshold where expansion rates dramatically increase. We show that expansion levels are affected by both the purity and orientation of the repeat tract within the genomic context. We further demonstrate that GAA·TTC expansion in our model is independent of cell division. Using unique reporter constructs, we identify transcription through the repeat tract as a major contributor to GAA·TTC expansion. Our findings provide novel insight into the mechanisms responsible for GAA·TTC expansion in human cells

Effect of a Simple Information Booklet on Pain Persistence after an Acute Episode of Low Back Pain: A Non-Randomized Trial in a Primary Care Setting

Mass-media campaigns have been known to modify the outcome of low back pain (LBP). We assessed the impact on outcome of standardized written information on LBP given to patients with acute LBP.A 3-month pragmatic, multicenter controlled trial with geographic stratification.Primary care practice in France.2752 patients with acute LBP.An advice book on LBP (the "back book").The main outcome measure was persistence of LBP three months after baseline evaluation.2337 (85%) patients were assessed at follow-up and 12.4% of participants reported persistent LBP. The absolute risk reduction of reporting persistent back pain in the intervention group was 3.6% lower than in the control group (10.5% vs. 14.1%; 95% confidence interval [-6.3% ; -1.0%]; p value adjusted for cluster effect = 0.01). Patients in the intervention group were more satisfied than those in the control group with the information they received about physical activities, when to consult their physician, and how to prevent a new episode of LBP. However, the number of patients who had taken sick leave was similar, as was the mean sick-leave duration, in both arms, and, among patients with persistent pain at follow-up, the intervention and control groups did not differ in disability or fear-avoidance beliefs.The level of improvement of an information booklet is modest, but the cost and complexity of the intervention is minimal. Therefore, the implications and generalizability of this intervention are substantial.ClinicalTrials.gov NCT00343057

Patterns of Reproductive Isolation in Toads

Understanding the general features of speciation is an important goal in evolutionary biology, and despite significant progress, several unresolved questions remain. We analyzed an extensive comparative dataset consisting of more than 1900 crosses between 92 species of toads to infer patterns of reproductive isolation. This unique dataset provides an opportunity to examine the strength of reproductive isolation, the development and sex ratios of hybrid offspring, patterns of fertility and infertility, and polyploidization in hybrids all in the context of genetic divergence between parental species. We found that the strength of intrinsic postzygotic isolation increases with genetic divergence, but relatively high levels of divergence are necessary before reproductive isolation is complete in toads. Fertilization rates were not correlated to genetic divergence, but hatching success, the number of larvae produced, and the percentage of tadpoles reaching metamorphosis were all inversely related with genetic divergence. Hybrids between species with lower levels of divergence developed to metamorphosis, while hybrids with higher levels of divergence stopped developing in gastrula and larval stages. Sex ratios of hybrid offspring were biased towards males in 70% of crosses and biased towards females in 30% of crosses. Hybrid females from crosses between closely related species were completely fertile, while approximately half (53%) of hybrid males were sterile, with sterility predicted by genetic divergence. The degree of abnormal ploidy in hybrids was positively related to genetic divergence between parental species, but surprisingly, polyploidization had no effect on patterns of asymmetrical inviability. We discuss explanations for these patterns, including the role of Haldane's rule in toads and anurans in general, and suggest mechanisms generating patterns of reproductive isolation in anurans