Pseudorehearsal in value function approximation

Catastrophic forgetting is of special importance in reinforcement learning, as the data distribution is generally non-stationary over time. We study and compare several pseudorehearsal approaches for Q-learning with function approximation in a pole balancing task. We have found that pseudorehearsal seems to assist learning even in such very simple problems, given proper initialization of the rehearsal parameters

Magnetothermodynamics of BPS baby skyrmions

The magnetothermodynamics of skyrmion type matter described by the gauged BPS baby Skyrme model at zero temperature is investigated. We prove that the BPS property of the model is preserved also for boundary conditions corresponding to an asymptotically constant magnetic field. The BPS bound and the corresponding BPS equations saturating the bound are found. Further, we show that one may introduce pressure in the gauged model by a redefinition of the superpotential. Interestingly, this is related to non-extremal type solutions in the so-called fake supersymmetry method. Finally, we compute the equation of state of magnetized BSP baby skyrmions inserted into an external constant magnetic field $H$ and under external pressure $P$, i.e., $V=V(P,H)$, where $V$ is the "volume" (area) occupied by the skyrmions. We show that the BPS baby skyrmions form a ferromagnetic medium.Comment: Latex, 39 pages, 14 figures. v2: New results and references added, physical interpretation partly change

Mass-Matching in Higgsless

Modern extra-dimensional Higgsless scenarios rely on a mass-matching between fermionic and bosonic KK resonances to evade constraints from precision electroweak measurements. After analyzing all of the Tevatron and LEP bounds on these so-called Cured Higgsless scenarios, we study their LHC signatures and explore how to identify the mass-matching mechanism, the key to their viability. We find singly and pair produced fermionic resonances show up as clean signals with 2 or 4 leptons and 2 hard jets, while neutral and charged bosonic resonances are visible in the dilepton and leptonic WZ channels, respectively. A measurement of the resonance masses from these channels shows the matching necessary to achieve $S\simeq 0$. Moreover, a large single production of KK-fermion resonances is a clear indication of compositeness of SM quarks. Discovery reach is below 10 fb$^{-1}$ of luminosity for resonances in the 700 GeV range.Comment: 28 pages, 18 figure

A novel targeted/untargeted GC-Orbitrap metabolomics methodology applied to Candida albicans and Staphylococcus aureus biofilms

Introduction: Combined infections from Candida albicans and Staphylococcus aureus are a leading cause of death in the developed world. Evidence suggests that Candida enhances the virulence of Staphylococcus—hyphae penetrate through tissue barriers, while S. aureus tightly associates with the hyphae to obtain entry to the host organism. Indeed, in a biofilm state, C. albicans enhances the antimicrobial resistance characteristics of S. aureus. The association of these microorganisms is also associated with significantly increased morbidity and mortality. Due to this tight association we hypothesised that metabolic effects were also in evidence. Objectives: To explore the interaction, we used a novel GC-Orbitrap-based mass spectrometer, the Q Exactive GC, which combines the high peak capacity and chromatographic resolution of gas chromatography with the sub-ppm mass accuracy of an Orbitrap system. This allows the capability to leverage the widely available electron ionisation libraries for untargeted applications, along with expanding accurate mass libraries and targeted matches based around authentic standards. Methods: Optimised C. albicans and S. aureus mono- and co-cultured biofilms were analysed using the new instrument in addition to the fresh and spent bacterial growth media. Results: The targeted analysis experiment was based around 36 sugars and sugar phosphates, 22 amino acids and five organic acids. Untargeted analysis resulted in the detection of 465 features from fresh and spent medium and 405 from biofilm samples. Three significantly changing compounds that matched to high scoring library fragment patterns were chosen for validation. Conclusion: Evaluation of the results demonstrates that the Q Exactive GC is suitable for metabolomics analysis using a targeted/untargeted methodology. Many of the results were as expected: e.g. rapid consumption of glucose and fructose from the medium regardless of the cell type. Modulation of sugar-phosphate levels also suggest that the pentose phosphate pathway could be enhanced in the cells from co-cultured biofilms. Untargeted metabolomics results suggested significant production of cell-wall biosynthesis components and the consumption of non-proteinaceous amino-acids

The role of mutation rate variation and genetic diversity in the architecture of human disease

Background We have investigated the role that the mutation rate and the structure of genetic variation at a locus play in determining whether a gene is involved in disease. We predict that the mutation rate and its genetic diversity should be higher in genes associated with disease, unless all genes that could cause disease have already been identified. Results Consistent with our predictions we find that genes associated with Mendelian and complex disease are substantially longer than non-disease genes. However, we find that both Mendelian and complex disease genes are found in regions of the genome with relatively low mutation rates, as inferred from intron divergence between humans and chimpanzees, and they are predicted to have similar rates of non-synonymous mutation as other genes. Finally, we find that disease genes are in regions of significantly elevated genetic diversity, even when variation in the rate of mutation is controlled for. The effect is small nevertheless. Conclusions Our results suggest that gene length contributes to whether a gene is associated with disease. However, the mutation rate and the genetic architecture of the locus appear to play only a minor role in determining whether a gene is associated with disease

Minimal lepton flavor violating realizations of minimal seesaw models

We study the implications of the global U(1)R symmetry present in minimal lepton flavor violating implementations of the seesaw mechanism for neutrino masses. In the context of minimal type I seesaw scenarios with a slightly broken U(1)R, we show that, depending on the R-charge assignments, two classes of generic models can be identified. Models where the right-handed neutrino masses and the lepton number breaking scale are decoupled, and models where the parameters that slightly break the U(1)R induce a suppression in the light neutrino mass matrix. We show that within the first class of models, contributions of right-handed neutrinos to charged lepton flavor violating processes are severely suppressed. Within the second class of models we study the charged lepton flavor violating phenomenology in detail, focusing on mu to e gamma, mu to 3e and mu to e conversion in nuclei. We show that sizable contributions to these processes are naturally obtained for right-handed neutrino masses at the TeV scale. We then discuss the interplay with the effects of the right-handed neutrino interactions on primordial B - L asymmetries, finding that sizable right-handed neutrino contributions to charged lepton flavor violating processes are incompatible with the requirement of generating (or even preserving preexisting) B - L asymmetries consistent with the observed baryon asymmetry of the Universe.Comment: 21 pages, 4 figures; version 2: Discussion on possible generic models extended, typos corrected, references added. Version matches publication in JHE

IACT observations of gamma-ray bursts: prospects for the Cherenkov Telescope Array

Gamma rays at rest frame energies as high as 90 GeV have been reported from gamma-ray bursts (GRBs) by the Fermi Large Area Telescope (LAT). There is considerable hope that a confirmed GRB detection will be possible with the upcoming Cherenkov Telescope Array (CTA), which will have a larger effective area and better low-energy sensitivity than current-generation imaging atmospheric Cherenkov telescopes (IACTs). To estimate the likelihood of such a detection, we have developed a phenomenological model for GRB emission between 1 GeV and 1 TeV that is motivated by the high-energy GRB detections of Fermi-LAT, and allows us to extrapolate the statistics of GRBs seen by lower energy instruments such as the Swift-BAT and BATSE on the Compton Gamma-ray Observatory. We show a number of statistics for detected GRBs, and describe how the detectability of GRBs with CTA could vary based on a number of parameters, such as the typical observation delay between the burst onset and the start of ground observations. We also consider the possibility of using GBM on Fermi as a finder of GRBs for rapid ground follow-up. While the uncertainty of GBM localization is problematic, the small field-of-view for IACTs can potentially be overcome by scanning over the GBM error region. Overall, our results indicate that CTA should be able to detect one GRB every 20 to 30 months with our baseline instrument model, assuming consistently rapid pursuit of GRB alerts, and provided that spectral breaks below 100 GeV are not a common feature of the bright GRB population. With a more optimistic instrument model, the detection rate can be as high as 1 to 2 GRBs per year.Comment: 28 pages, 24 figures, 4 tables, submitted to Experimental Astronom

Characteristics associated with quality of life among people with drug-resistant epilepsy

Quality of Life (QoL) is the preferred outcome in non-pharmacological trials, but there is little UK population evidence of QoL in epilepsy. In advance of evaluating an epilepsy self-management course we aimed to describe, among UK participants, what clinical and psycho-social characteristics are associated with QoL. We recruited 404 adults attending specialist clinics, with at least two seizures in the prior year and measured their self-reported seizure frequency, co-morbidity, psychological distress, social characteristics, including self-mastery and stigma, and epilepsy-specific QoL (QOLIE-31-P). Mean age was 42 years, 54% were female, and 75% white. Median time since diagnosis was 18 years, and 69% experienced ≥10 seizures in the prior year. Nearly half (46%) reported additional medical or psychiatric conditions, 54% reported current anxiety and 28% reported current depression symptoms at borderline or case level, with 63% reporting felt stigma. While a maximum QOLIE-31-P score is 100, participants’ mean score was 66, with a wide range (25–99). In order of large to small magnitude: depression, low self-mastery, anxiety, felt stigma, a history of medical and psychiatric comorbidity, low self-reported medication adherence, and greater seizure frequency were associated with low QOLIE-31-P scores. Despite specialist care, UK people with epilepsy and persistent seizures experience low QoL. If QoL is the main outcome in epilepsy trials, developing and evaluating ways to reduce psychological and social disadvantage are likely to be of primary importance. Educational courses may not change QoL, but be one component supporting self-management for people with long-term conditions, like epilepsy

Flavour physics from an approximate U(2)^3 symmetry

The quark sector of the Standard Model exhibits an approximate U(2)^3 flavour symmetry. This symmetry, broken in specific directions dictated by minimality, can explain the success of the Cabibbo-Kobayashi-Maskawa picture of flavour mixing and CP violation, confirmed by the data so far, while allowing for observable deviations from it, as expected in most models of ElectroWeak Symmetry Breaking. Building on previous work in the specific context of supersymmetry, we analyze the expected effects and we quantify the current bounds in a general Effective Field Theory framework. As a further relevant example we then show how the U(2)^3 symmetry and its breaking can be implemented in a generic composite Higgs model and we make a first analysis of its peculiar consequences. We also discuss how some partial extension of U(2)^3 to the lepton sector can arise, both in general and in composite Higgs models. An optimistic though conceivable interpretation of the considerations developed in this paper gives reasons to think that new physics searches in the flavour sector may be about to explore an interesting realm of phenomena.Comment: 29 pages, 5 figure