VR-SGD: A Simple Stochastic Variance Reduction Method for Machine Learning

© 1989-2012 IEEE. In this paper, we propose a simple variant of the original SVRG, called variance reduced stochastic gradient descent (VR-SGD). Unlike the choices of snapshot and starting points in SVRG and its proximal variant, Prox-SVRG, the two vectors of VR-SGD are set to the average and last iterate of the previous epoch, respectively. The settings allow us to use much larger learning rates, and also make our convergence analysis more challenging. We also design two different update rules for smooth and non-smooth objective functions, respectively, which means that VR-SGD can tackle non-smooth and/or non-strongly convex problems directly without any reduction techniques. Moreover, we analyze the convergence properties of VR-SGD for strongly convex problems, which show that VR-SGD attains linear convergence. Different from most algorithms that have no convergence guarantees for non-strongly convex problems, we also provide the convergence guarantees of VR-SGD for this case, and empirically verify that VR-SGD with varying learning rates achieves similar performance to its momentum accelerated variant that has the optimal convergence rate O(1/T2O(1/T2). Finally, we apply VR-SGD to solve various machine learning problems, such as convex and non-convex empirical risk minimization, and leading eigenvalue computation. Experimental results show that VR-SGD converges significantly faster than SVRG and Prox-SVRG, and usually outperforms state-of-the-art accelerated methods, e.g., Katyusha

Measurements of fiducial and differential cross sections for Higgs boson production in the diphoton decay channel at s√=8 TeV with ATLAS

Measurements of fiducial and differential cross sections are presented for Higgs boson production in proton-proton collisions at a centre-of-mass energy of s√=8 TeV. The analysis is performed in the H → γγ decay channel using 20.3 fb−1 of data recorded by the ATLAS experiment at the CERN Large Hadron Collider. The signal is extracted using a fit to the diphoton invariant mass spectrum assuming that the width of the resonance is much smaller than the experimental resolution. The signal yields are corrected for the effects of detector inefficiency and resolution. The pp → H → γγ fiducial cross section is measured to be 43.2 ±9.4(stat.) − 2.9 + 3.2 (syst.) ±1.2(lumi)fb for a Higgs boson of mass 125.4GeV decaying to two isolated photons that have transverse momentum greater than 35% and 25% of the diphoton invariant mass and each with absolute pseudorapidity less than 2.37. Four additional fiducial cross sections and two cross-section limits are presented in phase space regions that test the theoretical modelling of different Higgs boson production mechanisms, or are sensitive to physics beyond the Standard Model. Differential cross sections are also presented, as a function of variables related to the diphoton kinematics and the jet activity produced in the Higgs boson events. The observed spectra are statistically limited but broadly in line with the theoretical expectations

Evidence for the Higgs-boson Yukawa coupling to tau leptons with the ATLAS detector

Results of a search for H → τ τ decays are presented, based on the full set of proton-proton collision data recorded by the ATLAS experiment at the LHC during 2011 and 2012. The data correspond to integrated luminosities of 4.5 fb−1 and 20.3 fb−1 at centre-of-mass energies of √s = 7 TeV and √s = 8 TeV respectively. All combinations of leptonic (τ → `νν¯ with ` = e, µ) and hadronic (τ → hadrons ν) tau decays are considered. An excess of events over the expected background from other Standard Model processes is found with an observed (expected) significance of 4.5 (3.4) standard deviations. This excess provides evidence for the direct coupling of the recently discovered Higgs boson to fermions. The measured signal strength, normalised to the Standard Model expectation, of µ = 1.43 +0.43 −0.37 is consistent with the predicted Yukawa coupling strength in the Standard Model

Prognostic model to predict postoperative acute kidney injury in patients undergoing major gastrointestinal surgery based on a national prospective observational cohort study.

Background: Acute illness, existing co-morbidities and surgical stress response can all contribute to postoperative acute kidney injury (AKI) in patients undergoing major gastrointestinal surgery. The aim of this study was prospectively to develop a pragmatic prognostic model to stratify patients according to risk of developing AKI after major gastrointestinal surgery. Methods: This prospective multicentre cohort study included consecutive adults undergoing elective or emergency gastrointestinal resection, liver resection or stoma reversal in 2-week blocks over a continuous 3-month period. The primary outcome was the rate of AKI within 7 days of surgery. Bootstrap stability was used to select clinically plausible risk factors into the model. Internal model validation was carried out by bootstrap validation. Results: A total of 4544 patients were included across 173 centres in the UK and Ireland. The overall rate of AKI was 14·2 per cent (646 of 4544) and the 30-day mortality rate was 1·8 per cent (84 of 4544). Stage 1 AKI was significantly associated with 30-day mortality (unadjusted odds ratio 7·61, 95 per cent c.i. 4·49 to 12·90; P < 0·001), with increasing odds of death with each AKI stage. Six variables were selected for inclusion in the prognostic model: age, sex, ASA grade, preoperative estimated glomerular filtration rate, planned open surgery and preoperative use of either an angiotensin-converting enzyme inhibitor or an angiotensin receptor blocker. Internal validation demonstrated good model discrimination (c-statistic 0·65). Discussion: Following major gastrointestinal surgery, AKI occurred in one in seven patients. This preoperative prognostic model identified patients at high risk of postoperative AKI. Validation in an independent data set is required to ensure generalizability

Multi-messenger observations of a binary neutron star merger

On 2017 August 17 a binary neutron star coalescence candidate (later designated GW170817) with merger time 12:41:04 UTC was observed through gravitational waves by the Advanced LIGO and Advanced Virgo detectors. The Fermi Gamma-ray Burst Monitor independently detected a gamma-ray burst (GRB 170817A) with a time delay of ~1.7 s with respect to the merger time. From the gravitational-wave signal, the source was initially localized to a sky region of 31 deg2 at a luminosity distance of 40+8-8 Mpc and with component masses consistent with neutron stars. The component masses were later measured to be in the range 0.86 to 2.26 Mo. An extensive observing campaign was launched across the electromagnetic spectrum leading to the discovery of a bright optical transient (SSS17a, now with the IAU identification of AT 2017gfo) in NGC 4993 (at ~40 Mpc) less than 11 hours after the merger by the One- Meter, Two Hemisphere (1M2H) team using the 1 m Swope Telescope. The optical transient was independently detected by multiple teams within an hour. Subsequent observations targeted the object and its environment. Early ultraviolet observations revealed a blue transient that faded within 48 hours. Optical and infrared observations showed a redward evolution over ~10 days. Following early non-detections, X-ray and radio emission were discovered at the transient’s position ~9 and ~16 days, respectively, after the merger. Both the X-ray and radio emission likely arise from a physical process that is distinct from the one that generates the UV/optical/near-infrared emission. No ultra-high-energy gamma-rays and no neutrino candidates consistent with the source were found in follow-up searches. These observations support the hypothesis that GW170817 was produced by the merger of two neutron stars in NGC4993 followed by a short gamma-ray burst (GRB 170817A) and a kilonova/macronova powered by the radioactive decay of r-process nuclei synthesized in the ejecta

Search for a high-mass Higgs boson decaying to a W boson pair in pp collisions at √s = 8 TeV with the ATLAS detector

A search for a high-mass Higgs boson H is performed in the H → WW → ℓνℓν and H → WW → ℓνqq decay channels using pp collision data corresponding to an integrated luminosity of 20.3 fb−¹ collected at √s = 8 TeV by the ATLAS detector at the Large Hadron Collider. No evidence of a high-mass Higgs boson is found. Limits on σH × BR(H → WW) as a function of the Higgs boson mass mH are determined in three different scenarios: one in which the heavy Higgs boson has a narrow width compared to the experimental resolution, one for a width increasing with the boson mass and modeled by the complex-pole scheme following the same behavior as in the Standard Model, and one for intermediate widths. The upper range of the search is mH = 1500 GeV for the narrow-width scenario and mH = 1000 GeV for the other two scenarios. The lower edge of the search range is 200–300 GeV and depends on the analysis channel and search scenario. For each signal interpretation, individual and combined limits from the two WW decay channels are presented. At mH = 1500 GeV, the highest-mass point tested, σH × BR(H → WW) for a narrow-width Higgs boson is constrained to be less than 22 fb and 6.6 fb at 95% CL for the gluon fusion and vector-boson fusion production modes, respectively

Searches for the Zγ decay mode of the Higgs boson and for new high-mass resonances in pp collisions at √s=13 TeV with the ATLAS detector

This article presents searches for the Zγ decay of the Higgs boson and for narrow high-mass resonances decaying to Zγ, exploiting Z boson decays to pairs of electrons or muons. The data analysis uses 36.1 fb−1 of pp collisions at √s=13 recorded by the ATLAS detector at the CERN Large Hadron Collider. The data are found to be consistent with the expected Standard Model background. The observed (expected — assuming Standard Model pp → H → Zγ production and decay) upper limit on the production cross section times the branching ratio for pp → H → Zγ is 6.6. (5.2) times the Standard Model prediction at the 95% confidence level for a Higgs boson mass of 125.09 GeV. In addition, upper limits are set on the production cross section times the branching ratio as a function of the mass of a narrow resonance between 250 GeV and 2.4 TeV, assuming spin-0 resonances produced via gluon-gluon fusion, and spin-2 resonances produced via gluon-gluon or quark-antiquark initial states. For high-mass spin-0 resonances, the observed (expected) limits vary between 88 fb (61 fb) and 2.8 fb (2.7 fb) for the mass range from 250 GeV to 2.4 TeV at the 95% confidence level

Measurement of the Higgs boson coupling properties in the H → ZZ* → 4 decay channel at √s = 13 TeV with the ATLAS detector

The coupling properties of the Higgs boson are studied in the four-lepton (e, μ) decay channel using 36.1 fb−1 of pp collision data from the LHC at a centre-of-mass energy of 13 TeV collected by the ATLAS detector. Cross sections are measured for the main production modes in several exclusive regions of the Higgs boson production phase space and are interpreted in terms of coupling modifiers. The inclusive cross section times branching ratio for H → ZZ∗ decay and for a Higgs boson absolute rapidity below 2.5 is measured to be 1. 73 − 0.23 + 0.24 (stat.) − 0.08 + 0.10 (exp.) ± 0.04(th.) pb compared to the Standard Model prediction of 1.34±0.09 pb. In addition, the tensor structure of the Higgs boson couplings is studied using an effective Lagrangian approach for the description of interactions beyond the Standard Model. Constraints are placed on the non-Standard-Model CP-even and CP-odd couplings to Z bosons and on the CP-odd coupling to gluons

Pan-cancer analysis of whole genomes

Cancer is driven by genetic change, and the advent of massively parallel sequencing has enabled systematic documentation of this variation at the whole-genome scale(1-3). Here we report the integrative analysis of 2,658 whole-cancer genomes and their matching normal tissues across 38 tumour types from the Pan-Cancer Analysis of Whole Genomes (PCAWG) Consortium of the International Cancer Genome Consortium (ICGC) and The Cancer Genome Atlas (TCGA). We describe the generation of the PCAWG resource, facilitated by international data sharing using compute clouds. On average, cancer genomes contained 4-5 driver mutations when combining coding and non-coding genomic elements; however, in around 5% of cases no drivers were identified, suggesting that cancer driver discovery is not yet complete. Chromothripsis, in which many clustered structural variants arise in a single catastrophic event, is frequently an early event in tumour evolution; in acral melanoma, for example, these events precede most somatic point mutations and affect several cancer-associated genes simultaneously. Cancers with abnormal telomere maintenance often originate from tissues with low replicative activity and show several mechanisms of preventing telomere attrition to critical levels. Common and rare germline variants affect patterns of somatic mutation, including point mutations, structural variants and somatic retrotransposition. A collection of papers from the PCAWG Consortium describes non-coding mutations that drive cancer beyond those in the TERT promoter(4); identifies new signatures of mutational processes that cause base substitutions, small insertions and deletions and structural variation(5,6); analyses timings and patterns of tumour evolution(7); describes the diverse transcriptional consequences of somatic mutation on splicing, expression levels, fusion genes and promoter activity(8,9); and evaluates a range of more-specialized features of cancer genomes(8,10-18).Peer reviewe