Towards Guidelines for Assessing Qualities of Machine Learning Systems

Nowadays, systems containing components based on machine learning (ML) methods are becoming more widespread. In order to ensure the intended behavior of a software system, there are standards that define necessary quality aspects of the system and its components (such as ISO/IEC 25010). Due to the different nature of ML, we have to adjust quality aspects or add additional ones (such as trustworthiness) and be very precise about which aspect is really relevant for which object of interest (such as completeness of training data), and how to objectively assess adherence to quality requirements. In this article, we present the construction of a quality model (i.e., evaluation objects, quality aspects, and metrics) for an ML system based on an industrial use case. This quality model enables practitioners to specify and assess quality requirements for such kinds of ML systems objectively. In the future, we want to learn how the term quality differs between different types of ML systems and come up with general guidelines for specifying and assessing qualities of ML systems.Comment: Has been accepted at the 13th International Conference on the Quality of Information and Communications Technology QUATIC2020 (https://2020.quatic.org/). QUATIC 2020 proceedings will be included in a volume of Springer CCIS Series (Communications in Computer and Information Science

Search for non-relativistic Magnetic Monopoles with IceCube

The IceCube Neutrino Observatory is a large Cherenkov detector instrumenting $1\,\mathrm{km}^3$ of Antarctic ice. The detector can be used to search for signatures of particle physics beyond the Standard Model. Here, we describe the search for non-relativistic, magnetic monopoles as remnants of the GUT (Grand Unified Theory) era shortly after the Big Bang. These monopoles may catalyze the decay of nucleons via the Rubakov-Callan effect with a cross section suggested to be in the range of $10^{-27}\,\mathrm{cm^2}$ to $10^{-21}\,\mathrm{cm^2}$. In IceCube, the Cherenkov light from nucleon decays along the monopole trajectory would produce a characteristic hit pattern. This paper presents the results of an analysis of first data taken from May 2011 until May 2012 with a dedicated slow-particle trigger for DeepCore, a subdetector of IceCube. A second analysis provides better sensitivity for the brightest non-relativistic monopoles using data taken from May 2009 until May 2010. In both analyses no monopole signal was observed. For catalysis cross sections of $10^{-22}\,(10^{-24})\,\mathrm{cm^2}$ the flux of non-relativistic GUT monopoles is constrained up to a level of $\Phi_{90} \le 10^{-18}\,(10^{-17})\,\mathrm{cm^{-2}s^{-1}sr^{-1}}$ at a 90% confidence level, which is three orders of magnitude below the Parker bound. The limits assume a dominant decay of the proton into a positron and a neutral pion. These results improve the current best experimental limits by one to two orders of magnitude, for a wide range of assumed speeds and catalysis cross sections.Comment: 20 pages, 20 figure

A combined maximum-likelihood analysis of the high-energy astrophysical neutrino flux measured with IceCube

Evidence for an extraterrestrial flux of high-energy neutrinos has now been found in multiple searches with the IceCube detector. The first solid evidence was provided by a search for neutrino events with deposited energies $\gtrsim30$ TeV and interaction vertices inside the instrumented volume. Recent analyses suggest that the extraterrestrial flux extends to lower energies and is also visible with throughgoing, $\nu_\mu$-induced tracks from the Northern hemisphere. Here, we combine the results from six different IceCube searches for astrophysical neutrinos in a maximum-likelihood analysis. The combined event sample features high-statistics samples of shower-like and track-like events. The data are fit in up to three observables: energy, zenith angle and event topology. Assuming the astrophysical neutrino flux to be isotropic and to consist of equal flavors at Earth, the all-flavor spectrum with neutrino energies between 25 TeV and 2.8 PeV is well described by an unbroken power law with best-fit spectral index $-2.50\pm0.09$ and a flux at 100 TeV of $\left(6.7_{-1.2}^{+1.1}\right)\cdot10^{-18}\,\mathrm{GeV}^{-1}\mathrm{s}^{-1}\mathrm{sr}^{-1}\mathrm{cm}^{-2}$. Under the same assumptions, an unbroken power law with index $-2$ is disfavored with a significance of 3.8 $\sigma$ ($p=0.0066\%$) with respect to the best fit. This significance is reduced to 2.1 $\sigma$ ($p=1.7\%$) if instead we compare the best fit to a spectrum with index $-2$ that has an exponential cut-off at high energies. Allowing the electron neutrino flux to deviate from the other two flavors, we find a $\nu_e$ fraction of $0.18\pm0.11$ at Earth. The sole production of electron neutrinos, which would be characteristic of neutron-decay dominated sources, is rejected with a significance of 3.6 $\sigma$ ($p=0.014\%$).Comment: 16 pages, 10 figures; accepted for publication in The Astrophysical Journal; updated one referenc

The IceCube Neutrino Observatory - Contributions to ICRC 2015 Part II: Atmospheric and Astrophysical Diffuse Neutrino Searches of All Flavors

Papers on atmospheric and astrophysical diffuse neutrino searches of all flavors submitted to the 34th International Cosmic Ray Conference (ICRC 2015, The Hague) by the IceCube Collaboration.Comment: 66 pages, 36 figures, Papers submitted to the 34th International Cosmic Ray Conference, The Hague 2015, v2 has a corrected author lis

Measurement of the Atmospheric νe\nu_e Spectrum with IceCube

We present a measurement of the atmospheric $\nu_e$ spectrum at energies between 0.1 TeV and 100 TeV using data from the first year of the complete IceCube detector. Atmospheric $\nu_e$ originate mainly from the decays of kaons produced in cosmic-ray air showers. This analysis selects 1078 fully contained events in 332 days of livetime, then identifies those consistent with particle showers. A likelihood analysis with improved event selection extends our previous measurement of the conventional $\nu_e$ fluxes to higher energies. The data constrain the conventional $\nu_e$ flux to be $1.3^{+0.4}_{-0.3}$ times a baseline prediction from a Honda's calculation, including the knee of the cosmic-ray spectrum. A fit to the kaon contribution ($\xi$) to the neutrino flux finds a kaon component that is $\xi =1.3^{+0.5}_{-0.4}$ times the baseline value. The fitted/measured prompt neutrino flux from charmed hadron decays strongly depends on the assumed astrophysical flux and shape. If the astrophysical component follows a power law, the result for the prompt flux is $0.0^{+3.0}_{-0.0}$ times a calculated flux based on the work by Enberg, Reno and Sarcevic.Comment: PRD accepted versio

Characterization of the Atmospheric Muon Flux in IceCube

Muons produced in atmospheric cosmic ray showers account for the by far dominant part of the event yield in large-volume underground particle detectors. The IceCube detector, with an instrumented volume of about a cubic kilometer, has the potential to conduct unique investigations on atmospheric muons by exploiting the large collection area and the possibility to track particles over a long distance. Through detailed reconstruction of energy deposition along the tracks, the characteristics of muon bundles can be quantified, and individual particles of exceptionally high energy identified. The data can then be used to constrain the cosmic ray primary flux and the contribution to atmospheric lepton fluxes from prompt decays of short-lived hadrons. In this paper, techniques for the extraction of physical measurements from atmospheric muon events are described and first results are presented. The multiplicity spectrum of TeV muons in cosmic ray air showers for primaries in the energy range from the knee to the ankle is derived and found to be consistent with recent results from surface detectors. The single muon energy spectrum is determined up to PeV energies and shows a clear indication for the emergence of a distinct spectral component from prompt decays of short-lived hadrons. The magnitude of the prompt flux, which should include a substantial contribution from light vector meson di-muon decays, is consistent with current theoretical predictions.Comment: 36 pages, 39 figure

Search for Relativistic Magnetic Monopoles with IceCube

We present the first results in the search for relativistic magnetic monopoles with the IceCube detector, a subsurface neutrino telescope located in the South Polar ice cap containing a volume of 1 km$^{3}$. This analysis searches data taken on the partially completed detector during 2007 when roughly 0.2 km$^{3}$ of ice was instrumented. The lack of candidate events leads to an upper limit on the flux of relativistic magnetic monopoles of \Phi_{\mathrm{90%C.L.}}\sim 3\e{-18}\fluxunits for $\beta\geq0.8$. This is a factor of 4 improvement over the previous best experimental flux limits up to a Lorentz boost $\gamma$ below $10^{7}$. This result is then interpreted for a wide range of mass and kinetic energy values.Comment: 11 pages, 11 figures. v2 is minor text edits, no changes to resul

Search for Dark Matter Annihilation in the Galactic Center with IceCube-79

The Milky Way is expected to be embedded in a halo of dark matter particles, with the highest density in the central region, and decreasing density with the halo-centric radius. Dark matter might be indirectly detectable at Earth through a flux of stable particles generated in dark matter annihilations and peaked in the direction of the Galactic Center. We present a search for an excess flux of muon (anti-) neutrinos from dark matter annihilation in the Galactic Center using the cubic-kilometer-sized IceCube neutrino detector at the South Pole. There, the Galactic Center is always seen above the horizon. Thus, new and dedicated veto techniques against atmospheric muons are required to make the southern hemisphere accessible for IceCube. We used 319.7 live-days of data from IceCube operating in its 79-string configuration during 2010 and 2011. No neutrino excess was found and the final result is compatible with the background. We present upper limits on the self-annihilation cross-section, \left, for WIMP masses ranging from 30 GeV up to 10 TeV, assuming cuspy (NFW) and flat-cored (Burkert) dark matter halo profiles, reaching down to $\simeq 4 \cdot 10^{-24}$ cm$^3$ s$^{-1}$, and $\simeq 2.6 \cdot 10^{-23}$ cm$^3$ s$^{-1}$ for the $\nu\overline{\nu}$ channel, respectively.Comment: 14 pages, 9 figures, Submitted to EPJ-C, added references, extended limit overvie