ConfusionFlow: A Model-Agnostic Visualization for Temporal Analysis of Classifier Confusion

Classifiers are among the most widely used supervised machine learning algorithms. Many classification models exist, and choosing the right one for a given task is difficult. During model selection and debugging, data scientists need to assess classifiers' performances, evaluate their learning behavior over time, and compare different models. Typically, this analysis is based on single-number performance measures such as accuracy. A more detailed evaluation of classifiers is possible by inspecting class errors. The confusion matrix is an established way for visualizing these class errors, but it was not designed with temporal or comparative analysis in mind. More generally, established performance analysis systems do not allow a combined temporal and comparative analysis of class-level information. To address this issue, we propose ConfusionFlow, an interactive, comparative visualization tool that combines the benefits of class confusion matrices with the visualization of performance characteristics over time. ConfusionFlow is model-agnostic and can be used to compare performances for different model types, model architectures, and/or training and test datasets. We demonstrate the usefulness of ConfusionFlow in a case study on instance selection strategies in active learning. We further assess the scalability of ConfusionFlow and present a use case in the context of neural network pruning

Drag-Based CME Modeling With Heliospheric Images Incorporating Frontal Deformation : ELEvoHI 2.0

The evolution and propagation of coronal mass ejections (CMEs) in interplanetary space is still not well understood. As a consequence, accurate arrival time and arrival speed forecasts are an unsolved problem in space weather research. In this study, we present the ELlipse Evolution model based on HI observations (ELEvoHI) and introduce a deformable front to this model. ELEvoHI relies on heliospheric imagers (HI) observations to obtain the kinematics of a CME. With the newly developed deformable front, the model is able to react to the ambient solar wind conditions during the entire propagation and along the whole front of the CME. To get an estimate of the ambient solar wind conditions, we make use of three different models: Heliospheric Upwind eXtrapolation model (HUX), Heliospheric Upwind eXtrapolation with time dependence model (HUXt), and EUropean Heliospheric FORecasting Information Asset (EUHFORIA). We test the deformable front on a CME first observed in STEREO-A/HI on February 3, 2010 14:49 UT. For this case study, the deformable front provides better estimates of the arrival time and arrival speed than the original version of ELEvoHI using an elliptical front. The new implementation enables us to study the parameters influencing the propagation of the CME not only for the apex, but for the entire front. The evolution of the CME front, especially at the flanks, is highly dependent on the ambient solar wind model used. An additional advantage of the new implementation is given by the possibility to provide estimates of the CME mass.Peer reviewe

Prediction of the in situ coronal mass ejection rate for solar cycle 25: Implications for Parker Solar Probe in situ observations

The Parker Solar Probe (PSP) and Solar Orbiter missions are designed to make groundbreaking observations of the Sun and interplanetary space within this decade. We show that a particularly interesting in situ observation of an interplanetary coronal mass ejection (ICME) by PSP may arise during close solar flybys ($< 0.1$~AU). During these times, the same magnetic flux rope inside an ICME could be observed in situ by PSP twice, by impacting its frontal part as well as its leg. Investigating the odds of this situation, we forecast the ICME rate in solar cycle 25 based on 2 models for the sunspot number (SSN): (1) the forecast of an expert panel in 2019 (maximum SSN = 115), and (2) a prediction by McIntosh et al. (2020, maximum SSN = 232). We link the SSN to the observed ICME rates in solar cycles 23 and 24 with the Richardson and Cane list and our own ICME catalog, and calculate that between 1 and 7 ICMEs will be observed by PSP at heliocentric distances $< 0.1$ AU until 2025, including 1$\sigma$ uncertainties. We then model the potential flux rope signatures of such a double-crossing event with the semi-empirical 3DCORE flux rope model, showing a telltale elevation of the radial magnetic field component $B_R$, and a sign reversal in the component $B_N$ normal to the solar equator compared to field rotation in the first encounter. This holds considerable promise to determine the structure of CMEs close to their origin in the solar corona.Comment: 11 pages, 6 figures, accepted for publication in the Astrophysical Journal on 2020 September 1

Quantifying errors in 3D CME parameters derived from synthetic data using white-light reconstruction techniques

Current efforts in space weather forecasting of CMEs have been focused on predicting their arrival time and magnetic structure. To make these predictions, methods have been developed to derive the true CME speed, size, position, and mass, among others. Difficulties in determining the input parameters for CME forecasting models arise from the lack of direct measurements of the coronal magnetic fields and uncertainties in estimating the CME 3D geometric and kinematic parameters after eruption. White-light coronagraph images are usually employed by a variety of CME reconstruction techniques that assume more or less complex geometries. This is the first study from our International Space Science Institute (ISSI) team “Understanding Our Capabilities in Observing and Modeling Coronal Mass Ejections”, in which we explore how subjectivity affects the 3D CME parameters that are obtained from the Graduated Cylindrical Shell (GCS) reconstruction technique, which is widely used in CME research. To be able to quantify such uncertainties, the “true” values that are being fitted should be known, which are impossible to derive from observational data. We have designed two different synthetic scenarios where the “true” geometric parameters are known in order to quantify such uncertainties for the first time. We explore this by using two sets of synthetic data: 1) Using the ray-tracing option from the GCS model software itself, and 2) Using 3D magnetohydrodynamic (MHD) simulation data from the Magnetohydrodynamic Algorithm outside a Sphere code. Our experiment includes different viewing configurations using single and multiple viewpoints. CME reconstructions using a single viewpoint had the largest errors and error ranges overall for both synthetic GCS and simulated MHD white-light data. As the number of viewpoints increased from one to two, the errors decreased by approximately 4° in latitude, 22° in longitude, 14° in tilt, and 10° in half-angle. Our results quantitatively show the critical need for at least two viewpoints to be able to reduce the uncertainty in deriving CME parameters. We did not find a significant decrease in errors when going from two to three viewpoints for our specific hypothetical three spacecraft scenario using synthetic GCS white-light data. As we expected, considering all configurations and numbers of viewpoints, the mean absolute errors in the measured CME parameters are generally significantly higher in the case of the simulated MHD white-light data compared to those from the synthetic white-light images generated by the GCS model. We found the following CME parameter error bars as a starting point for quantifying the minimum error in CME parameters from white-light reconstructions: Δθ (latitude)=6°-3°+2°, Δϕ (longitude)=11°-6°+18°, Δγ (tilt)=25°-7°+8°, Δα(half-angle)=10°-6°+12°, Δh (height)=0.6-0.4+1.2 R⊙, and Δκ (ratio)=0.1-0.02+0.03.Fil: Verbeke, Christine. Royal Observatory Of Belgium (rob);Fil: Mays, M. Leila. NASA Goddard Space Flight Center. Heliophysics Science Division; Estados UnidosFil: Kay, Christina. NASA Goddard Space Flight Center. Heliophysics Science Division; Estados Unidos. The Catholic University of America; Estados UnidosFil: Riley, Pete. Predictive Science Inc.; Estados UnidosFil: Palmerio, Erika. Predictive Science Inc.; Estados UnidosFil: Dumbović, Mateja. University of Zagreb; CroaciaFil: Mierla, Marilena. Institute of Geodynamics of the Romanian Academy; Rumania. Royal Observatory of Belgium; BélgicaFil: Scolini, Camilla. University of New Hampshire; Estados Unidos. University Corporation for Atmospheric Research; Estados UnidosFil: Temmer, Manuela. University of Graz; AustriaFil: Paouris, Evangelos. George Mason University; Estados Unidos. University Johns Hopkins; Estados UnidosFil: Balmaceda, Laura Antonia. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Ciencias Astronómicas, de la Tierra y del Espacio. Universidad Nacional de San Juan. Instituto de Ciencias Astronómicas, de la Tierra y del Espacio; Argentina. George Mason University; Estados Unidos. NASA Goddard Space Flight Center; Estados UnidosFil: Cremades Fernandez, Maria Hebe. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mendoza; Argentina. Universidad de Mendoza; ArgentinaFil: Hinterreiter, Jürgen. University of Graz; Austri

Forecasting the ambient solar wind with numerical models. II. An adaptive prediction system for specifying solar wind speed near the Sun

The ambient solar wind flows and fields influence the complex propagation dynamics of coronal mass ejections in the interplanetary medium and play an essential role in shaping Earth's space weather environment. A critical scientific goal in the space weather research and prediction community is to develop, implement, and optimize numerical models for specifying the large-scale properties of solar wind conditions at the inner boundary of the heliospheric model domain. Here we present an adaptive prediction system that fuses information from in situ measurements of the solar wind into numerical models to better match the global solar wind model solutions near the Sun with prevailing physical conditions in the vicinity of Earth. In this way, we attempt to advance the predictive capabilities of well-established solar wind models for specifying solar wind speed, including the Wang–Sheeley–Arge model. In particular, we use the Heliospheric Upwind eXtrapolation (HUX) model for mapping the solar wind solutions from the near-Sun environment to the vicinity of Earth. In addition, we present the newly developed Tunable HUX (THUX) model, which solves the viscous form of the underlying Burgers equation. We perform a statistical analysis of the resulting solar wind predictions for the period 2006–2015. The proposed prediction scheme improves all the investigated coronal/heliospheric model combinations and produces better estimates of the solar wind state at Earth than our reference baseline model. We discuss why this is the case and conclude that our findings have important implications for future practice in applied space weather research and prediction