Critical issues in ionospheric data quality and implications for scientific studies

Ionospheric data are valuable records of the behavior of the ionosphere, solar activity, and the entire Sun-Earth system. The data are critical for both societally important services and scientific investigations of upper atmospheric variability. This work investigates some of the difficulties and pitfalls in maintaining long-term records of geophysical measurements. This investigation focuses on the ionospheric parameters contained in the historical data sets within the National Oceanic and Atmospheric Administration National Geophysical Data Center and Space Physics Interactive Data Resource databases. These archives include data from approximately 100 ionosonde stations worldwide, beginning in the early 1940s. Our study focuses on the quality and consistency of ionosonde data accessible via the primary Space Physics Interactive Data Resource node located within the National Oceanic and Atmospheric Administration National Geophysical Data Center and the World Data Center for Solar-Terrestrial Physics located in Boulder, Colorado. We find that, although the Space Physics Interactive Data Resource archives contained an impressive amount of high-quality data, specific problems existed involving missing and noncontiguous data sets, long-term variations or changes in methodologies and analysis procedures used, and incomplete documentation. The important lessons learned from this investigation are that the data incorporated into an archive must have clear traceability back to the primary source, including scientific validation by the contributors, and that the historical records must have associated metadata that describe relevant nuances in the observations. Although this report only focuses on historical ionosonde data in National Oceanic and Atmospheric Administration databases, we feel that these findings have general applicability to environmental scientists interested in using long-term geophysical data sets for climate and global change research.Peer ReviewedPostprint (published version

SORCE and TSIS-1 SIM Comparison: Absolute Irradiance Scale Reconciliation

The Solar Radiation and Climate Experiment (SORCE) and Total and Spectral Irradiance Sensor (TSIS-1) conducted an intercomparison for the two Spectral Irradiance Monitors (SIM) spanning 704&nbsp;days from 23 March 2018 to 25 February 2020 and permitted 554 time-matched pairs of observations. This comparison was conducted during the extremely quiescent Solar Cycle 24 minimum, so all observed differences and drifts between the two sensors are instrumental in nature. The TSIS-1 SIM benefitted from advanced calibration capabilities based on SI standards that were not available during the preflight calibration time period of SORCE. For this reason, a revision of the SORCE SIM absolute scale is appropriate. As expected, wavelength dependent differences in absolute agreement are a function of detector sensitivity and local changes in spectral slope. At the time of the comparison SORCE SIM has been on-orbit for 17&nbsp;years while TSIS-1 observations commenced immediately after a 100-day outgassing and commissioning period. Peak-to-peak absolute scale differences are about 12% with a mean fractional difference of 0.7%&nbsp;&plusmn;&nbsp;2.9%. The greatest scale differences occur at the change-over between the UV and visible photodiodes in the 310&nbsp;nm region, and a systematic disagreement is present in the 850&ndash;1,600&nbsp;nm range. A multiplicative scale correction factor has been developed to reconcile the TSIS-1 and SORCE difference with a wavelength dependent error on the mean typically less than 0.01% derived from every matched pair of observations. &nbsp;</p

From Predicting Solar Activity to Forecasting Space Weather: Practical Examples of Research-to-Operations and Operations-to-Research

The successful transition of research to operations (R2O) and operations to research (O2R) requires, above all, interaction between the two communities. We explore the role that close interaction and ongoing communication played in the successful fielding of three separate developments: an observation platform, a numerical model, and a visualization and specification tool. Additionally, we will examine how these three pieces came together to revolutionize interplanetary coronal mass ejection (ICME) arrival forecasts. A discussion of the importance of education and training in ensuring a positive outcome from R2O activity follows. We describe efforts by the meteorological community to make research results more accessible to forecasters and the applicability of these efforts to the transfer of space-weather research.We end with a forecaster "wish list" for R2O transitions. Ongoing, two-way communication between the research and operations communities is the thread connecting it all.Comment: 18 pages, 3 figures, Solar Physics in pres

Progress in space weather modeling in an operational environment

YesThis paper aims at providing an overview of latest advances in space weather modeling in an operational environment in Europe, including both the introduction of new models and improvements to existing codes and algorithms that address the broad range of space weather's prediction requirements from the Sun to the Earth. For each case, we consider the model's input data, the output parameters, products or services, its operational status, and whether it is supported by validation results, in order to build a solid basis for future developments. This work is the output of the Sub Group 1.3 "Improvement of operational models'' of the European Cooperation in Science and Technology (COST) Action ES0803 "Developing Space Weather Products and services in Europe'' and therefore this review focuses on the progress achieved by European research teams involved in the action