Feature calibration for computer models

Computer model calibration involves using partial and imperfect observations of the real world to learn which values of a model's input parameters lead to outputs that are consistent with real-world observations. When calibrating models with high-dimensional output (e.g. a spatial field), it is common to represent the output as a linear combination of a small set of basis vectors. Often, when trying to calibrate to such output, what is important to the credibility of the model is that key emergent physical phenomena are represented, even if not faithfully or in the right place. In these cases, comparison of model output and data in a linear subspace is inappropriate and will usually lead to poor model calibration. To overcome this, we present kernel-based history matching (KHM), generalising the meaning of the technique sufficiently to be able to project model outputs and observations into a higher-dimensional feature space, where patterns can be compared without their location necessarily being fixed. We develop the technical methodology, present an expert-driven kernel selection algorithm, and then apply the techniques to the calibration of boundary layer clouds for the French climate model IPSL-CM.Comment: 50 page

High sensitivity of tropical precipitation to local sea-surface temperature

Precipitation and atmospheric circulation are the coupled processes through which tropical ocean surface temperatures drive global weather and climate. Local ocean surface warming tends to increase precipitation, but this local control is hard to disentangle from remote effects of conditions elsewhere. Such remote effects occur, for example, from El Niño Southern Oscillation (ENSO) events in the equatorial Pacific, which alter precipitation across the tropics. Atmospheric circulations associated with tropical precipitation are predominantly deep, extending up to the tropopause. Shallow atmospheric circulations impacting the lower troposphere also occur, but the importance of their interaction with precipitation is unclear. Uncertainty in precipitation observations and limited observations of shallow circulations11 further obstruct understanding of the ocean’s influence on weather and climate. Despite decades of research, persistent biases remain in many numerical model simulations, including excessively wide tropical rainbands, the ‘double-intertropical convergence zone (ITCZ) problem’ and too-weak responses to ENSO. These demonstrate stubborn gaps in our understanding, reducing confidence in forecasts and projections. Here we show that the real world has a high sensitivity of seasonal tropical precipitation to local sea-surface temperature. Our best observational estimate is 80% precipitation change per g/kg change in the saturation specific humidity (itself a function of the ocean surface temperature). This observed sensitivity is higher than in 43 of the 47 climate models studied, and is associated with strong shallow circulations. Models with more realistic sensitivity have smaller biases across a wide range of metrics. Our results apply to both temporal and spatial variation, over regions where climatological precipitation is around 1 millimetre per day or greater. Novel analysis of multiple independent observations, physical constraints and model data, underpin these findings. The spread in model behaviour is further linked to differences in shallow convection, providing a focus for accelerated research, to improve seasonal forecasts through multidecadal climate projections

Radiative Flux and Forcing Parameterization Error in Aerosol-Free Clear Skies

This article reports on the accuracy in aerosol- and cloud-free conditions of the radiation parameterizations used in climate models. Accuracy is assessed relative to observationally validated reference models for fluxes under present-day conditions and forcing (flux changes) from quadrupled concentrations of carbon dioxide. Agreement among reference models is typically within 1 W/m2, while parameterized calculations are roughly half as accurate in the longwave and even less accurate, and more variable, in the shortwave. Absorption of shortwave radiation is underestimated by most parameterizations in the present day and has relatively large errors in forcing. Error in present-day conditions is essentially unrelated to error in forcing calculations. Recent revisions to parameterizations have reduced error in most cases. A dependence on atmospheric conditions, including integrated water vapor, means that global estimates of parameterization error relevant for the radiative forcing of climate change will require much more ambitious calculations

Evaluating climate models with the CLIVAR 2020 ENSO Metrics Package

El Niño–Southern Oscillation (ENSO) is the dominant mode of interannual climate variability on the planet, with far-reaching global impacts. It is therefore key to evaluate ENSO simulations in state-of-the-art numerical models used to study past, present, and future climate. Recently, the Pacific Region Panel of the International Climate and Ocean: Variability, Predictability and Change (CLIVAR) Project, as a part of the World Climate Research Programme (WCRP), led a community-wide effort to evaluate the simulation of ENSO variability, teleconnections, and processes in climate models. The new CLIVAR 2020 ENSO metrics package enables model diagnosis, comparison, and evaluation to 1) highlight aspects that need improvement; 2) monitor progress across model generations; 3) help in selecting models that are well suited for particular analyses; 4) reveal links between various model biases, illuminating the impacts of those biases on ENSO and its sensitivity to climate change; and to 5) advance ENSO literacy. By interfacing with existing model evaluation tools, the ENSO metrics package enables rapid analysis of multipetabyte databases of simulations, such as those generated by the Coupled Model Intercomparison Project phases 5 (CMIP5) and 6 (CMIP6). The CMIP6 models are found to significantly outperform those from CMIP5 for 8 out of 24 ENSO-relevant metrics, with most CMIP6 models showing improved tropical Pacific seasonality and ENSO teleconnections. Only one ENSO metric is significantly degraded in CMIP6, namely, the coupling between the ocean surface and subsurface temperature anomalies, while the majority of metrics remain unchanged

Inter-model comparison of sub-seasonal tropical variability in aquaplanet experimets: effect of a warm pool

This study compares the simulation of sub-seasonal tropical variability by a set of six state-of-the-art AGCMs in two experiments in aqua-planet configuration: a zonally-symmetric experiment, and an experiment with a warm pool centered on the equator. In all six models, the presence of the warm pool generates zonal asymmetries in the simulated mean states in the form of a “Gill-type” response, made more complex by feedbacks between moisture, convective heating and circulation. Noticeable differences appear from one model to another. Only half the models simulate mean low-level equatorial westerlies over the warm pool area. The presence of the warm pool can also favor the development of large-scale variability consistent with observed Madden-Julian Oscillation (MJO) characteristics, but this happens only in half the models. Our results do not support the idea that the presence of the warm pool and/or of mean low-level equatorial westerlies are sufficient conditions for MJO-like variability to arise in the models. Comparing spectral characteristics of the simulated Convectively Coupled Equatorial Waves (CCEWs) in the aquaplanet experiments and the corresponding coupled atmosphere-ocean (i.e. CMIP) and atmosphere-only (i.e. AMIP) simulations, we also show that there is more consistency for a given model across its configurations, than for a given configuration across the six models. Overall, our results confirm that the simulation of sub-seasonal variability by given model is significantly influenced by the parameterization of sub-grid physical processes (most-likely cloud processes), both directly and through modulation of the mean state

The tropical rain belts with an annual cycle and a continent model intercomparison project: TRACMIP

This paper introduces the Tropical Rain belts with an Annual cycle and a Continent Model Intercomparison Project (TRACMIP). TRACMIP studies the dynamics of tropical rain belts and their response to past and future radiative forcings through simulations with 13 comprehensive and one simplified atmosphere models coupled to a slab ocean and driven by seasonally-varying insolation. Five idealised experiments, two with an aquaplanet setup and three with a setup with an idealized tropical continent, fill the space between prescribed-SST aquaplanet simulations and realistic simulations provided by CMIP5/6. The simulations reproduce key features of present-day climate and expected future climate change, including an annual-mean intertropical convergence zone (ITCZ) that is located north of the equator and Hadley cells and eddy-driven jets that are similar to present-day climate. Quadrupling CO2 leads to a northward ITCZ shift and preferential warming in Northern high-latitudes. The simulations show interesting CO2-induced changes in the seasonal excursion of the ITCZ and indicate a possible state-dependence of climate sensitivity. The inclusion of an idealized continent modulates both the control climate and the response to increased CO2; for example, it reduces the northward ITCZ shift associated with warming and, in some models, climate sensitivity. In response to eccentricity-driven orbital seasonal insolation changes, seasonal changes in oceanic rainfall are best characterized as a meridional dipole, while seasonal continental rainfall changes tend to be symmetric about the equator. This survey illustrates TRACMIP's potential to engender a deeper understanding of global and regional climate and to address questions on past and future climate

ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP

A community diagnostics and performance metrics tool for the evaluation of Earth system models (ESMs) has been developed that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. The priority of the effort so far has been to target specific scientific themes focusing on selected essential climate variables (ECVs), a range of known systematic biases common to ESMs, such as coupled tropical climate variability, monsoons, Southern Ocean processes, continental dry biases, and soil hydrology–climate interactions, as well as atmospheric CO2 budgets, tropospheric and stratospheric ozone, and tropospheric aerosols. The tool is being developed in such a way that additional analyses can easily be added. A set of standard namelists for each scientific topic reproduces specific sets of diagnostics or performance metrics that have demonstrated their importance in ESM evaluation in the peer-reviewed literature. The Earth System Model Evaluation Tool (ESMValTool) is a community effort open to both users and developers encouraging open exchange of diagnostic source code and evaluation results from the Coupled Model Intercomparison Project (CMIP) ensemble. This will facilitate and improve ESM evaluation beyond the state-of-the-art and aims at supporting such activities within CMIP and at individual modelling centres. Ultimately, we envisage running the ESMValTool alongside the Earth System Grid Federation (ESGF) as part of a more routine evaluation of CMIP model simulations while utilizing observations available in standard formats (obs4MIPs) or provided by the user

Clouds and convective self-aggregation in a multi-model ensemble of radiative-convective equilibrium simulations

The Radiative-Convective Equilibrium Model Intercomparison Project (RCEMIP) is an intercomparison of multiple types of numerical models configured in radiative-convective equilibrium (RCE). RCE is an idealization of the tropical atmosphere that has long been used to study basic questions in climate science. Here, we employ RCE to investigate the role that clouds and convective activity play in determining cloud feedbacks, climate sensitivity, the state of convective aggregation, and the equilibrium climate. RCEMIP is unique amongst intercomparisons in its inclusion of a wide range of model types, including atmospheric general circulation models (GCMs), single column models (SCMs), cloud-resolving models (CRMs), large eddy simulations (LES), and global cloud-resolving models (GCRMs). The first results are presented from the RCEMIP ensemble of more than 30 models. While there are large differences across the RCEMIP ensemble in the representation of mean profiles of temperature, humidity, and cloudiness, in a majority of models anvil clouds rise, warm, and decrease in area coverage in response to an increase in sea surface temperature (SST). Nearly all models exhibit self-aggregation in large domains and agree that self-aggregation acts to dry and warm the troposphere, reduce high cloudiness, and increase cooling to space. The degree of self-aggregation exhibits no clear tendency with warming. There is a wide range of climate sensitivities, but models with parameterized convection tend to have lower climate sensitivities than models with explicit convection. In models with parameterized convection, aggregated simulations have lower climate sensitivities than un-aggregated simulations