Evaluation of biospheric components in earth system models using modern and palaeo-observations: The state-of-the-art

PublishedJournal ArticleEarth system models (ESMs) are increasing in complexity by incorporating more processes than their predecessors, making them potentially important tools for studying the evolution of climate and associated biogeochemical cycles. However, their coupled behaviour has only recently been examined in any detail, and has yielded a very wide range of outcomes. For example, coupled climate-carbon cycle models that represent land-use change simulate total land carbon stores at 2100 that vary by as much as 600 Pg C, given the same emissions scenario. This large uncertainty is associated with differences in how key processes are simulated in different models, and illustrates the necessity of determining which models are most realistic using rigorous methods of model evaluation. Here we assess the state-of-the-art in evaluation of ESMs, with a particular emphasis on the simulation of the carbon cycle and associated biospheric processes. We examine some of the new advances and remaining uncertainties relating to (i) modern and palaeodata and (ii) metrics for evaluation. We note that the practice of averaging results from many models is unreliable and no substitute for proper evaluation of individual models. We discuss a range of strategies, such as the inclusion of pre-calibration, combined process-and system-level evaluation, and the use of emergent constraints, that can contribute to the development of more robust evaluation schemes. An increasingly data-rich environment offers more opportunities for model evaluation, but also presents a challenge. Improved knowledge of data uncertainties is still necessary to move the field of ESM evaluation away from a "beauty contest" towards the development of useful constraints on model outcomes. © 2013 Author(s).This paper emerged from the GREENCYCLESII mini-conference “Evaluation of Earth system models using modern and palaeo-observations” held at Clare College, Cambridge, UK, in September 2012. We would like to thank the Marie Curie FP7 Research and Training Network GREENCYCLESII for providing funding which made this meeting possible. Research leading to these results has received funding from the European Community’s Seventh Framework Programme (FP7 2007–2013) under grant agreement no. 238366. The work of C. D. Jones was supported by the Joint DECC/Defra Met Office Hadley Centre Climate Programme (GA01101). N. R. Edwards acknowledges support from FP7 grant no. 265170 (ERMITAGE). N. Vázquez Riveiros acknowledges support from the AXA Research Fund and the Newton Trust

The Earth system model CLIMBER-X v1.0 – Part 2: The global carbon cycle

The carbon cycle component of the newly developed Earth system model of intermediate complexity CLIMBER-X is presented. The model represents the cycling of carbon through the atmosphere, vegetation, soils, seawater and marine sediments. Exchanges of carbon with geological reservoirs occur through sediment burial, rock weathering and volcanic degassing. The state-of-the-art HAMOCC6 model is employed to simulate ocean biogeochemistry and marine sediment processes. The land model PALADYN simulates the processes related to vegetation and soil carbon dynamics, including permafrost and peatlands. The dust cycle in the model allows for an interactive determination of the input of the micro-nutrient iron into the ocean. A rock weathering scheme is implemented in the model, with the weathering rate depending on lithology, runoff and soil temperature. CLIMBER-X includes a simple representation of the methane cycle, with explicitly modelled natural emissions from land and the assumption of a constant residence time of CH4 in the atmosphere. Carbon isotopes 13C and 14C are tracked through all model compartments and provide a useful diagnostic for model–data comparison. A comprehensive evaluation of the model performance for the present day and the historical period shows that CLIMBER-X is capable of realistically reproducing the historical evolution of atmospheric CO2 and CH4 but also the spatial distribution of carbon on land and the 3D structure of biogeochemical ocean tracers. The analysis of model performance is complemented by an assessment of carbon cycle feedbacks and model sensitivities compared to state-of-the-art Coupled Model Intercomparison Project Phase 6 (CMIP6) models. Enabling an interactive carbon cycle in CLIMBER-X results in a relatively minor slow-down of model computational performance by ∼ 20 % compared to a throughput of ∼ 10 000 simulation years per day on a single node with 16 CPUs on a high-performance computer in a climate-only model set-up. CLIMBER-X is therefore well suited to investigating the feedbacks between climate and the carbon cycle on temporal scales ranging from decades to &gt;100 000 years.</p

Accuracy, realism and general applicability of European forest models

Forest models are instrumental for understanding and projecting the impact of climate change on forests. A considerable number of forest models have been developed in the last decades. However, few systematic and comprehensive model comparisons have been performed in Europe that combine an evaluation of modelled carbon and water fluxes and forest structure. We evaluate 13 widely used, state-of-the-art, stand-scale forest models against field measurements of forest structure and eddy-covariance data of carbon and water fluxes over multiple decades across an environmental gradient at nine typical European forest stands. We test the models\u27 performance in three dimensions: accuracy of local predictions (agreement of modelled and observed annual data), realism of environmental responses (agreement of modelled and observed responses of daily gross primary productivity to temperature, radiation and vapour pressure deficit) and general applicability (proportion of European tree species covered). We find that multiple models are available that excel according to our three dimensions of model performance. For the accuracy of local predictions, variables related to forest structure have lower random and systematic errors than annual carbon and water flux variables. Moreover, the multi-model ensemble mean provided overall more realistic daily productivity responses to environmental drivers across all sites than any single individual model. The general applicability of the models is high, as almost all models are currently able to cover Europe\u27s common tree species. We show that forest models complement each other in their response to environmental drivers and that there are several cases in which individual models outperform the model ensemble. Our framework provides a first step to capturing essential differences between forest models that go beyond the most commonly used accuracy of predictions. Overall, this study provides a point of reference for future model work aimed at predicting climate impacts and supporting climate mitigation and adaptation measures in forests

Accuracy, realism and general applicability of European forest models

Forest models are instrumental for understanding and projecting the impact of climate change on forests. A considerable number of forest models have been developed in the last decades. However, few systematic and comprehensive model comparisons have been performed in Europe that combine an evaluation of modelled carbon and water fluxes and forest structure. We evaluate 13 widely used, state-of-the-art, stand-scale forest models against field measurements of forest structure and eddy-covariance data of carbon and water fluxes over multiple decades across an environmental gradient at nine typical European forest stands. We test the models' performance in three dimensions: accuracy of local predictions (agreement of modelled and observed annual data), realism of environmental responses (agreement of modelled and observed responses of daily gross primary productivity to temperature, radiation and vapour pressure deficit) and general applicability (proportion of European tree species covered). We find that multiple models are available that excel according to our three dimensions of model performance. For the accuracy of local predictions, variables related to forest structure have lower random and systematic errors than annual carbon and water flux variables. Moreover, the multi-model ensemble mean provided overall more realistic daily productivity responses to environmental drivers across all sites than any single individual model. The general applicability of the models is high, as almost all models are currently able to cover Europe's common tree species. We show that forest models complement each other in their response to environmental drivers and that there are several cases in which individual models outperform the model ensemble. Our framework provides a first step to capturing essential differences between forest models that go beyond the most commonly used accuracy of predictions. Overall, this study provides a point of reference for future model work aimed at predicting climate impacts and supporting climate mitigation and adaptation measures in forests.Peer reviewe

A harmonized database of European forest simulations under climate change

Process-based forest models combine biological, physical, and chemical process understanding to simulate forest dynamics as an emergent property of the system. As such, they are valuable tools to investigate the effects of climate change on forest ecosystems. Specifically, they allow testing of hypotheses regarding long-term ecosystem dynamics and provide means to assess the impacts of climate scenarios on future forest development. As a consequence, numerous local-scale simulation studies have been conducted over the past decades to assess the impacts of climate change on forests. These studies apply the best available models tailored to local conditions, parameterized and evaluated by local experts. However, this treasure trove of knowledge on climate change responses remains underexplored to date, as a consistent and harmonized dataset of local model simulations is missing. Here, our objectives were (i) to compile existing local simulations on forest development under climate change in Europe in a common database, (ii) to harmonize them to a common suite of output variables, and (iii) to provide a standardized vector of auxiliary environmental variables for each simulated location to aid subsequent investigations. Our dataset of European stand- and landscape-level forest simulations contains over 1.1 million simulation runs representing 135 million simulation years for more than 13,000 unique locations spread across Europe. The data were harmonized to consistently describe forest development in terms of stand structure (dominant height), composition (dominant species, admixed species), and functioning (leaf area index). Auxiliary variables provided include consistent daily climate information (temperature, precipitation, radiation, vapor pressure deficit) as well as information on local site conditions (soil depth, soil physical properties, soil water holding capacity, plant-available nitrogen). The present dataset facilitates analyses across models and locations, with the aim to better harness the valuable information contained in local simulations for large-scale policy support, and for fostering a deeper understanding of the effects of climate change on forest ecosystems in Europe

Towards a more objective evaluation of modelled land-carbon trends using atmospheric CO₂ and satellite-based vegetation activity observations

Terrestrial ecosystem models used for Earth system modelling show a significant divergence in future patterns of ecosystem processes, in particular the net land– atmosphere carbon exchanges, despite a seemingly common behaviour for the contemporary period. An in-depth evaluation of these models is hence of high importance to better understand the reasons for this disagreement. Here, we develop an extension for existing benchmarking systems by making use of the complementary information contained in the observational records of atmospheric CO2 and remotely sensed vegetation activity to provide a novel set of diagnostics of ecosystem responses to climate variability in the last 30 yr at different temporal and spatial scales. The selection of observational characteristics (traits) specifically considers the robustness of information given that the uncertainty of both data and evaluation methodology is largely unknown or difficult to quantify. Based on these considerations, we introduce a baseline benchmark – a minimum test that any model has to pass – to provide a more objective, quantitative evaluation framework. The benchmarking strategy can be used for any land surface model, either driven by observed meteorology or coupled to a climate model. We apply this framework to evaluate the offline version of the MPI Earth System Model’s land surface scheme JSBACH. We demonstrate that the complementary use of atmospheric CO2 and satellite-based vegetation activity data allows pinpointing of specific model deficiencies that would not be possible by the sole use of atmospheric CO2 observations

Carbon-nitrogen interactions on land at global scales: current understanding in modelling climate biosphere feedbacks

Interactions between the terrestrial carbon (C) and nitrogen (N) cycles shape the response of ecosystems to global change. The limitation of ecosystem C storage due to N availability, and the response of N(2)O emissions to environmental conditions and N addition have been intensively studied at the site level. However, their contribution to biosphere-climate interactions at regional to global scales remains unclear. A growing number of global terrestrial biogeochemical models provide a means to scale ecological understanding of the nitrogen cycle to regional and global scales with the ultimate aim to investigate the magnitude of nitrogen cycling effects on global biogeochemistry, as well as their indirect consequences for biogeophysical land-atmosphere interactions. Key challenges to modelling the coupled terrestrial carbon-nitrogen cycles arise from the need to account for micro-scale processes to represent and quantify important N fluxes, uncertainties in the representation of key carbon-nitrogen cycle couplings at the ecosystem scale, and vagaries in the available observations to constrain global models. The new generation of carbon-nitrogen cycle models suggests that reactive nitrogen deposition is associated with a moderate increase in current terrestrial carbon sequestration, providing a small climate cooling effect. The models further unanimously demonstrate that nitrogen cycling reduces both global carbon sequestration due to CO(2) fertilisation and the carbon losses associated with climate change on land, in sum leading to an acceleration of carbon accumulation in the atmosphere relative to C-cycle only models. A recent study furthermore suggests a moderate positive interaction between terrestrial N(2)O emissions and recent climatic changes, although the atmospheric increase in N(2)O over the last few decades appears to be mostly associated with anthropogenic Nr additions to the terrestrial biosphere. At least some of these models can be used to assess the biogeophysical effects of N cycling through altered albedo and changed sensible and latent heat fluxes, but no study so far has assessed these consequences explicitly