8 research outputs found

    Fourier Neural Operators for Arbitrary Resolution Climate Data Downscaling

    Full text link
    Climate simulations are essential in guiding our understanding of climate change and responding to its effects. However, it is computationally expensive to resolve complex climate processes at high spatial resolution. As one way to speed up climate simulations, neural networks have been used to downscale climate variables from fast-running low-resolution simulations, but high-resolution training data are often unobtainable or scarce, greatly limiting accuracy. In this work, we propose a downscaling method based on the Fourier neural operator. It trains with data of a small upsampling factor and then can zero-shot downscale its input to arbitrary unseen high resolution. Evaluated both on ERA5 climate model data and on the Navier-Stokes equation solution data, our downscaling model significantly outperforms state-of-the-art convolutional and generative adversarial downscaling models, both in standard single-resolution downscaling and in zero-shot generalization to higher upsampling factors. Furthermore, we show that our method also outperforms state-of-the-art data-driven partial differential equation solvers on Navier-Stokes equations. Overall, our work bridges the gap between simulation of a physical process and interpolation of low-resolution output, showing that it is possible to combine both approaches and significantly improve upon each other.Comment: Presented at the ICLR 2023 workshop on "Tackling Climate Change with Machine Learning

    Physics-Constrained Deep Learning for Climate Downscaling

    Full text link
    The availability of reliable, high-resolution climate and weather data is important to inform long-term decisions on climate adaptation and mitigation and to guide rapid responses to extreme events. Forecasting models are limited by computational costs and, therefore, often generate coarse-resolution predictions. Statistical downscaling, including super-resolution methods from deep learning, can provide an efficient method of upsampling low-resolution data. However, despite achieving visually compelling results in some cases, such models frequently violate conservation laws when predicting physical variables. In order to conserve physical quantities, we develop methods that guarantee physical constraints are satisfied by a deep learning downscaling model while also improving their performance according to traditional metrics. We compare different constraining approaches and demonstrate their applicability across different neural architectures as well as a variety of climate and weather datasets. Besides enabling faster and more accurate climate predictions, we also show that our novel methodologies can improve super-resolution for satellite data and standard datasets

    Direct Sampling for Spatially Variable Extreme Event Generation in Resampling‐Based Stochastic Weather Generators

    No full text
    Abstract Resampling‐based weather generators simulate new time series of weather variables by reordering the observed values such that the statistics of the simulated data are consistent with the observed ones. These generators are fully data‐driven, easy to implement, and capable of reproducing the dynamics among weather variables. However, although the simulated time series is new, the weather fields produced at arbitrary time steps are replicas of those found in observations, limiting the spatial variability of simulations and preventing the generation of extreme weather fields beyond the range of observed values. To address these limitations, we propose the integration of the Direct Sampling algorithm—a data‐driven method for producing simulations—into resampling‐based weather generators. By incorporating Direct Sampling as a post‐processing step on the outputs of the weather generator, we enhance the spatial variability of the generated weather fields and enable the generation of extreme weather fields. We introduce an approach for generating out‐of‐sample extreme weather fields using Direct Sampling. This method involves utilizing a set of control points in conjunction with Direct Sampling, where the values of these control points are informed by return period analysis. The proposed approach is validated using precipitation, temperature, and cloud cover weather fields in a region of northwest India. The experimental results confirm that Direct Sampling enhances the spatial variability of the weather fields and facilitates the generation of out‐of‐sample precipitation fields that accurately adhere to the spatial statistics provided by return precipitation level maps, as well as the observed precipitation weather field employed in the analysis

    Penobscot Interpretation Dataset

    No full text
    <p>We have seen in the past years the flourishing of machine and deep learning algorithms in several applications such as image classification and segmentation, object detection and recognition, among many others. This was only possible, in part, because datasets like ImageNet - with +14 million labeled images - were created and made publicly available, providing researches with a common ground to compare their advances and extend the state-of-the-art. Although we have seen an increasing interest in machine learning in geosciences as well, we will only be able to achieve a significant impact in our community if we collaborate to build such a common basis. This is even more difficult when it comes to the Oil & Gas industry, in which confidentiality and commercial interests often hinder the sharing of datasets to others. In this letter, we present the Penobscot interpretation dataset, our contribution to the development of machine learning in geosciences, more specifically in seismic interpretation. The Penobscot 3D seismic dataset was acquired in the Scotian shelf, offshore Nova Scotia, Canada. The data is publicly available and comprises pre- and pos-stack data, 5 horizons and well logs of 2 wells. However, for the dataset to be of practical use for our tasks, we had to reinterpret the seismic, generating 7 horizons separating different seismic facies intervals. The interpreted horizons were used to generated +100,000 labeled images for inlines and crosslines. To demonstrate the utility of our dataset, results of two experiments are presented.</p> <p><strong>Dataset contents</strong></p> <ul> <li>Crosslines: <ul> <li>Classes: 7</li> <li>Slices used for training: 289</li> <li>Records per class for training: 16706</li> <li>Slices used for testing: 192</li> <li>Records per class for testing: 1000</li> </ul> </li> <li>Inlines: <ul> <li>Classes: 7</li> <li>Slices used for training: 358</li> <li>Records per class for training: 14988</li> <li>Slices used for testing: 238</li> <li>Records per class for testing: 1000</li> </ul> </li> </ul
    corecore