28 research outputs found

    Object storage: how chunky would you like your data?

    Get PDF
    In this study we examine object storage, a cutting-edge cloud-native technology specifically designed for efficiently managing large datasets. While object storage offers significant cost-effectiveness compared to disk storage, it requires data to be appropriately adapted to fully realise its benefits. Data retrieval from object storage is over HTTP in complete "objects," which are either entire files or file chunks. As this is relatively new technology, there is a clear lack of established tools and best-practice for converting various file types for optimal use with object storage, particularly for large gridded and N-dimensional datasets used in environmental and climate science. The performance and speed of object storage are contingent upon the data's structure, chunking, and the specific analysis requirements of the user. Consequently, a better understanding of these interactions is essential before widespread adoption. To address this need, our study conducted a series of experiments using gridded data with different chunking strategies, aiming to identify the most efficient approach for utilizing and accessing data stored in an object store. Our findings highlight the need for comprehensive understanding of object storage before its widespread adoption, and serve as a valuable resource for guiding future users in utilizing object storage effectively

    Projected changes in the East Asian hydrological cycle for different levels of future global warming

    Get PDF
    Recent decades have shown significant changes to the hydrological cycle over East Asia (EA), and further changes are expected due to future global warming. This study evaluates projected seasonal changes in the EA hydrological cycle using simulations that are 1.5 °C, 2.0 °C and 3.0 ∘C warmer than pre-industrial, from the Met Office Unified Model (MetUM) Global Ocean Mixed Layer model version 2.0 (GOML2.0), compared against present-day conditions. The moisture sources of the warming-induced precipitation changes are identified over five hydrologically unique regions within EA. Precipitation over EA increases with warming (except over southeastern EA in the spring and autumn) due to the intensified hydrological cycle. The projected seasonal changes in the hydrological cycle are usually nonlinear, with the rate of change between 1.5 ∘C and 2.0 ∘C larger than the rate of change between 2.0 ∘C and 3.0 ∘C of warming. The warming-induced precipitation increases are mainly associated with an increase in remote moisture convergence rather than local moisture recycling, except over the Tibetan Plateau. Decomposition of the changes in moisture sources by direction and flux component indicate that changes from the west are dominated by changes to moisture and changes from the north are more circulation driven. The changes from the south are moisture driven over southern EA and driven by moisture and circulation change over northern EA. Our results highlight the regionally and seasonally diverse projected changes to the EA hydrological cycle due to global warming, which will be useful for region-specific climate mitigation policies and the implementation of seasonally varying adaptation methods
    corecore