6 research outputs found

    Accelerating in-transit co-processing for scientific simulations using region-based data-driven analysis

    Get PDF
    Increasing processing capabilities and input/output constraints of supercomputers have increased the use of co-processing approaches, i.e., visualizing and analyzing data sets of simulations on the fly. We present a method that evaluates the importance of different regions of simulation data and a data-driven approach that uses the proposed method to accelerate in-transit co-processing of large-scale simulations. We use the importance metrics to simultaneously employ multiple compression methods on different data regions to accelerate the in-transit co-processing. Our approach strives to adaptively compress data on the fly and uses load balancing to counteract memory imbalances. We demonstrate the method’s efficiency through a fluid mechanics application, a Richtmyer–Meshkov instability simulation, showing how to accelerate the in-transit co-processing of simulations. The results show that the proposed method expeditiously can identify regions of interest, even when using multiple metrics. Our approach achieved a speedup of 1.29× in a lossless scenario. The data decompression time was sped up by 2× compared to using a single compression method uniformly

    Goods and Services of Marine Bivalves

    Get PDF
    The aim of this book is to review and analyse the goods and services of bivalve shellfish. How they are defined, what determines the ecological functions that are the basis for the goods and services, what controversies in the use of goods and services exist, and what is needed for sustainable exploitation of bivalves from the perspective of the various stakeholders. The book is focused on the goods and services, and not on impacts of shellfish aquaculture on the benthic environment, or on threats like biotoxins; neither is it a shellfish culture handbook although it can be used in evaluating shellfish culture. The reviews and analysis are based on case studies that exemplify the concept, and show the strengths and weaknesses of the current applications. The multi-authored reviews cover ecological, economic and social aspects of bivalve goods and services. The book provides new insights for scientists, students, shellfish producers, policy advisors, nature conservationists and decision makers. This book is open access under the CC BY license.publishedVersio

    Modeling High-throughput Applications for in situ Analytics

    Get PDF
    International audienceWith the goal of performing exascale computing, the importance of I/Omanagement becomes more and more critical to maintain system performance.While the computing capacities of machines are getting higher, the I/O capa-bilities of systems do not increase as fast. We are able to generate more databut unable to manage them eciently due to variability of I/O performance.Limiting the requests to the Parallel File System (PFS) becomes necessary. Toaddress this issue, new strategies are being developed such as online in situanalysis. The idea is to overcome the limitations of basic post-mortem dataanalysis where the data have to be stored on PFS rst and processed later.There are several software solutions that allow users to specically dedicatenodes for analysis of data and distribute the computation tasks over dier-ent sets of nodes. Thus far, they rely on a manual resource partitioning andallocation by the user of tasks (simulations, analysis).In this work, we propose a memory-constraint modelization for in situ anal-ysis. We use this model to provide dierent scheduling policies to determineboth the number of resources that should be dedicated to analysis functions,and that schedule eciently these functions. We evaluate them and show theimportance of considering memory constraints in the model. Finally, we discussthe dierent challenges that have to be addressed in order to build automatictools for in situ analytics
    corecore