1,071,596 research outputs found

    Lightweigth Adaptive fault-tolerant data storage system (AFTSYS)

    Get PDF
    Research group ARCOS of Universidad Carlos III de Madrid (Spain) have been working on flexible and adaptive data storage systems for several years. The storage systems developed are featured by software governance, making them portable across different hardware storage resources, and their dynamic adaptativy to the different circumstances of computer systems following the autonomic system paradigm. They also allow getting high performance storage by using data distribution or striping across multiple devices. One of the group’s technologies y the AFTSYS system. A fault-tolerant storage system for persistent distributed objects, user configurable and adaptive to system behaviour

    Performance Evaluation and Modeling of HPC I/O on Non-Volatile Memory

    Full text link
    HPC applications pose high demands on I/O performance and storage capability. The emerging non-volatile memory (NVM) techniques offer low-latency, high bandwidth, and persistence for HPC applications. However, the existing I/O stack are designed and optimized based on an assumption of disk-based storage. To effectively use NVM, we must re-examine the existing high performance computing (HPC) I/O sub-system to properly integrate NVM into it. Using NVM as a fast storage, the previous assumption on the inferior performance of storage (e.g., hard drive) is not valid any more. The performance problem caused by slow storage may be mitigated; the existing mechanisms to narrow the performance gap between storage and CPU may be unnecessary and result in large overhead. Thus fully understanding the impact of introducing NVM into the HPC software stack demands a thorough performance study. In this paper, we analyze and model the performance of I/O intensive HPC applications with NVM as a block device. We study the performance from three perspectives: (1) the impact of NVM on the performance of traditional page cache; (2) a performance comparison between MPI individual I/O and POSIX I/O; and (3) the impact of NVM on the performance of collective I/O. We reveal the diminishing effects of page cache, minor performance difference between MPI individual I/O and POSIX I/O, and performance disadvantage of collective I/O on NVM due to unnecessary data shuffling. We also model the performance of MPI collective I/O and study the complex interaction between data shuffling, storage performance, and I/O access patterns.Comment: 10 page

    Robo-line storage: Low latency, high capacity storage systems over geographically distributed networks

    Get PDF
    Rapid advances in high performance computing are making possible more complete and accurate computer-based modeling of complex physical phenomena, such as weather front interactions, dynamics of chemical reactions, numerical aerodynamic analysis of airframes, and ocean-land-atmosphere interactions. Many of these 'grand challenge' applications are as demanding of the underlying storage system, in terms of their capacity and bandwidth requirements, as they are on the computational power of the processor. A global view of the Earth's ocean chlorophyll and land vegetation requires over 2 terabytes of raw satellite image data. In this paper, we describe our planned research program in high capacity, high bandwidth storage systems. The project has four overall goals. First, we will examine new methods for high capacity storage systems, made possible by low cost, small form factor magnetic and optical tape systems. Second, access to the storage system will be low latency and high bandwidth. To achieve this, we must interleave data transfer at all levels of the storage system, including devices, controllers, servers, and communications links. Latency will be reduced by extensive caching throughout the storage hierarchy. Third, we will provide effective management of a storage hierarchy, extending the techniques already developed for the Log Structured File System. Finally, we will construct a protototype high capacity file server, suitable for use on the National Research and Education Network (NREN). Such research must be a Cornerstone of any coherent program in high performance computing and communications

    Conditioning of BPM pickup signals for operations of the Duke storage ring with a wide range of single-bunch current

    Full text link
    The Duke storage ring is a dedicated driver for the storage ring based oscillator free-electron lasers (FELs), and the High Intensity Gamma-ray Source (HIGS). It is operated with a beam current ranging from about 1 mA to 100 mA per bunch for various operations and accelerator physics studies. High performance operations of the FEL and gamma-ray source require a stable electron beam orbit, which has been realized by the global orbit feedback system. As a critical part of the orbit feedback system, the electron beam position monitors (BPMs) are required to be able to precisely measure the electron beam orbit in a wide range of the single-bunch current. However, the high peak voltage of the BPM pickups associated with high single-bunch current degrades the performance of the BPM electronics, and can potentially damage the BPM electronics. A signal conditioning method using low pass filters is developed to reduce the peak voltage to protect the BPM electronics, and to make the BPMs capable of working with a wide range of single-bunch current. Simulations and electron beam based tests are performed. The results show that the Duke storage ring BPM system is capable of providing precise orbit measurements to ensure highly stable FEL and HIGS operations
    • …
    corecore