10,716 research outputs found
ArrayBridge: Interweaving declarative array processing with high-performance computing
Scientists are increasingly turning to datacenter-scale computers to produce
and analyze massive arrays. Despite decades of database research that extols
the virtues of declarative query processing, scientists still write, debug and
parallelize imperative HPC kernels even for the most mundane queries. This
impedance mismatch has been partly attributed to the cumbersome data loading
process; in response, the database community has proposed in situ mechanisms to
access data in scientific file formats. Scientists, however, desire more than a
passive access method that reads arrays from files.
This paper describes ArrayBridge, a bi-directional array view mechanism for
scientific file formats, that aims to make declarative array manipulations
interoperable with imperative file-centric analyses. Our prototype
implementation of ArrayBridge uses HDF5 as the underlying array storage library
and seamlessly integrates into the SciDB open-source array database system. In
addition to fast querying over external array objects, ArrayBridge produces
arrays in the HDF5 file format just as easily as it can read from it.
ArrayBridge also supports time travel queries from imperative kernels through
the unmodified HDF5 API, and automatically deduplicates between array versions
for space efficiency. Our extensive performance evaluation in NERSC, a
large-scale scientific computing facility, shows that ArrayBridge exhibits
statistically indistinguishable performance and I/O scalability to the native
SciDB storage engine.Comment: 12 pages, 13 figure
Recommended from our members
Research advances towards large-scale solar hydrogen production from water
Study of the sustainability of a Permanent Martian Outpost
This document contains a sustainability study of a permanent Martian outpost. It involves a preliminary introduction to the exploration of Mars and concepts related to sustainability such as sustainable development, carrying capacity or impact, as well as an overview of previous studies regarding human exploration of Mars. The methodology proposed to carry out the sustainability study is a brand-new approach to the analysis of space exploration missions that focus on the impact of the mission elements regarding the Earth, the Outer Space, and Mars itself. It also provides a framework that will allow to extend the study to location-related carrying capacity assessment, and In Situ Resource Utilization and Environmental Control and Life Support Systems’ circularity. After a discussion of the results obtained from the quantitative analysis performed, an extensive proposal of future work is provided, as well as orientation on what to expect from future missions to the red planet
Electrobioremediation of oil spills
Annually, thousands of oil spills occur across the globe. As a result, petroleum substances and petrochemical compounds are widespread contaminants causing concern due to their toxicity and recalcitrance. Many remediation strategies have been developed using both physicochemical and biological approaches. Biological strategies are most benign, aiming to enhance microbial metabolic activities by supplying limiting inorganic nutrients, electron acceptors or donors, thus stimulating oxidation or reduction of contaminants. A key issue is controlling the supply of electron donors/acceptors. Bioelectrochemical systems (BES) have emerged, in which an electrical current serves as either electron donor or acceptor for oil spill bioremediation. BES are highly controllable and can possibly also serve as biosensors for real time monitoring of the degradation process. Despite being promising, multiple aspects need to be considered to make BES suitable for field applications including system design, electrode materials, operational parameters, mode of action and radius of influence. The microbiological processes, involved in bioelectrochemical contaminant degradation, are currently not fully understood, particularly in relation to electron transfer mechanisms. Especially in sulfate rich environments, the sulfur cycle appears pivotal during hydrocarbon oxidation. This review provides a comprehensive analysis of the research on bioelectrochemical remediation of oil spills and of the key parameters involved in the process
Energy Optimization in Commercial FPGAs with Voltage, Frequency and Logic Scaling
This paper investigates the energy reductions possible in commercially available FPGAs configured to support voltage, frequency and logic scalability combined with power gating. Voltage and frequency scaling is based on in-situ detectors that allow the device to detect valid working voltage and frequency pairs at run-time while logic scalability is achieved with partial dynamic reconfiguration. The considered devices are FPGA-processor hybrids with independent power domains fabricated in 28 nm process nodes. The test case is based on a number of operational scenarios in which the FPGA side is loaded with a motion estimation core that can be configured with a variable number of execution units. The results demonstrate that voltage scalability reduces power by up to 60 percent compared with nominal voltage operation at the same frequency. The energy analysis show that the most energy efficiency core configuration depends on the performance requirements. A low performance scenario shows that serial computation is more energy efficient than the parallel configuration while the opposite is true when the performance requirements increase. An algorithm is proposed to combine effectively adaptive voltage/logic scaling and power gating in the proposed system and application
- …