Redundant Arrays of IDE Drives

The next generation of high-energy physics experiments is expected to gather prodigious amounts of data. New methods must be developed to handle this data and make analysis at universities possible. We examine some techniques that use recent developments in commodity hardware. We test redundant arrays of integrated drive electronics (IDE) disk drives for use in offline high-energy physics data analysis. IDE redundant array of inexpensive disks (RAID) prices now equal the cost per terabyte of million-dollar tape robots! The arrays can be scaled to sizes affordable to institutions without robots and used when fast random access at low cost is important. We also explore three methods of moving data between sites; internet transfers, hot pluggable IDE disks in FireWire cases, and writable digital video disks (DVD-R).Comment: Submitted to IEEE Transactions On Nuclear Science, for the 2001 IEEE Nuclear Science Symposium and Medical Imaging Conference, 8 pages, 1 figure, uses IEEEtran.cls. Revised March 19, 2002 and published August 200

A Survey on Array Storage, Query Languages, and Systems

Since scientific investigation is one of the most important providers of massive amounts of ordered data, there is a renewed interest in array data processing in the context of Big Data. To the best of our knowledge, a unified resource that summarizes and analyzes array processing research over its long existence is currently missing. In this survey, we provide a guide for past, present, and future research in array processing. The survey is organized along three main topics. Array storage discusses all the aspects related to array partitioning into chunks. The identification of a reduced set of array operators to form the foundation for an array query language is analyzed across multiple such proposals. Lastly, we survey real systems for array processing. The result is a thorough survey on array data storage and processing that should be consulted by anyone interested in this research topic, independent of experience level. The survey is not complete though. We greatly appreciate pointers towards any work we might have forgotten to mention.Comment: 44 page

A Case for Redundant Arrays of Hybrid Disks (RAHD)

Hybrid Hard Disk Drive was originally concepted by Samsung, which incorporates a Flash memory in a magnetic disk. The combined ultra-high-density benefits of magnetic storage and the low-power and fast read access of NAND technology inspires us to construct Redundant Arrays of Hybrid Disks (RAHD) to offer a possible alternative to today’s Redundant Arrays of Independent Disks (RAIDs) and/or Massive Arrays of Idle Disks (MAIDs). We first design an internal management system (including Energy-Efficient Control) for hybrid disks. Three traces collected from real systems as well as a synthetic trace are then used to evaluate the RAHD arrays. The trace-driven experimental results show: in the high speed mode, a RAHD outplays the purely-magnetic-disk-based RAIDs by a factor of 2.4–4; in the energy-efficient mode, a RAHD4/5 can save up to 89% of energy at little performance degradationPeer reviewe

Role of edge inclination in optical microdisk resonator for label-free sensing

In this paper we report on the measurement and modelling of enhanced optical refractometric sensors based on whispering-gallery-modes. The devices under test are optical microresonators made of silicon nitride on silicon oxide. In our approach, these microresonators are vertically coupled to a buried waveguide with the aim of creating integrated and cost-effective devices. The optimization analysis is a delicate balance of resonance quality factor and evanescent field overlap with the sorrounding environment to analyze. By numerical simulations we show that the microdisk thickness is critical to yield high figure of merit for the sensor, while edge inclination is less important. We also show that figures of merit as high as 1600/RIU are feasible.Comment: 10 page

Towards optical intensity interferometry for high angular resolution stellar astrophysics

Most neighboring stars are still detected as point sources and are beyond the angular resolution reach of current observatories. Methods to improve our understanding of stars at high angular resolution are investigated. Air Cherenkov telescopes (ACTs), primarily used for Gamma-ray astronomy, enable us to increase our understanding of the circumstellar environment of a particular system. When used as optical intensity interferometers, future ACT arrays will allow us to detect stars as extended objects and image their surfaces at high angular resolution. Optical stellar intensity interferometry (SII) with ACT arrays, composed of nearly 100 telescopes, will provide means to measure fundamental stellar parameters and also open the possibility of model-independent imaging. A data analysis algorithm is developed and permits the reconstruction of high angular resolution images from simulated SII data. The capabilities and limitations of future ACT arrays used for high angular resolution imaging are investigated via Monte-Carlo simulations. Simple stellar objects as well as stellar surfaces with localized hot or cool regions can be accurately imaged. Finally, experimental efforts to measure intensity correlations are expounded. The functionality of analog and digital correlators is demonstrated. Intensity correlations have been measured for a simulated star emitting pseudo-thermal light, resulting in angular diameter measurements. The StarBase observatory, consisting of a pair of 3 m telescopes separated by 23 m, is described.Comment: PhD dissertatio

Formal Representation of the SS-DB Benchmark and Experimental Evaluation in EXTASCID

Evaluating the performance of scientific data processing systems is a difficult task considering the plethora of application-specific solutions available in this landscape and the lack of a generally-accepted benchmark. The dual structure of scientific data coupled with the complex nature of processing complicate the evaluation procedure further. SS-DB is the first attempt to define a general benchmark for complex scientific processing over raw and derived data. It fails to draw sufficient attention though because of the ambiguous plain language specification and the extraordinary SciDB results. In this paper, we remedy the shortcomings of the original SS-DB specification by providing a formal representation in terms of ArrayQL algebra operators and ArrayQL/SciQL constructs. These are the first formal representations of the SS-DB benchmark. Starting from the formal representation, we give a reference implementation and present benchmark results in EXTASCID, a novel system for scientific data processing. EXTASCID is complete in providing native support both for array and relational data and extensible in executing any user code inside the system by the means of a configurable metaoperator. These features result in an order of magnitude improvement over SciDB at data loading, extracting derived data, and operations over derived data.Comment: 32 pages, 3 figure