FEW : file management for portable devices

Comunicação apresentada ao International Workshop on Software Support for Portable Storage (IWSSPS), San Francisco, 2005.In recent years, an increasing number of portable devices with large amounts of storage have become widely used. In this paper, we present the early design of the FEW system, a system that aims to ease file management in the new mobile environment. To this end, the system will manage file replicas stored in fixed and portable storage devices. It will provide an automatic mechanism to establish new file replicas by analyzing file system activity. The system will automatically and incrementally synchronize all file replicas exploring the available network connectivity and the availability of portable storage devices. To merge concurrent updates, operational transformation techniques will be used.FCT/MCES POSI/FEDER - Project #59064/2004

Evaluation of different SAN Technologies for virtual machine hosting

This thesis covers a problem which companies faces every day: Finding a Storage Area Network(SAN) solution that tackles the rising demands from users and their software and when working with virtualization environments. In this paper it will be showed a way to investigate and identify, from a selection of SAN technologies, which is the most efficient and optimal based on scenarios that fits real life experiences. The approach taken was to create an experimental setup in a controlled environment that fits real life experience. The benchmark tool bonnie++ was used to simulate activity and interpreted by an analysis script tool developed by the author. Distributed Replicated Block Device(DRBD), Network File System(NFS), Parallel Virtual File System(PVFS), Internet SCSI(ISCSI) and ATA over Ethernet(AoE) are the SAN technologies which will be evaluated and discussed. The optimal SAN technologies will be chosen based on a certain criterias such as raw performance and stability.Master i nettverks- og systemadministrasjo

A shared-disk parallel cluster file system

Dissertação apresentada para obtenção do Grau de Doutor em Informática Pela Universidade Nova de Lisboa, Faculdade de Ciências e TecnologiaToday, clusters are the de facto cost effective platform both for high performance computing (HPC) as well as IT environments. HPC and IT are quite different environments and differences include, among others, their choices on file systems and storage: HPC favours parallel file systems geared towards maximum I/O bandwidth, but which are not fully POSIX-compliant and were devised to run on top of (fault prone) partitioned storage; conversely, IT data centres favour both external disk arrays (to provide highly available storage) and POSIX compliant file systems, (either general purpose or shared-disk cluster file systems, CFSs). These specialised file systems do perform very well in their target environments provided that applications do not require some lateral features, e.g., no file locking on parallel file systems, and no high performance writes over cluster-wide shared files on CFSs. In brief, we can say that none of the above approaches solves the problem of providing high levels of reliability and performance to both worlds. Our pCFS proposal makes a contribution to change this situation: the rationale is to take advantage on the best of both – the reliability of cluster file systems and the high performance of parallel file systems. We don’t claim to provide the absolute best of each, but we aim at full POSIX compliance, a rich feature set, and levels of reliability and performance good enough for broad usage – e.g., traditional as well as HPC applications, support of clustered DBMS engines that may run over regular files, and video streaming. pCFS’ main ideas include: · Cooperative caching, a technique that has been used in file systems for distributed disks but, as far as we know, was never used either in SAN based cluster file systems or in parallel file systems. As a result, pCFS may use all infrastructures (LAN and SAN) to move data. · Fine-grain locking, whereby processes running across distinct nodes may define nonoverlapping byte-range regions in a file (instead of the whole file) and access them in parallel, reading and writing over those regions at the infrastructure’s full speed (provided that no major metadata changes are required). A prototype was built on top of GFS (a Red Hat shared disk CFS): GFS’ kernel code was slightly modified, and two kernel modules and a user-level daemon were added. In the prototype, fine grain locking is fully implemented and a cluster-wide coherent cache is maintained through data (page fragments) movement over the LAN. Our benchmarks for non-overlapping writers over a single file shared among processes running on different nodes show that pCFS’ bandwidth is 2 times greater than NFS’ while being comparable to that of the Parallel Virtual File System (PVFS), both requiring about 10 times more CPU. And pCFS’ bandwidth also surpasses GFS’ (600 times for small record sizes, e.g., 4 KB, decreasing down to 2 times for large record sizes, e.g., 4 MB), at about the same CPU usage.Lusitania, Companhia de Seguros S.A, Programa IBM Shared University Research (SUR

StoRM: A Manager for Storage Resource in Grid

Nowadays, data intensive applications demand high-performance and large-storage systems capable of serving up to various Petabytes of storage space. Therefore, common solutions adopted in data centres include Storage Area Networks (SAN) and cluster parallel file systems, such as GPFS from IBM and Lustre from Sun Microsystems. In order to make these storage system solutions available in modern Data Grid architectures, standard interfaces are needed. The Grid Storage Resource Manager (SRM) interface is one of these standard interfaces. Grid storage services implementing the SRM standard provide common capabilities and advanced functionality such as dynamic space allocation and file management on shared storage systems. In this paper, we describe StoRM (STOrage Resource Manager). StoRM is a flexible and high-performing implementation of the standard SRM interface version 2.2. The software architecture of StoRM allows for an easy integration to different underlying storage systems via a plug-in mechanism. In particular, StoRM takes advantage from storage systems based on cluster file systems. Currently, StoRM is installed and used in production in various data centres, including the WLCG Italian Tier-1. In addition, Economics and Financial communities, as represented by the EGRID Project, adopt StoRM in production as well

Single-file diffusion in a box: Effect of the initial configuration

This paper studies the single-file diffusion process on a linear chain of identical pointlike particles with multiple-site occupation confined in a one-dimensional box. The particles are noninteracting, except that double occupancy is forbidden. When particles are confined in a finite box, the final stage is saturation. By means of combinatorial analysis, an exact numerical evaluation of the saturation values for both the mean-square displacement (MSD) of a tracer particle and the center of mass of the system are obtained. Different initial distributions of particles are introduced. The time dependence of the MSD is obtained by means of Monte Carlo simulations. The values of the MSD for the tracer particles as well as the center of mass of the system depend on the size of the particle, the size of the box, and the initial distribution. Moreover, the transient regime depends on the initial distribution. In fact, the crossover from normal to subdiffusive regime is observed for random and alternate initial distributions, while superdiffusive diffusion appears for any stacked initial distributions. In all cases, it is shown that the collisions between particles do not determine the time exponent of the MSD. A simple expression for the transient regime is also obtained for the especial case of random initial distribution.Fil: Manzi, Sergio Javier. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Luis. Instituto de Física Aplicada "Dr. Jorge Andrés Zgrablich". Universidad Nacional de San Luis. Facultad de Ciencias Físico Matemáticas y Naturales. Instituto de Física Aplicada "Dr. Jorge Andrés Zgrablich"; ArgentinaFil: Torrez Herrera, Jonathan Josue. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Luis. Instituto de Matemática Aplicada de San Luis "Prof. Ezio Marchi". Universidad Nacional de San Luis. Facultad de Ciencias Físico, Matemáticas y Naturales. Instituto de Matemática Aplicada de San Luis "Prof. Ezio Marchi"; ArgentinaFil: Pereyra, Victor Daniel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Luis. Instituto de Matemática Aplicada de San Luis "Prof. Ezio Marchi". Universidad Nacional de San Luis. Facultad de Ciencias Físico, Matemáticas y Naturales. Instituto de Matemática Aplicada de San Luis "Prof. Ezio Marchi"; Argentin