LIFE: bibliography

The following bibliography came out of the research which formed the first phase of the joint British Library-UCL LIFE (Lifecycle Information for E-Literature) project. The references are not an exhaustive review of digital preservation activities, they are a reflection of the aims of the LIFE project. Any suggestions for additions or comments can be emailed to [email protected]

Signature Searching Concerning Association Assortment of Files

Signature is the example that you search for inside an information parcel. A signature is utilized to recognize one or numerous sorts of assaults. Signatures may be available in distinctive parts of an information parcel contingent on the way of the assault. We can discover signatures in the IP header, transport layer header (TCP or UDP header) and application layer header or payload. Generally IDS relies on signatures to get some answers concerning gatecrasher movement. With the expanded measure of information exchanged by PC systems, the amoun t of the malevolent movement likewise increments and thusly it is important to ensure the system by security framework, for example, firewalls and the Intrusion Detection System. Example coordinating is the time discriminating operation of current Intrusion Detection System. In this venture this example coordinating is in view of the standard expression where as these example of known   Assaults are put away in the database of Intrusion Detection System. Customary Expressions are regularly used to portray malignant system design

The LIFE project research review: mapping the landscape, riding a life cycle

The LIFE project research review investigates both life cycle costing and digital preservation, with a view to creating a useable life cycle costing model that can be applied to digital preservation within an HE/FE environment. The general concept of life cycle costing (LCC) is explored as a cost management tool. LCC is concerned with all stages of a life cycle, from inception to retirement. “Life cycles” are used in many arenas; this broader context is also taken into account. Although not a vast amount of study has been done in this domain, specific library-based life cycle collection models are considered. These provide useful costing models, including the first application of a costing model for digital collections. Research concerning the effective management and preservation of digital materials is looked at, some of which notably endorses a life cycle approach. This line of investigation provided the most significant perspective for digital preservation life cycle costing. Records management is also discussed, insofar as records management principles have been advocated for digital information management and preservation. It thus provides further insight and has informed work in the area of life cycle management. To fully appreciate the life cycle costs associated with digital preservation it was necessary to have a reliable framework of digital preservation costs. Literature involving the precise nature of stages involved in digital preservation was examined to ensure that all the relevant cost factors were taken into account. Furthermore, it was significant to address the question of who is responsible for carrying out this work and how this should be done

Flexible allocation and space management in storage systems

In this dissertation, we examine some of the challenges faced by the emerging networked storage systems. We focus on two main issues. Current file systems allocate storage statically at the time of their creation. This results in many suboptimal scenarios, for example: (a) space on the disk is not allocated well across multiple file systems, (b) data is not organized well for typical access patterns. We propose Virtual Allocation for flexible storage allocation. Virtual allocation separates storage allocation from the file system. It employs an allocate-on-write strategy, which lets applications fit into the actual usage of storage space without regard to the configured file system size. This improves flexibility by allowing storage space to be shared across different file systems. We present the design of virtual allocation and an evaluation of it through benchmarks based on a prototype system on Linux. Next, based on virtual allocation, we consider the problem of balancing locality and load in networked storage systems with multiple storage devices (or bricks). Data distribution affects locality and load balance across the devices in a networked storage system. We propose user-optimal data migration scheme which tries to balance locality and load balance in such networked storage systems. The presented approach automatically and transparently manages migration of data blocks among disks as data access patterns and loads change over time. We built a prototype system on Linux and present the design of user-optimal migration and an evaluation of it through realistic experiments

Storage Systems for Non-volatile Memory Devices

This dissertation presents novel approaches to the use of non-volatile memory devices in building storage systems. There are many types of non-volatile memory devices, and they usually have better performance than regular magnetic hard disks in terms of throughput and latency. This dissertation focused on two of them, NAND flash memory and Phase Change Memory (PCM). This work consisted of two parts. The first part was to design a high-performance hybrid storage system employing Solid State Drives that are build out of NAND flash memory and Hard Disk Drives. In this hybrid system, we proposed two different policies to improve its performance. One is to exploit the fact that the performances of Solid State Drive and Hard Disk Drive are asymmetric and the other is to exploit concurrency on multiple devices. We implemented prototypes in Linux and evaluate both policies in multiple workloads and multiple configurations. The results showed that the proposed approaches improve the performance significantly, and adapt to different configurations of the system under different workloads. The second part was to implement a file system on a special class of memory devices, Storage Class Memory (SCM), which is both byte addressable and also nonvolatile, e.g. PCM. We claimed that both the existing regular file systems and the memory based file systems are not suitable for SCM, and proposed a new file system, called SCMFS, which is implemented on the virtual address space. In SCMFS, we utilized the existing memory management module in the operating system to do the block management. Our design keeps address space within a file contiguous to reduce the block management software. The simplicity of SCMFS not only makes it easy to implement, but also improves the performance. We implemented a prototype of SCMFS in Linux and evaluated its performance through multiple benchmarks

An overview of a large-scale data migration

We present an overview of the migration of the data collected by the COMPASS experiment at CERN. In less than three months, almost 300 TB will be migrated at a sustained data rate approaching 100 MB/s, using a distributed system with multiple nodes and data servers. This project, which is being carried out by the Database Group of CERN's IT Division and is expected to be completed by early 2003, involves both a physical media migration, from StorageTek 9940A to StorageTek 9940B tapes, and a data format conversion, from an object database management system to a hybrid persistency mechanism based on flat files referenced in a relational database management system. (11 refs)