Assessing digital preservation frameworks: the approach of the SHAMAN project

How can we deliver infrastructure capable of supporting the preservation of digital objects, as well as the services that can be applied to those digital objects, in ways that future unknown systems will understand? A critical problem in developing systems is the process of validating whether the delivered solution effectively reflects the validated requirements. This is a challenge also for the EU-funded SHAMAN project, which aims to develop an integrated preservation framework using grid-technologies for distributed networks of digital preservation systems, for managing the storage, access, presentation, and manipulation of digital objects over time. Recognising this, the project team ensured that alongside the user requirements an assessment framework was developed. This paper presents the assessment of the SHAMAN demonstrators for the memory institution, industrial design and engineering and eScience domains, from the point of view of user’s needs and fitness for purpose. An innovative synergistic use of TRAC criteria, DRAMBORA risk registry and mitigation strategies, iRODS rules and information system models requirements has been designed, with the underlying goal to define associated policies, rules and state information, and make them wherever possible machine-encodable and enforceable. The described assessment framework can be valuable not only for the implementers of this project preservation framework, but for the wider digital preservation community, because it provides a holistic approach to assessing and validating the preservation of digital libraries, digital repositories and data centres

Invest to Save: Report and Recommendations of the NSF-DELOS Working Group on Digital Archiving and Preservation

Digital archiving and preservation are important areas for research and development, but there is no agreed upon set of priorities or coherent plan for research in this area. Research projects in this area tend to be small and driven by particular institutional problems or concerns. As a consequence, proposed solutions from experimental projects and prototypes tend not to scale to millions of digital objects, nor do the results from disparate projects readily build on each other. It is also unclear whether it is worthwhile to seek general solutions or whether different strategies are needed for different types of digital objects and collections. The lack of coordination in both research and development means that there are some areas where researchers are reinventing the wheel while other areas are neglected. Digital archiving and preservation is an area that will benefit from an exercise in analysis, priority setting, and planning for future research. The WG aims to survey current research activities, identify gaps, and develop a white paper proposing future research directions in the area of digital preservation. Some of the potential areas for research include repository architectures and inter-operability among digital archives; automated tools for capture, ingest, and normalization of digital objects; and harmonization of preservation formats and metadata. There can also be opportunities for development of commercial products in the areas of mass storage systems, repositories and repository management systems, and data management software and tools.

Critique of Architectures for Long-Term Digital Preservation

Evolving technology and fading human memory threaten the long-term intelligibility of many kinds of documents. Furthermore, some records are susceptible to improper alterations that make them untrustworthy. Trusted Digital Repositories (TDRs) and Trustworthy Digital Objects (TDOs) seem to be the only broadly applicable digital preservation methodologies proposed. We argue that the TDR approach has shortfalls as a method for long-term digital preservation of sensitive information. Comparison of TDR and TDO methodologies suggests differentiating near-term preservation measures from what is needed for the long term. TDO methodology addresses these needs, providing for making digital documents durably intelligible. It uses EDP standards for a few file formats and XML structures for text documents. For other information formats, intelligibility is assured by using a virtual computer. To protect sensitive information—content whose inappropriate alteration might mislead its readers, the integrity and authenticity of each TDO is made testable by embedded public-key cryptographic message digests and signatures. Key authenticity is protected recursively in a social hierarchy. The proper focus for long-term preservation technology is signed packages that each combine a record collection with its metadata and that also bind context—Trustworthy Digital Objects.

Consider the Source: The Value of Source Code to Digital Preservation Strategies

One of the major challenges in the digital preservation field is the difficulty of ensuring long-term access to digital objects, especially in cases when the software that was used to create an object is no longer current. Software source code has a human-readable, documentary structure that makes it an overlooked aspect of digital preservation strategies, in addition to a valuable component for the records of modern computing history. The author surveys several approaches to software preservation and finds that, by supporting open source initiatives, digital libraries can improve their ability to preserve access to their collections for future generations

PRONOM-ROAR: Adding Format Profiles to a Repository Registry to Inform Preservation Services

To date many institutional repository (IR) software suppliers have pushed the IR as a digital preservation solution. We argue that the digital preservation of objects in IRs may better be achieved through the use of light-weight, add-on services. We present such a service – PRONOM-ROAR – that generates file format profiles for IRs. This demonstrates the potential of using third- party services to provide preservation expertise to IR managers by making use of existing machine interfaces to IRs

Using an institutional repository to support records management and digital preservation (RMDP)

Institutional repositories are under current investigation for their ability to support digital preservation. Whilst systems for digital preservation are still evolving, repositories are increasingly being used as the basis of or a component of such systems. Digital preservation requires information (metadata) to be stored about the digital objects themselves (format etc.), events that occur, agents that have acted on the object, and rights. These can start being collected from the point an object is created in a repository, as part of its ongoing management

Reflections on preserving the state of new media art

As part of its work to explore emerging issues associated with characterisation of digital materials, Planets has explored vocabularies and information structures for expressing the properties integral to the value of digital art. Value encompasses those qualities that must be understood and captured in order to ensure that art works’ sensory, emotional, mental and spiritual resonance remain. Facets of interactivity, modularity and temporality associated with digital art present some critical questions that the preservation community must increasingly be equipped to answer. Because digital art materials exhibit fundamental multidimensionality, validating the successful preservation of creative experience demands the explication of more than just file characteristics. Understanding relationships between objects also implies an understanding of their respective functional qualities. This paper presents a Planets’ vocabulary for encapsulating contextual and implicit characteristics of digital art, optimised for preservation planning and validation

The Role of Metadata in Digital Preservation

The production of digital objects, things such as e-books, photos, and electronic documents, is overwhelming. Libraries and other institutions are collecting digital objects quickly at a high quantity, but such objects will not last long unless preservation efforts are made. Just as physical collections need preservation so too do digital ones, but digital objects are even more fragile and need more care and maintenance. Metadata is an integral part of the preservation process of digital material. Metadata is more than just data about data, it is the documentation of an object that provides description, context, and long-term usability. The more quality metadata there is with an electronic object, the better it will be preserved and accessible in the future. Metadata is almost equal in importance to the digital object itself. Yet although quality metadata is necessary for preservation, there are difficulties to its widespread implementation and in general institutions are not providing enough for the preservation of digital material. However, there are efforts being made to provide metadata standards and to create ways to collect that information on a large scale. This is a literature review examining the role of metadata in the preservation of digital objects and how institutions are responding to the need for better metadata at a higher quantity

The importance of context for Digital Libraries.

The concept of "context" has great importance in digital preservation. This paper analyzes the meaning of context from the point of view of access to digital objects, combining linguistics, terminological disambiguation in information retrieval and text categorization aspects. In these areas, the context is a key element for successful disambiguation and thus get better results. Therefore, the preservation and subsequent access of digital objects should also consider the preservation of appropriate information about the terminology and social context in which these objects were generated