Segmentation-assisted detection of dirt impairments in archived film sequences

A novel segmentation-assisted method for film dirt detection is proposed. We exploit the fact that film dirt manifests in the spatial domain as a cluster of connected pixels whose intensity differs substantially from that of its neighborhood and we employ a segmentation-based approach to identify this type of structure. A key feature of our approach is the computation of a measure of confidence attached to detected dirt regions which can be utilized for performance fine tuning. Another important feature of our algorithm is the avoidance of the computational complexity associated with motion estimation. Our experimental framework benefits from the availability of manually derived as well as objective ground truth data obtained using infrared scanning. Our results demonstrate that the proposed method compares favorably with standard spatial, temporal and multistage median filtering approaches and provides efficient and robust detection for a wide variety of test material

Detection of dirt impairments from archived film sequences : survey and evaluations

Film dirt is the most commonly encountered artifact in archive restoration applications. Since dirt usually appears as a temporally impulsive event, motion-compensated interframe processing is widely applied for its detection. However, motion-compensated prediction requires a high degree of complexity and can be unreliable when motion estimation fails. Consequently, many techniques using spatial or spatiotemporal filtering without motion were also been proposed as alternatives. A comprehensive survey and evaluation of existing methods is presented, in which both qualitative and quantitative performances are compared in terms of accuracy, robustness, and complexity. After analyzing these algorithms and identifying their limitations, we conclude with guidance in choosing from these algorithms and promising directions for future research

Innovative Techniques for Digitizing and Restoring Deteriorated Historical Documents

Recent large-scale document digitization initiatives have created new modes of access to modern library collections with the development of new hardware and software technologies. Most commonly, these digitization projects focus on accurately scanning bound texts, some reaching an efficiency of more than one million volumes per year. While vast digital collections are changing the way users access texts, current scanning paradigms can not handle many non-standard materials. Documentation forms such as manuscripts, scrolls, codices, deteriorated film, epigraphy, and rock art all hold a wealth of human knowledge in physical forms not accessible by standard book scanning technologies. This great omission motivates the development of new technology, presented by this thesis, that is not-only effective with deteriorated bound works, damaged manuscripts, and disintegrating photonegatives but also easily utilized by non-technical staff. First, a novel point light source calibration technique is presented that can be performed by library staff. Then, a photometric correction technique which uses known illumination and surface properties to remove shading distortions in deteriorated document images can be automatically applied. To complete the restoration process, a geometric correction is applied. Also unique to this work is the development of an image-based uncalibrated document scanner that utilizes the transmissivity of document substrates. This scanner extracts intrinsic document color information from one or both sides of a document. Simultaneously, the document shape is estimated to obtain distortion information. Lastly, this thesis provides a restoration framework for damaged photographic negatives that corrects photometric and geometric distortions. Current restoration techniques for the discussed form of negatives require physical manipulation to the photograph. The novel acquisition and restoration system presented here provides the first known solution to digitize and restore deteriorated photographic negatives without damaging the original negative in any way. This thesis work develops new methods of document scanning and restoration suitable for wide-scale deployment. By creating easy to access technologies, library staff can implement their own scanning initiatives and large-scale scanning projects can expand their current document-sets

Assessment of plastics in the National Trust: a case study at Mr Straw's House

The National Trust is a charity that cares for over 300 publically accessible historic buildings and their contents across England, Wales and Northern Ireland. There have been few previous studies on preservation of plastics within National Trust collections, which form a significant part of the more modern collections of objects. This paper describes the design of an assessment system which was successfully trialled at Mr Straws House, a National Trust property in Worksop, UK. This system can now be used for future plastic surveys at other National Trust properties. In addition, the survey gave valuable information about the state of the collection, demonstrating that the plastics that are deteriorating are those that are known to be vulnerable, namely cellulose nitrate/acetate, PVC and rubber. Verifying this knowledge of the most vulnerable plastics enables us to recommend to properties across National Trust that these types should be seen as a priority for correct storage and in-depth recording

Improved revealing of hidden structures and defects for historic art sculptures using poisson image editing

[EN] Radiography is a non-destructive tool and offers the acquisition of detailed information on the internal features of sculptures as a cultural heritage. However, radiographs contain different levels of blurriness mainly caused by the detection of scattered X-rays. Reduction of image blurriness provides improved contrast in targeted areas which enhances the extraction of information from the selected regions and features of the radiographs. In this study, we applied a set of convolution methods to a group of radiographic images of historic sculptures. Radiographs of the objects were provided with the associated documentation from the collection of the Radiographic Inspection Laboratory of the Universitat Politecnica de Valencia. The selection of the particular objects was based on the difference in the materials used in their construction i.e. the objects were made of wood, paper, or wax. The Poisson Image Editing (PIE) based on L-2-norm was applied for image enhancement of digital radiography images. The results showed that the PIE method was effective in selective region enhancement of the radiographic image contrast enabling better visualization of the objects' internal structures. The application of the implemented algorithm enabled the conservators and radiographers involved in the study to improve the visualization of the sculptures' internal features and defects enhance the defects' evaluation.Madrid García, JA.; Yahaghi, E.; Mirzapour, M.; Movafeghi, A. (2022). Improved revealing of hidden structures and defects for historic art sculptures using poisson image editing. Journal of Cultural Heritage. 55:381-390. https://doi.org/10.1016/j.culher.2022.04.0023813905

Digital technologies for virtual recomposition : the case study of Serpotta stuccoes

The matter that lies beneath the smooth and shining surface of stuccoes of the Serpotta family, who used to work in Sicily from 1670 to 1730, has been thoroughly studied in previous papers, disclosing the deep, even if empirical, knowledge of materials science that guided the artists in creating their master- works. In this work the attention is focused on the solid perspective and on the scenographic sculpture by Giacomo Serpotta, who is acknowledged as the leading exponent of the School. The study deals with some particular works of the artist, the so-called "teatrini" (Toy Theater), made by him for the San Lorenzo Oratory in Palermo. On the basis of archive documents and previous analogical photogrammetric plotting, integrated with digital solutions and methodologies of computer- based technologies, the study investigates and interprets the geometric-formal genesis of the examined works of art, until the prototyping of the whole scenic apparatus.peer-reviewe

Unsupervised hyperspectral image segmentation of films: a hierarchical clustering-based approach

Hyperspectral imaging (HSI) has been drastically applied in recent years to cultural heritage (CH) analysis, conservation, and also digital restoration. However, the efficient processing of the large datasets registered remains challenging and still in development. In this paper, we propose to use the hierarchical clustering algorithm (HCA) as an alternative machine learning approach to the most common practices, such as principal component analysis(PCA). HCA has shown its potential in the past decades for spectral data classification and segmentation in many other fields, maximizing the information to be extracted from the high-dimensional spectral dataset via the formation of the agglomerative hierarchical tree. However, to date, there has been very limited implementation of HCA in the field of cultural heritage. Data used in this experiment were acquired on real historic film samples with various degradation degrees, using a custom-made push-broom VNIR hyperspectral camera (380–780nm). With the proposed HCA workflow, multiple samples in the entire dataset were processed simultaneously and the degradation areas with distinctive characteristics were successfully segmented into clusters with various hierarchies. A range of algorithmic parameters was tested, including the grid sizes, metrics, and agglomeration methods, and the best combinations were proposed at the end. This novel application of the semi-automating and unsupervised HCA could provide a basis for future digital unfading, and show the potential to solve other CH problems such as pigment mapping