Image-based Search and Retrieval for Biface Artefacts using Features Capturing Archaeologically Significant Characteristics

Archaeologists are currently producing huge numbers of digitized photographs to record and preserve artefact finds. These images are used to identify and categorize artefacts and reason about connections between artefacts and perform outreach to the public. However, finding specific types of images within collections remains a major challenge. Often, the metadata associated with images is sparse or is inconsistent. This makes keyword-based exploratory search difficult, leaving researchers to rely on serendipity and slowing down the research process. We present an image-based retrieval system that addresses this problem for biface artefacts. In order to identify artefact characteristics that need to be captured by image features, we conducted a contextual inquiry study with experts in bifaces. We then devised several descriptors for matching images of bifaces with similar artefacts. We evaluated the performance of these descriptors using measures that specifically look at the differences between the sets of images returned by the search system using different descriptors. Through this nuanced approach, we have provided a comprehensive analysis of the strengths and weaknesses of the different descriptors and identified implications for design in the search systems for archaeology

Texture analysis and Its applications in biomedical imaging: a survey

Texture analysis describes a variety of image analysis techniques that quantify the variation in intensity and pattern. This paper provides an overview of several texture analysis approaches addressing the rationale supporting them, their advantages, drawbacks, and applications. This survey’s emphasis is in collecting and categorising over five decades of active research on texture analysis.Brief descriptions of different approaches are presented along with application examples. From a broad range of texture analysis applications, this survey’s final focus is on biomedical image analysis. An up-to-date list of biological tissues and organs in which disorders produce texture changes that may be used to spot disease onset and progression is provided. Finally, the role of texture analysis methods as biomarkers of disease is summarised.Manuscript received February 3, 2021; revised June 23, 2021; accepted September 21, 2021. Date of publication September 27, 2021; date of current version January 24, 2022. This work was supported in part by the Portuguese Foundation for Science and Technology (FCT) under Grants PTDC/EMD-EMD/28039/2017, UIDB/04950/2020, PestUID/NEU/04539/2019, and CENTRO-01-0145-FEDER-000016 and by FEDER-COMPETE under Grant POCI-01-0145-FEDER-028039. (Corresponding author: Rui Bernardes.)info:eu-repo/semantics/publishedVersio

Non-destructive quality control of carbon anodes using modal analysis, acousto-ultrasonic and latent variable methods

La performance des cuves d’électrolyse utilisées dans la production d’aluminium primaire par le procédé Hall-Héroult est fortement influencée par la qualité des anodes de carbone. Celles-ci sont de plus en plus variables en raison de la qualité décroissante des matières premières (coke et braie) et des changements de fournisseurs qui deviennent de plus en plus fréquents afin de réduire le coût d’achat et de rencontrer les spécifications des usines. En effet, les défauts des anodes, tels les fissures, les pores et les hétérogénéités, causés par cette variabilité, doivent être détectés le plus tôt possible afin d’éviter d’utiliser des anodes défectueuses dans les cuves et/ou d’apporter des ajustements au niveau du procédé de fabrication des anodes. Cependant, les fabricants d’anodes ne sont pas préparés pour réagir à cette situation afin de maintenir une qualité d'anode stable. Par conséquent, il devient prioritaire de développer des techniques permettant d’inspecter le volume complet de chaque anode individuelle afin d’améliorer le contrôle de la qualité des anodes et de compenser la variabilité provenant des matières premières. Un système d’inspection basé sur les techniques d’analyse modale et d’acousto-ultrasonique est proposé pour contrôler la qualité des anodes de manière rapide et non destructive. Les données massives (modes de vibration et signaux acoustiques) ont été analysées à l'aide de méthodes statistiques à variables latentes, telles que l'Analyse en Composantes Principales (ACP) et la Projection sur les Structures Latentes (PSL), afin de regrouper les anodes testées en fonction de leurs signatures vibratoires et acousto-ultrasoniques. Le système d'inspection a été premièrement investigué sur des tranches d'anodes industrielles et ensuite testé sur plusieurs anodes pleine grandeur produites sous différentes conditions à l’usine de Alcoa Deschambault au Québec (ADQ). La méthode proposée a permis de distinguer les anodes saines de celles contenant des défauts ainsi que d’identifier le type et la sévérité des défauts, et de les localiser. La méthode acousto-ultrasonique a été validée qualitativement par la tomographie à rayon-X, pour les analyses des tranches d’anodes. Pour les tests réalisés sur les blocs d’anode, la validation a été réalisée au moyen de photos recueillies après avoir coupé certaines anodes parmi celles testées.The performance of the Hall-Héroult electrolysis reduction process used for the industrial aluminium smelting is strongly influenced by the quality of carbon anodes, particularly by the presence of defects in their internal structure, such as cracks, pores and heterogeneities. This is partly due to the decreasing quality and increasing variability of the raw materials available on the market as well as the frequent suppliers changes made in order to meet the smelter’s specifications and to reduce purchasing costs. However, the anode producers are not prepared to cope with these variations and in order to maintain consistent anode quality. Consequently, it becomes a priority to develop alternative methods for inspecting each anode block to improve quality control and maintain consistent anode quality in spite of the variability of incoming raw materials.A rapid and non-destructive inspection system for anode quality control is proposed based on modal analysis and acousto-ultrasonic techniques. The large set of vibration and acousto-ultrasonic data collected from baked anode materials was analyzed using multivariate latent variable methods, such as Principal Component Analysis (PCA) and Partial Least Squares (PLS), in order to cluster the tested anodes based on vibration and their acousto-ultrasonic signatures. The inspection system was investigated first using slices collected from industrial anodes and then on several full size anodes produced under different conditions at the Alcoa Deschambault in Québec (ADQ). It is shown that the proposed method allows discriminating defect-free anodes from those containing various types of defects. In addition, the acousto-ultrasonic features obtained in different frequency ranges were found to be sensitive to the defects severities and were able to locate them in anode blocks. The acousto-ultrasonic method was validated qualitatively using X-ray computed tomography, when studying the anode slices. The results obtained on the full size anode blocks were validated by means of images collected after cutting some tested anodes

Study of the building and decorative materials and techniques used in Hungarian Roman sites

The aims of this research were: - To identify the characteristics, properties and provenance of the building and decorative material found in three Hungarian Roman sites: Nagyharsány, Nemesvámos-Balácapuszta and Aquincum - To provide a database of information on the different sites - To have an overview of main conservation strategies applied in Hungary. Geological studies, macroscopical and microscopical observations, XRD investigations, physical and chemical analyses allowed us to define the characteristics and properties of the different kinds of collected materials. Building stones sampled from Nagyharsány site showed two different kinds of massive limestone belonging to the areas surrounding the villa. Also Building stones sampled from Nemesvámos-Balácapuszta Roman villa proved to be compatible with limestone belonging to local sources. Mural painting fragments show that all samples are units composed of multilayered structures. Mosaic tesserae can be classified as following: -Pale yellow , blackish and pink tesserae are comparable with local limestone; -White tessera, composed of marble, was probably imported from distant regions of the Empire, as the usual practice of Romans. Mortars present different characteristics according to the age, the site and the functions: -Building mortars are generally lime based, white or pale yellow in colour, present a high percentage of aggregates represented by fine sand; -Supporting mortars from both mosaics and mural paintings are reddish or pinkish in colour, due to the presence of high percentage of brick dust and tiles fragments, and present a higher content of MgO. Although the condition of the sites, there is an insignificant content of soluble salts. Database The whole study has allowed us to provide work sheets for each samples, including all characteristics and properties. Furthermore, all sites included in the frame of the research have been described and illustrated on the base of their floor plans, material and construction methodologies. It can be concluded that: 1. In Nagyharsány Archaeological site, it is possible to define a sequence of different construction phases on the base of the study of building material and mortars. The results are comparable with the chronology of the site provided by the archaeologists 2. The material used for construction was of local origin while the more precious ones, used for decorative elements, were probably imported from long distance 3. Construction techniques in Hungary mainly refer to the usual Roman knowledge and practice (Vitruvius); few differences have been found 4. The database will represent an archive for Archaeologists, Historians and Conservators dealing with Roman period in Hungary

Authentication of Amadeo de Souza-Cardoso Paintings and Drawings With Deep Learning

Art forgery has a long-standing history that can be traced back to the Roman period and has become more rampant as the art market continues prospering. Reports disclosed that uncountable artworks circulating on the art market could be fake. Even some principal art museums and galleries could be exhibiting a good percentage of fake artworks. It is therefore substantially important to conserve cultural heritage, safeguard the interest of both the art market and the artists, as well as the integrity of artists’ legacies. As a result, art authentication has been one of the most researched and well-documented fields due to the ever-growing commercial art market in the past decades. Over the past years, the employment of computer science in the art world has flourished as it continues to stimulate interest in both the art world and the artificial intelligence arena. In particular, the implementation of Artificial Intelligence, namely Deep Learning algorithms and Neural Networks, has proved to be of significance for specialised image analysis. This research encompassed multidisciplinary studies on chemistry, physics, art and computer science. More specifically, the work presents a solution to the problem of authentication of heritage artwork by Amadeo de Souza-Cardoso, namely paintings, through the use of artificial intelligence algorithms. First, an authenticity estimation is obtained based on processing of images through a deep learning model that analyses the brushstroke features of a painting. Iterative, multi-scale analysis of the images is used to cover the entire painting and produce an overall indication of authenticity. Second, a mixed input, deep learning model is proposed to analyse pigments in a painting. This solves the image colour segmentation and pigment classification problem using hyperspectral imagery. The result is used to provide an indication of authenticity based on pigment classification and correlation with chemical data obtained via XRF analysis. Further algorithms developed include a deep learning model that tackles the pigment unmixing problem based on hyperspectral data. Another algorithm is a deep learning model that estimates hyperspectral images from sRGB images. Based on the established algorithms and results obtained, two applications were developed. First, an Augmented Reality mobile application specifically for the visualisation of pigments in the artworks by Amadeo. The mobile application targets the general public, i.e., art enthusiasts, museum visitors, art lovers or art experts. And second, a desktop application with multiple purposes, such as the visualisation of pigments and hyperspectral data. This application is designed for art specialists, i.e., conservators and restorers. Due to the special circumstances of the pandemic, trials on the usage of these applications were only performed within the Department of Conservation and Restoration at NOVA University Lisbon, where both applications received positive feedback.A falsificação de arte tem uma história de longa data que remonta ao período romano e tornou-se mais desenfreada à medida que o mercado de arte continua a prosperar. Relatórios revelaram que inúmeras obras de arte que circulam no mercado de arte podem ser falsas. Mesmo alguns dos principais museus e galerias de arte poderiam estar exibindo uma boa porcentagem de obras de arte falsas. Por conseguinte, é extremamente importante conservar o património cultural, salvaguardar os interesses do mercado da arte e dos artis- tas, bem como a integridade dos legados dos artistas. Como resultado, a autenticação de arte tem sido um dos campos mais pesquisados e bem documentados devido ao crescente mercado de arte comercial nas últimas décadas.Nos últimos anos, o emprego da ciência da computação no mundo da arte floresceu à medida que continua a estimular o interesse no mundo da arte e na arena da inteligência artificial. Em particular, a implementação da Inteligência Artificial, nomeadamente algoritmos de aprendizagem profunda (ou Deep Learning) e Redes Neuronais, tem-se revelado importante para a análise especializada de imagens.Esta investigação abrangeu estudos multidisciplinares em química, física, arte e informática. Mais especificamente, o trabalho apresenta uma solução para o problema da autenticação de obras de arte patrimoniais de Amadeo de Souza-Cardoso, nomeadamente pinturas, através da utilização de algoritmos de inteligência artificial. Primeiro, uma esti- mativa de autenticidade é obtida com base no processamento de imagens através de um modelo de aprendizagem profunda que analisa as características de pincelada de uma pintura. A análise iterativa e multiescala das imagens é usada para cobrir toda a pintura e produzir uma indicação geral de autenticidade. Em segundo lugar, um modelo misto de entrada e aprendizagem profunda é proposto para analisar pigmentos em uma pintura. Isso resolve o problema de segmentação de cores de imagem e classificação de pigmentos usando imagens hiperespectrais. O resultado é usado para fornecer uma indicação de autenticidade com base na classificação do pigmento e correlação com dados químicos obtidos através da análise XRF. Outros algoritmos desenvolvidos incluem um modelo de aprendizagem profunda que aborda o problema da desmistura de pigmentos com base em dados hiperespectrais. Outro algoritmo é um modelo de aprendizagem profunda estabelecidos e nos resultados obtidos, foram desenvolvidas duas aplicações. Primeiro, uma aplicação móvel de Realidade Aumentada especificamente para a visualização de pigmentos nas obras de Amadeo. A aplicação móvel destina-se ao público em geral, ou seja, entusiastas da arte, visitantes de museus, amantes da arte ou especialistas em arte. E, em segundo lugar, uma aplicação de ambiente de trabalho com múltiplas finalidades, como a visualização de pigmentos e dados hiperespectrais. Esta aplicação é projetada para especialistas em arte, ou seja, conservadores e restauradores. Devido às circunstâncias especiais da pandemia, os ensaios sobre a utilização destas aplicações só foram realizados no âmbito do Departamento de Conservação e Restauro da Universidade NOVA de Lisboa, onde ambas as candidaturas receberam feedback positivo

Remote Sensing and Geosciences for Archaeology

This book collects more than 20 papers, written by renowned experts and scientists from across the globe, that showcase the state-of-the-art and forefront research in archaeological remote sensing and the use of geoscientific techniques to investigate archaeological records and cultural heritage. Very high resolution satellite images from optical and radar space-borne sensors, airborne multi-spectral images, ground penetrating radar, terrestrial laser scanning, 3D modelling, Geographyc Information Systems (GIS) are among the techniques used in the archaeological studies published in this book. The reader can learn how to use these instruments and sensors, also in combination, to investigate cultural landscapes, discover new sites, reconstruct paleo-landscapes, augment the knowledge of monuments, and assess the condition of heritage at risk. Case studies scattered across Europe, Asia and America are presented: from the World UNESCO World Heritage Site of Lines and Geoglyphs of Nasca and Palpa to heritage under threat in the Middle East and North Africa, from coastal heritage in the intertidal flats of the German North Sea to Early and Neolithic settlements in Thessaly. Beginners will learn robust research methodologies and take inspiration; mature scholars will for sure derive inputs for new research and applications

VR Technologies in Cultural Heritage

This open access book constitutes the refereed proceedings of the First International Conference on VR Technologies in Cultural Heritage, VRTCH 2018, held in Brasov, Romania in May 2018. The 13 revised full papers along with the 5 short papers presented were carefully reviewed and selected from 21 submissions. The papers of this volume are organized in topical sections on data acquisition and modelling, visualization methods / audio, sensors and actuators, data management, restoration and digitization, cultural tourism

Advanced Techniques for Ground Penetrating Radar Imaging

Ground penetrating radar (GPR) has become one of the key technologies in subsurface sensing and, in general, in non-destructive testing (NDT), since it is able to detect both metallic and nonmetallic targets. GPR for NDT has been successfully introduced in a wide range of sectors, such as mining and geology, glaciology, civil engineering and civil works, archaeology, and security and defense. In recent decades, improvements in georeferencing and positioning systems have enabled the introduction of synthetic aperture radar (SAR) techniques in GPR systems, yielding GPR–SAR systems capable of providing high-resolution microwave images. In parallel, the radiofrequency front-end of GPR systems has been optimized in terms of compactness (e.g., smaller Tx/Rx antennas) and cost. These advances, combined with improvements in autonomous platforms, such as unmanned terrestrial and aerial vehicles, have fostered new fields of application for GPR, where fast and reliable detection capabilities are demanded. In addition, processing techniques have been improved, taking advantage of the research conducted in related fields like inverse scattering and imaging. As a result, novel and robust algorithms have been developed for clutter reduction, automatic target recognition, and efficient processing of large sets of measurements to enable real-time imaging, among others. This Special Issue provides an overview of the state of the art in GPR imaging, focusing on the latest advances from both hardware and software perspectives

Addressing subjectivity in the classification of palaeoenvironmental remains with supervised deep learning convolutional neural networks

Archaeological object identifications have been traditionally undertaken through a comparative methodology where each artefact is identified through a subjective, interpretative act by a professional. Regarding palaeoenvironmental remains, this comparative methodology is given boundaries by using reference materials and codified sets of rules, but subjectivity is nevertheless present. The problem with this traditional archaeological methodology is that higher level of subjectivity in the identification of artefacts leads to inaccuracies, which then increases the potential for Type I and Type II errors in the testing of hypotheses. Reducing the subjectivity of archaeological identifications would improve the statistical power of archaeological analyses, which would subsequently lead to more impactful research. In this thesis, it is shown that the level of subjectivity in palaeoenvironmental research can be reduced by applying deep learning convolutional neural networks within an image recognition framework. The primary aim of the presented research is therefore to further the on-going paradigm shift in archaeology towards model-based object identifications, particularly within the realm of palaeoenvironmental remains. Although this thesis focuses on the identification of pollen grains and animal bones, with the latter being restricted to the astragalus of sheep and goats, there are wider implications for archaeology as these methods can easily be extended beyond pollen and animal remains. The previously published POLEN23E dataset is used as the pilot study of applying deep learning in pollen grain classification. In contrast, an image dataset of modern bones was compiled for the classification of sheep and goat astragali due to a complete lack of available bone image datasets and a double blind study with inexperienced and experienced zooarchaeologists was performed to have a benchmark to which image recognition models can be compared. In both classification tasks, the presented models outperform all previous formal modelling methods and only the best human analysts match the performance of the deep learning model in the sheep and goat astragalus separation task. Throughout the thesis, there is a specific focus on increasing trust in the models through the visualization of the models’ decision making and avenues of improvements to Grad-CAM are explored. This thesis makes an explicit case for the phasing out of the comparative methods in favour of a formal modelling framework within archaeology, especially in palaeoenvironmental object identification