Craquelure as a Graph: Application of Image Processing and Graph Neural Networks to the Description of Fracture Patterns

Cracks on a painting is not a defect but an inimitable signature of an artwork which can be used for origin examination, aging monitoring, damage identification, and even forgery detection. This work presents the development of a new methodology and corresponding toolbox for the extraction and characterization of information from an image of a craquelure pattern. The proposed approach processes craquelure network as a graph. The graph representation captures the network structure via mutual organization of junctions and fractures. Furthermore, it is invariant to any geometrical distortions. At the same time, our tool extracts the properties of each node and edge individually, which allows to characterize the pattern statistically. We illustrate benefits from the graph representation and statistical features individually using novel Graph Neural Network and hand-crafted descriptors correspondingly. However, we also show that the best performance is achieved when both techniques are merged into one framework. We perform experiments on the dataset for paintings' origin classification and demonstrate that our approach outperforms existing techniques by a large margin.Comment: Published in ICCV 2019 Workshop

Context-Aware Embeddings for Automatic Art Analysis

Automatic art analysis aims to classify and retrieve artistic representations from a collection of images by using computer vision and machine learning techniques. In this work, we propose to enhance visual representations from neural networks with contextual artistic information. Whereas visual representations are able to capture information about the content and the style of an artwork, our proposed context-aware embeddings additionally encode relationships between different artistic attributes, such as author, school, or historical period. We design two different approaches for using context in automatic art analysis. In the first one, contextual data is obtained through a multi-task learning model, in which several attributes are trained together to find visual relationships between elements. In the second approach, context is obtained through an art-specific knowledge graph, which encodes relationships between artistic attributes. An exhaustive evaluation of both of our models in several art analysis problems, such as author identification, type classification, or cross-modal retrieval, show that performance is improved by up to 7.3% in art classification and 37.24% in retrieval when context-aware embeddings are used

Situated and distributed cognition in artifact negotiation and trade-specific skills: A cognitive ethnography of Kashmiri carpet weaving practice

This article describes various ways actors in Kashmiri carpet weaving practice deploy a range of artifacts, from symbolic, to material, to hybrid, in order to achieve diverse cognitive accomplishments in their particular task domains: information representation, inter and intra-domain communication, distribution of cognitive labor across people and time, coordination of team activities, and carrying of cultural heritage. In this repertoire, some artifacts position themselves as naïve tools in the actors’ environment to the point of being ignored; however, their usage-in-context unfolds their cognitive involvement in the tasks. These usages-in-context are shown through artifact analysis of their routine, improvised, and opportunistic uses, where cognitive artifacts like talim—the central artifact of this practice—are shown to play not only multifunctional roles beyond representation, but are also complemented by trade-specific skills bearing strong cognitive implications in a task