The hunt for submarines in classical art: mappings between scientific invention and artistic interpretation

This is a report to the AHRC's ICT in Arts and Humanities Research Programme. This report stems from a project which aimed to produce a series of mappings between advanced imaging information and communications technologies (ICT) and needs within visual arts research. A secondary aim was to demonstrate the feasibility of a structured approach to establishing such mappings. The project was carried out over 2006, from January to December, by the visual arts centre of the Arts and Humanities Data Service (AHDS Visual Arts).1 It was funded by the Arts and Humanities Research Council (AHRC) as one of the Strategy Projects run under the aegis of its ICT in Arts and Humanities Research programme. The programme, which runs from October 2003 until September 2008, aims ‘to develop, promote and monitor the AHRC’s ICT strategy, and to build capacity nation-wide in the use of ICT for arts and humanities research’.2 As part of this, the Strategy Projects were intended to contribute to the programme in two ways: knowledge-gathering projects would inform the programme’s Fundamental Strategic Review of ICT, conducted for the AHRC in the second half of 2006, focusing ‘on critical strategic issues such as e-science and peer-review of digital resources’. Resource-development projects would ‘build tools and resources of broad relevance across the range of the AHRC’s academic subject disciplines’.3 This project fell into the knowledge-gathering strand. The project ran under the leadership of Dr Mike Pringle, Director, AHDS Visual Arts, and the day-to-day management of Polly Christie, Projects Manager, AHDS Visual Arts. The research was carried out by Dr Rupert Shepherd

Deep Lesion Graphs in the Wild: Relationship Learning and Organization of Significant Radiology Image Findings in a Diverse Large-scale Lesion Database

Radiologists in their daily work routinely find and annotate significant abnormalities on a large number of radiology images. Such abnormalities, or lesions, have collected over years and stored in hospitals' picture archiving and communication systems. However, they are basically unsorted and lack semantic annotations like type and location. In this paper, we aim to organize and explore them by learning a deep feature representation for each lesion. A large-scale and comprehensive dataset, DeepLesion, is introduced for this task. DeepLesion contains bounding boxes and size measurements of over 32K lesions. To model their similarity relationship, we leverage multiple supervision information including types, self-supervised location coordinates and sizes. They require little manual annotation effort but describe useful attributes of the lesions. Then, a triplet network is utilized to learn lesion embeddings with a sequential sampling strategy to depict their hierarchical similarity structure. Experiments show promising qualitative and quantitative results on lesion retrieval, clustering, and classification. The learned embeddings can be further employed to build a lesion graph for various clinically useful applications. We propose algorithms for intra-patient lesion matching and missing annotation mining. Experimental results validate their effectiveness.Comment: Accepted by CVPR2018. DeepLesion url adde

Action Recognition in Videos: from Motion Capture Labs to the Web

This paper presents a survey of human action recognition approaches based on visual data recorded from a single video camera. We propose an organizing framework which puts in evidence the evolution of the area, with techniques moving from heavily constrained motion capture scenarios towards more challenging, realistic, "in the wild" videos. The proposed organization is based on the representation used as input for the recognition task, emphasizing the hypothesis assumed and thus, the constraints imposed on the type of video that each technique is able to address. Expliciting the hypothesis and constraints makes the framework particularly useful to select a method, given an application. Another advantage of the proposed organization is that it allows categorizing newest approaches seamlessly with traditional ones, while providing an insightful perspective of the evolution of the action recognition task up to now. That perspective is the basis for the discussion in the end of the paper, where we also present the main open issues in the area.Comment: Preprint submitted to CVIU, survey paper, 46 pages, 2 figures, 4 table

Three-dimensional distribution of primary melt inclusions in garnets by X-ray microtomography

open6X-ray computed microtomography (X-mu CT) is applied here to investigate in a non-invasive way the three-dimensional (3D) spatial distribution of primary melt and fluid inclusions in gamets from the metapeitic enclaves of El Hoyazo and from the migmatitcs of Sierra Alpujata, Spain. Attention is focused on a particular case of inhomogeneous distribution of inclusions, characterized by inclusion-rich cores and almost inclusion-free rims (i.e., zonal arrangement), that has been previously investigated in detail only by means of 2D conventional methods. Different experimental X-mu CT configurations, both synchrotron radiation- and X-ray tube-based, are employed to explore the limits of the technique. The internal features of the samples are successfully imaged, with spatial resolution down to a few micrometers. By means of dedicated image processing protocols, the lighter melt and fluid inclusions can be separated from the heavier host garnet and from other non-relevant features (e.g., other mineral phases or large voids). This allows evaluating the volumetric density of inclusions within spherical shells as a function of the radial distance from the center of the host garnets. The 3D spatial distribution of heavy mineral inclusions is investigated as well and compared with that of melt inclusions. Data analysis reveals the occurrence of a clear peak of melt and fluid inclusions density, ranging approximately from 1/3 to 1/2 of the radial distance from the center of the distribution and a gradual decrease from the peak outward. heavy mineral inclusions appear to be almost absent in the central portion of the garnets and more randomly arranged, showing no correlation with the distribution of melt and fluid inclusions. To reduce the effect of geometric artifacts arising from the non-spherical shape of the distribution, the inclusion density was calculated also along narrow prisms with different orientations, obtaining plots of pseudo-linear distributions. The results show that the core-rim transition is characterized by a rapid (but not step-like) decrease in inclusion density, occurring in a continuous mode. X-ray tomographic data, combined with electron microprobe chemical profiles of selected elements, suggest that despite the inhomogeneous distribution of inclusions, the investigated garnets have grown in one single progressive episode in the presence of anatectic melt. The continuous drop of inclusion density suggests a similar decline in (radial) garnet growth, which is a natural consequence in the case of a constant reaction rate. Our results confirm the advantages of high-resolution X-mu CT compared to conventional destructive 2D observations for the analysis of the spatial distribution of micrometer-scale inclusions in minerals, owing to its non-invasive 3D capabilities. The same approach can be extended to the study of different microstructural features in samples from a wide variety of geological settings.openParisatto, Matteo; Turina, Alice; Cruciani, Giuseppe; Mancini, Lucia; Peruzzo, Luca; Cesare, BernardoParisatto, Matteo; Turina, Alice; Cruciani, Giuseppe; Mancini, Lucia; Peruzzo, Luca; Cesare, Bernard

From 3D Point Clouds to Pose-Normalised Depth Maps

We consider the problem of generating either pairwise-aligned or pose-normalised depth maps from noisy 3D point clouds in a relatively unrestricted poses. Our system is deployed in a 3D face alignment application and consists of the following four stages: (i) data filtering, (ii) nose tip identification and sub-vertex localisation, (iii) computation of the (relative) face orientation, (iv) generation of either a pose aligned or a pose normalised depth map. We generate an implicit radial basis function (RBF) model of the facial surface and this is employed within all four stages of the process. For example, in stage (ii), construction of novel invariant features is based on sampling this RBF over a set of concentric spheres to give a spherically-sampled RBF (SSR) shape histogram. In stage (iii), a second novel descriptor, called an isoradius contour curvature signal, is defined, which allows rotational alignment to be determined using a simple process of 1D correlation. We test our system on both the University of York (UoY) 3D face dataset and the Face Recognition Grand Challenge (FRGC) 3D data. For the more challenging UoY data, our SSR descriptors significantly outperform three variants of spin images, successfully identifying nose vertices at a rate of 99.6%. Nose localisation performance on the higher quality FRGC data, which has only small pose variations, is 99.9%. Our best system successfully normalises the pose of 3D faces at rates of 99.1% (UoY data) and 99.6% (FRGC data)