Post-Acquisition Small-Animal Respiratory Gated Imaging Using Micro Cone-Beam CT

On many occasions, it is desirable to image lungs in vivo to perform a pulmonary physiology study. Since the lungs are moving, gating with respect to the ventilatory phase has to be performed in order to minimize motion artifacts. Gating can be done in real time, similar to cardiac imaging in clinical applications, however, there are technical problems that have lead us to investigate different approaches. The problems include breath-to-breath inconsistencies in tidal volume, which makes the precise detection of ventilatory phase difficult, and the relatively high ventilation rates seen in small animals (rats and mice have ventilation rates in the range of a hundred cycles per minute), which challenges the capture rate of many imaging systems (this is particularly true of our system which utilizes cone-beam geometry and a 2 dimensional detector). Instead of pre-capture ventilation gating we implemented a method of post-acquisition gating. We acquire a sequence of projections images at 30 frames per second for each of 360 viewing angles. During each capture sequence the rat undergoes multiple ventilation cycles. Using the sequence of projection images, an automated region of interest algorithm, based on integrated grayscale intensity, tracts the ventilatory phase of the lungs. In the processing of an image sequence, multiple projection images are identified at a particular phase and averaged to improve the signal-to-ratio. The resulting averaged projection images are input to a Feldkamp cone-beam algorithm reconstruction algorithm in order to obtain isotropic image volumes. Minimal motion artifact data sets improve qualitative and quantitative analysis techniques useful in physiologic studies of pulmonary structure and function

Semantic analysis of field sports video using a petri-net of audio-visual concepts

The most common approach to automatic summarisation and highlight detection in sports video is to train an automatic classifier to detect semantic highlights based on occurrences of low-level features such as action replays, excited commentators or changes in a scoreboard. We propose an alternative approach based on the detection of perception concepts (PCs) and the construction of Petri-Nets which can be used for both semantic description and event detection within sports videos. Low-level algorithms for the detection of perception concepts using visual, aural and motion characteristics are proposed, and a series of Petri-Nets composed of perception concepts is formally defined to describe video content. We call this a Perception Concept Network-Petri Net (PCN-PN) model. Using PCN-PNs, personalized high-level semantic descriptions of video highlights can be facilitated and queries on high-level semantics can be achieved. A particular strength of this framework is that we can easily build semantic detectors based on PCN-PNs to search within sports videos and locate interesting events. Experimental results based on recorded sports video data across three types of sports games (soccer, basketball and rugby), and each from multiple broadcasters, are used to illustrate the potential of this framework

Aerial moving target detection based on motion vector field analysis

An efficient automatic detection strategy for aerial moving targets in airborne forward-looking infrared (FLIR) imagery is presented in this paper. Airborne cameras induce a global motion over all objects in the image, that invalidates motion-based segmentation techniques for static cameras. To overcome this drawback, previous works compensate the camera ego-motion. However, this approach is too much dependent on the quality of the ego-motion compensation, tending towards an over-detection. In this work, the proposed strategy estimates a robust motion vector field, free of erroneous vectors. Motion vectors are classified into different independent moving objects, corresponding to background objects and aerial targets. The aerial targets are directly segmented using their associated motion vectors. This detection strategy has a low computational cost, since no compensation process or motion-based technique needs to be applied. Excellent results have been obtained over real FLIR sequences

Indexing of fictional video content for event detection and summarisation

This paper presents an approach to movie video indexing that utilises audiovisual analysis to detect important and meaningful temporal video segments, that we term events. We consider three event classes, corresponding to dialogues, action sequences, and montages, where the latter also includes musical sequences. These three event classes are intuitive for a viewer to understand and recognise whilst accounting for over 90% of the content of most movies. To detect events we leverage traditional filmmaking principles and map these to a set of computable low-level audiovisual features. Finite state machines (FSMs) are used to detect when temporal sequences of specific features occur. A set of heuristics, again inspired by filmmaking conventions, are then applied to the output of multiple FSMs to detect the required events. A movie search system, named MovieBrowser, built upon this approach is also described. The overall approach is evaluated against a ground truth of over twenty-three hours of movie content drawn from various genres and consistently obtains high precision and recall for all event classes. A user experiment designed to evaluate the usefulness of an event-based structure for both searching and browsing movie archives is also described and the results indicate the usefulness of the proposed approach

Improved GelSight Tactile Sensor for Measuring Geometry and Slip

A GelSight sensor uses an elastomeric slab covered with a reflective membrane to measure tactile signals. It measures the 3D geometry and contact force information with high spacial resolution, and successfully helped many challenging robot tasks. A previous sensor, based on a semi-specular membrane, produces high resolution but with limited geometry accuracy. In this paper, we describe a new design of GelSight for robot gripper, using a Lambertian membrane and new illumination system, which gives greatly improved geometric accuracy while retaining the compact size. We demonstrate its use in measuring surface normals and reconstructing height maps using photometric stereo. We also use it for the task of slip detection, using a combination of information about relative motions on the membrane surface and the shear distortions. Using a robotic arm and a set of 37 everyday objects with varied properties, we find that the sensor can detect translational and rotational slip in general cases, and can be used to improve the stability of the grasp.Comment: IEEE/RSJ International Conference on Intelligent Robots and System

Motion magnification in coronal seismology

We introduce a new method for the investigation of low-amplitude transverse oscillations of solar plasma non-uniformities, such as coronal loops, individual strands in coronal arcades, jets, prominence fibrils, polar plumes, and other contrast features, observed with imaging instruments. The method is based on the two-dimensional dual tree complex wavelet transform (DT$\mathbb{C}$WT). It allows us to magnify transverse, in the plane-of-the-sky, quasi-periodic motions of contrast features in image sequences. The tests performed on the artificial data cubes imitating exponentially decaying, multi-periodic and frequency-modulated kink oscillations of coronal loops showed the effectiveness, reliability and robustness of this technique. The algorithm was found to give linear scaling of the magnified amplitudes with the original amplitudes provided they are sufficiently small. Also, the magnification is independent of the oscillation period in a broad range of the periods. The application of this technique to SDO/AIA EUV data cubes of a non-flaring active region allowed for the improved detection of low-amplitude decay-less oscillations in the majority of loops.Comment: Accepted for publication in Solar Physic