Towards an All-Purpose Content-Based Multimedia Information Retrieval System

The growth of multimedia collections - in terms of size, heterogeneity, and variety of media types - necessitates systems that are able to conjointly deal with several forms of media, especially when it comes to searching for particular objects. However, existing retrieval systems are organized in silos and treat different media types separately. As a consequence, retrieval across media types is either not supported at all or subject to major limitations. In this paper, we present vitrivr, a content-based multimedia information retrieval stack. As opposed to the keyword search approach implemented by most media management systems, vitrivr makes direct use of the object's content to facilitate different types of similarity search, such as Query-by-Example or Query-by-Sketch, for and, most importantly, across different media types - namely, images, audio, videos, and 3D models. Furthermore, we introduce a new web-based user interface that enables easy-to-use, multimodal retrieval from and browsing in mixed media collections. The effectiveness of vitrivr is shown on the basis of a user study that involves different query and media types. To the best of our knowledge, the full vitrivr stack is unique in that it is the first multimedia retrieval system that seamlessly integrates support for four different types of media. As such, it paves the way towards an all-purpose, content-based multimedia information retrieval system

A Review of Audio Features and Statistical Models Exploited for Voice Pattern Design

Audio fingerprinting, also named as audio hashing, has been well-known as a powerful technique to perform audio identification and synchronization. It basically involves two major steps: fingerprint (voice pattern) design and matching search. While the first step concerns the derivation of a robust and compact audio signature, the second step usually requires knowledge about database and quick-search algorithms. Though this technique offers a wide range of real-world applications, to the best of the authors' knowledge, a comprehensive survey of existing algorithms appeared more than eight years ago. Thus, in this paper, we present a more up-to-date review and, for emphasizing on the audio signal processing aspect, we focus our state-of-the-art survey on the fingerprint design step for which various audio features and their tractable statistical models are discussed.Comment: http://www.iaria.org/conferences2015/PATTERNS15.html ; Seventh International Conferences on Pervasive Patterns and Applications (PATTERNS 2015), Mar 2015, Nice, Franc

Physical mapping integrated with syntenic analysis to characterize the gene space of the long arm of wheat chromosome 1A

Background: Bread wheat (Triticum aestivum L.) is one of the most important crops worldwide and its production faces pressing challenges, the solution of which demands genome information. However, the large, highly repetitive hexaploid wheat genome has been considered intractable to standard sequencing approaches. Therefore the International Wheat Genome Sequencing Consortium (IWGSC) proposes to map and sequence the genome on a chromosome-by-chromosome basis. Methodology/Principal Findings: We have constructed a physical map of the long arm of bread wheat chromosome 1A using chromosome-specific BAC libraries by High Information Content Fingerprinting (HICF). Two alternative methods (FPC and LTC) were used to assemble the fingerprints into a high-resolution physical map of the chromosome arm. A total of 365 molecular markers were added to the map, in addition to 1122 putative unique transcripts that were identified by microarray hybridization. The final map consists of 1180 FPC based or 583 LTC based contigs. Conclusions/Significance: The physical map presented here marks an important step forward in mapping of hexaploid bread wheat. The map is orders of magnitude more detailed than previously available maps of this chromosome, and the assignment of over a thousand putative expressed gene sequences to specific map locations will greatly assist future functional studies. This map will be an essential tool for future sequencing of and positional cloning within chromosome 1A

Maryland v. King: The Fourth Amendment Spirals Down the Double Helix

This commentary previews an upcoming Supreme Court case, Maryland v. King, in which the Court may decide whether requiring an arrestee to submit to a buccal swab for identification purposes violates the arrestee\u27s privacy interests under the Fourth Amendment

Hybrid-State Free Precession in Nuclear Magnetic Resonance

The dynamics of large spin-1/2 ensembles in the presence of a varying magnetic field are commonly described by the Bloch equation. Most magnetic field variations result in unintuitive spin dynamics, which are sensitive to small deviations in the driving field. Although simplistic field variations can produce robust dynamics, the captured information content is impoverished. Here, we identify adiabaticity conditions that span a rich experiment design space with tractable dynamics. These adiabaticity conditions trap the spin dynamics in a one-dimensional subspace. Namely, the dynamics is captured by the absolute value of the magnetization, which is in a transient state, while its direction adiabatically follows the steady state. We define the hybrid state as the co-existence of these two states and identify the polar angle as the effective driving force of the spin dynamics. As an example, we optimize this drive for robust and efficient quantification of spin relaxation times and utilize it for magnetic resonance imaging of the human brain

Fat fraction mapping using bSSFP Signal Profile Asymmetries for Robust multi-Compartment Quantification (SPARCQ)

Purpose: To develop a novel quantitative method for detection of different tissue compartments based on bSSFP signal profile asymmetries (SPARCQ) and to provide a validation and proof-of-concept for voxel-wise water-fat separation and fat fraction mapping. Methods: The SPARCQ framework uses phase-cycled bSSFP acquisitions to obtain bSSFP signal profiles. For each voxel, the profile is decomposed into a weighted sum of simulated profiles with specific off-resonance and relaxation time ratios. From the obtained set of weights, voxel-wise estimations of the fractions of the different components and their equilibrium magnetization are extracted. For the entire image volume, component-specific quantitative maps as well as banding-artifact-free images are generated. A SPARCQ proof-of-concept was provided for water-fat separation and fat fraction mapping. Noise robustness was assessed using simulations. A dedicated water-fat phantom was used to validate fat fractions estimated with SPARCQ against gold-standard 1H MRS. Quantitative maps were obtained in knees of six healthy volunteers, and SPARCQ repeatability was evaluated in scan rescan experiments. Results: Simulations showed that fat fraction estimations are accurate and robust for signal-to-noise ratios above 20. Phantom experiments showed good agreement between SPARCQ and gold-standard (GS) fat fractions (fF(SPARCQ) = 1.02*fF(GS) + 0.00235). In volunteers, quantitative maps and banding-artifact-free water-fat-separated images obtained with SPARCQ demonstrated the expected contrast between fatty and non-fatty tissues. The coefficient of repeatability of SPARCQ fat fraction was 0.0512. Conclusion: The SPARCQ framework was proposed as a novel quantitative mapping technique for detecting different tissue compartments, and its potential was demonstrated for quantitative water-fat separation.Comment: 20 pages, 7 figures, submitted to Magnetic Resonance in Medicin