Structured Sparsity Models for Multiparty Speech Recovery from Reverberant Recordings

We tackle the multi-party speech recovery problem through modeling the acoustic of the reverberant chambers. Our approach exploits structured sparsity models to perform room modeling and speech recovery. We propose a scheme for characterizing the room acoustic from the unknown competing speech sources relying on localization of the early images of the speakers by sparse approximation of the spatial spectra of the virtual sources in a free-space model. The images are then clustered exploiting the low-rank structure of the spectro-temporal components belonging to each source. This enables us to identify the early support of the room impulse response function and its unique map to the room geometry. To further tackle the ambiguity of the reflection ratios, we propose a novel formulation of the reverberation model and estimate the absorption coefficients through a convex optimization exploiting joint sparsity model formulated upon spatio-spectral sparsity of concurrent speech representation. The acoustic parameters are then incorporated for separating individual speech signals through either structured sparse recovery or inverse filtering the acoustic channels. The experiments conducted on real data recordings demonstrate the effectiveness of the proposed approach for multi-party speech recovery and recognition.Comment: 31 page

Recent advances in directional statistics

Mainstream statistical methodology is generally applicable to data observed in Euclidean space. There are, however, numerous contexts of considerable scientific interest in which the natural supports for the data under consideration are Riemannian manifolds like the unit circle, torus, sphere and their extensions. Typically, such data can be represented using one or more directions, and directional statistics is the branch of statistics that deals with their analysis. In this paper we provide a review of the many recent developments in the field since the publication of Mardia and Jupp (1999), still the most comprehensive text on directional statistics. Many of those developments have been stimulated by interesting applications in fields as diverse as astronomy, medicine, genetics, neurology, aeronautics, acoustics, image analysis, text mining, environmetrics, and machine learning. We begin by considering developments for the exploratory analysis of directional data before progressing to distributional models, general approaches to inference, hypothesis testing, regression, nonparametric curve estimation, methods for dimension reduction, classification and clustering, and the modelling of time series, spatial and spatio-temporal data. An overview of currently available software for analysing directional data is also provided, and potential future developments discussed.Comment: 61 page

The QM9 Benchmark

e3nn is an artificial neural network which operates on atomic coordinates and achieves equivariance to the special euclidean group in three dimensions by using spherical harmonics as features. The main experiment is to benchmark the model against a standard chemical data set called QM9, on which e3nn achieves state of the art performance on three of twelve regression targets. Along with empirical results, this thesis presents theoretical argumentation for why e3nn outperforms its closest relatives, SchNet and Cormorant, on some regression targets. Significant background regarding machine learning, quantum chemistry, and the special euclidean group is also presented

Studies of spacetimes with spatial topologies S3 and S1 X S2

The purpose of this work is to introduce a new analytical and numerical approach to the treatment of the initial value problem for the vacuum Einstein field equations on spacetimes with spatial topologies S3 or S1 × S2 and symmetry groups U(1) or U(1)×U(1). The general idea consists of taking advantage of the action of the symmetry group U(1) to rewrite those spacetimes as a principal fiber bundle, which is trivial for S1 × S2 but not for S3. Thus, the initial value problem in four dimensions can be reduced to a three-dimensional initial value problem for a certain manifold with spatial topology S2. Furthermore, we avoid coordinate representations that suffer from coordinate singularities for S2 by expressing all the fields in terms of the spin-weighted spherical harmonics. We use the generalized wave map formalism to reduce the vacuum Einstein field equations on a manifold with three spatial dimensions to a system of quasilinear wave equations in terms of generalized gauge source functions with well-defined spin-weights. As a result, thanks to the fully tensorial character of these equations, the system of evolution equations can be solved numerically using a 2 + 1-pseudo-spectral approach based on a spin-weighted spherical harmonic transform. In this work, however, we apply our infrastructure to the study of Gowdy symmetric spacetimes, where thanks to the symmetry group U(1) × U(1), the system of hyperbolic equations obtained from the vacuum Einstein field equations can be reduced to a 1+1-system of partial differential equations. Therefore, we introduce an axial symmetric spin-weighted transform that provides an efficient treatment of axially symmetric functions in S2 by reducing the complexity of the general transform. To analyse the consistency, accuracy, and feasibility of our numerical infrastructure, we reproduce an inhomogeneous cosmological solution of the vacuum Einstein field quations with spatial topology S3 . In addition, we consider two applications of our infrastructure. In the first one, we numerically explore the behaviour of Gowdy S1 × S2 spacetimes using our infrastructure. In particular, we study the behaviour of some geometrical quantities to investigate the behaviour of those spacetimes when approach a future singularity. As a second application, we conduct a systematic investigation on the non-linear instability of the Nariai spacetime and the asymptotic behaviour of its perturbations

Spectral Clustering en IRM de diffusion pour Retrouver les Faisceaux de la Matière Blanche

White matter fiber clustering allows to get insight about anatomical structures in order to generate atlases, perform clear visualizations and compute statistics across subjects, all important and current neuroimaging problems. In this work, we present a Diffusion Maps clustering method applied to diffusion MRI in order to cluster and segment complex white matter fiber bundles. It is well-known that Diffusion Tensor Imaging (DTI) is restricted in complex fiber regions with crossings and this is why recent High Angular Resolution Diffusion Imaging (HARDI) such has Q-Ball Imaging (QBI) have been introduced to overcome these limitations. QBI reconstructs the diffusion orientation distribution function (ODF), a spherical function that has its maxima agreeing with the underlying fiber populations. In this paper, we introduce the usage of the Diffusion Maps technique and show how it can be used to directly cluster set of fiber tracts, that could be obtained through a streamline tractography for instance, and how it can also help in segmenting fields of ODF images, obtained through a linear and regularized ODF estimation algorithm based on a spherical harmonics representation of the Q-Ball data. We first show the advantage of using Diffusion Maps clustering over classical methods such as N-Cuts and Laplacian Eigenmaps in both cases. In particular, our Diffusion Maps requires a smaller number of hypothesis from the input data, reduces the number of artifacts in fiber tract clustering and ODF image segmentation and automatically exhibits the number of clusters in both cases by using an adaptive scale-space parameter. We also show that our ODF Diffusion Maps clustering can reproduce published results using the diffusion tensor (DT) clustering with N-Cuts on simple synthetic images without crossings. On more complex data with crossings, we show that our ODF-based method succeeds to separate fiber bundles and crossing regions whereas the DT-based methods generate artifacts and exhibit wrong number of clusters. Finally, we illustrate the potential of our approach on a real brain dataset where we successfully segment well-known fiber bundles

High rank tensor and spherical harmonic models for diffusion MRI processing

Diffusion tensor imaging (DTI) is a non-invasive quantitative method of characterizing tissue micro-structure. Diffusion imaging attempts to characterize the manner by which the water molecules within a particular location move within a given amount of time. Measurement of the diffusion tensor (D) within a voxel allows a macroscopic voxel-averaged description of fiber structure, orientation and fully quantitative evaluation of the microstructural features of healthy and diseased tissue.;The rank two tensor model is incapable of resolving multiple fiber orientations within an individual voxel. This shortcoming of single tensor model stems from the fact that the tensor possesses only a single orientational maximum. Several authors reported this non-mono-exponential behavior for the diffusion-induced attenuation in brain tissue in water and N-Acetyl Aspartate (NAA) signals, that is why the Multi-Tensor, Higher Rank Tensor and Orientation Distribution Function (ODF) were introduced.;Using the higher rank tensor, we will propose a scheme for tensor field interpolation which is inspired by subdivision surfaces in computer graphics. The method applies to Cartesian tensors of all ranks and imposes smoothness on the interpolated field by constraining the divergence and curl of the tensor field. Results demonstrate that the subdivision scheme can better preserve anisotropicity and interpolate rotations than some other interpolation methods. As one of the most important applications of DTI, fiber tractography was implemented to study the shape geometry changes. Based on the divergence and curl measurement, we will introduce new scalar measures that are sensitive to behaviors such as fiber bending and fanning.;Based on the ODF analysis, a new anisotropy measure that has the ability to describe multi-fiber heterogeneity while remaining rotationally invariant, will be introduced, which is a problem with many other anisotropy measures defined using the ODF. The performance of this novel measure is demonstrated for data with varying Signal to Noise Ratio (SNR), and different material characteristics

Cooperative Position and Orientation Estimation with Multi-Mode Antennas

Robotic multi-agent systems are envisioned for planetary exploration and terrestrial applications. Autonomous operation of robots requires estimations of their positions and orientations, which are obtained from the direction-of-arrival (DoA) and the time-of-arrival (ToA) of radio signals exchanged among the agents. In this thesis, we estimate the signal DoA and ToA using a multi-mode antenna (MMA). An MMA is a single antenna element, where multiple orthogonal current modes are excited by different antenna ports. We provide a first study on the use of MMAs for cooperative position and orientation estimation, specifically exploring their DoA estimation capabilities. Assuming the agents of a cooperative network are equipped with MMAs, lower bounds on the achievable position and orientation accuracy are derived. We realize a gap between the theoretical lower bounds and real-world performance of a cooperative radio localization system, which is caused by imperfect antenna and transceiver calibration. Consequentially, we theoretically analyze in-situ antenna calibration, introduce an algorithm for the calibration of arbitrary multiport antennas and show its effectiveness by simulation. To also improve calibration during operation, we propose cooperative simultaneous localization and calibration (SLAC). We show that cooperative SLAC is able to estimate antenna responses and ranging biases of the agents together with their positions and orientations, leading to considerably better position and orientation accuracy. Finally, we validate the results from theory and simulation by experiments with robotic rovers equipped with software-defined radios (SDRs). In conclusion, we show that DoA estimation with an MMA is feasible, and accuracy can be improved by in-situ calibration and SLAC