Tensor Decompositions for Signal Processing Applications From Two-way to Multiway Component Analysis

The widespread use of multi-sensor technology and the emergence of big datasets has highlighted the limitations of standard flat-view matrix models and the necessity to move towards more versatile data analysis tools. We show that higher-order tensors (i.e., multiway arrays) enable such a fundamental paradigm shift towards models that are essentially polynomial and whose uniqueness, unlike the matrix methods, is guaranteed under verymild and natural conditions. Benefiting fromthe power ofmultilinear algebra as theirmathematical backbone, data analysis techniques using tensor decompositions are shown to have great flexibility in the choice of constraints that match data properties, and to find more general latent components in the data than matrix-based methods. A comprehensive introduction to tensor decompositions is provided from a signal processing perspective, starting from the algebraic foundations, via basic Canonical Polyadic and Tucker models, through to advanced cause-effect and multi-view data analysis schemes. We show that tensor decompositions enable natural generalizations of some commonly used signal processing paradigms, such as canonical correlation and subspace techniques, signal separation, linear regression, feature extraction and classification. We also cover computational aspects, and point out how ideas from compressed sensing and scientific computing may be used for addressing the otherwise unmanageable storage and manipulation problems associated with big datasets. The concepts are supported by illustrative real world case studies illuminating the benefits of the tensor framework, as efficient and promising tools for modern signal processing, data analysis and machine learning applications; these benefits also extend to vector/matrix data through tensorization. Keywords: ICA, NMF, CPD, Tucker decomposition, HOSVD, tensor networks, Tensor Train

5D seismic data completion and denoising using a novel class of tensor decompositions

We have developed a novel strategy for simultaneous interpolation and denoising of prestack seismic data. Most seismic surveys fail to cover all possible source-receiver combinations, leading to missing data especially in the midpoint-offset domain. This undersampling can complicate certain data processing steps such as amplitude-variation-with-offset analysis and migration. Data interpolation can mitigate the impact of missing traces. We considered the prestack data as a 5D multidimensional array or otherwise referred to as a 5D tensor. Using synthetic data sets, we first found that prestack data can be well approximated by a low-rank tensor under a recently proposed framework for tensor singular value decomposition (tSVD). Under this low-rank assumption, we proposed a complexity-penalized algorithm for the recovery of missing traces and data denoising. In this algorithm, the complexity regularization was controlled by tuning a single regularization parameter using a statistical test. We tested the performance of the proposed algorithm on synthetic and real data to show that missing data can be reliably recovered under heavy downsampling. In addition, we demonstrated that compressibility, i.e., approximation of the data by a low-rank tensor, of seismic data under tSVD depended on the velocity model complexity and shot and receiver spacing. We further found that compressibility correlated with the recovery of missing data because high compressibility implied good recovery and vice versa.National Science Foundation (U.S.). Graduate Research Fellowship (Grant DGE-0806676)National Science Foundation (U.S.). Division of Computing and Communication Foundations (Grant NSF-1319653

Four lectures on secant varieties

This paper is based on the first author's lectures at the 2012 University of Regina Workshop "Connections Between Algebra and Geometry". Its aim is to provide an introduction to the theory of higher secant varieties and their applications. Several references and solved exercises are also included.Comment: Lectures notes to appear in PROMS (Springer Proceedings in Mathematics & Statistics), Springer/Birkhause

Tensor completion in hierarchical tensor representations

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the reconstruction of tensors of low multi-linear rank in recently introduced hierarchical tensor formats from a small number of measurements. Hierarchical tensors are a flexible generalization of the well-known Tucker representation, which have the advantage that the number of degrees of freedom of a low rank tensor does not scale exponentially with the order of the tensor. While corresponding tensor decompositions can be computed efficiently via successive applications of (matrix) singular value decompositions, some important properties of the singular value decomposition do not extend from the matrix to the tensor case. This results in major computational and theoretical difficulties in designing and analyzing algorithms for low rank tensor recovery. For instance, a canonical analogue of the tensor nuclear norm is NP-hard to compute in general, which is in stark contrast to the matrix case. In this book chapter we consider versions of iterative hard thresholding schemes adapted to hierarchical tensor formats. A variant builds on methods from Riemannian optimization and uses a retraction mapping from the tangent space of the manifold of low rank tensors back to this manifold. We provide first partial convergence results based on a tensor version of the restricted isometry property (TRIP) of the measurement map. Moreover, an estimate of the number of measurements is provided that ensures the TRIP of a given tensor rank with high probability for Gaussian measurement maps.Comment: revised version, to be published in Compressed Sensing and Its Applications (edited by H. Boche, R. Calderbank, G. Kutyniok, J. Vybiral

Tensor Regression with Applications in Neuroimaging Data Analysis

Classical regression methods treat covariates as a vector and estimate a corresponding vector of regression coefficients. Modern applications in medical imaging generate covariates of more complex form such as multidimensional arrays (tensors). Traditional statistical and computational methods are proving insufficient for analysis of these high-throughput data due to their ultrahigh dimensionality as well as complex structure. In this article, we propose a new family of tensor regression models that efficiently exploit the special structure of tensor covariates. Under this framework, ultrahigh dimensionality is reduced to a manageable level, resulting in efficient estimation and prediction. A fast and highly scalable estimation algorithm is proposed for maximum likelihood estimation and its associated asymptotic properties are studied. Effectiveness of the new methods is demonstrated on both synthetic and real MRI imaging data.Comment: 27 pages, 4 figure

Geometric Entanglement of Symmetric States and the Majorana Representation

Permutation-symmetric quantum states appear in a variety of physical situations, and they have been proposed for quantum information tasks. This article builds upon the results of [New J. Phys. 12, 073025 (2010)], where the maximally entangled symmetric states of up to twelve qubits were explored, and their amount of geometric entanglement determined by numeric and analytic means. For this the Majorana representation, a generalization of the Bloch sphere representation, can be employed to represent symmetric n qubit states by n points on the surface of a unit sphere. Symmetries of this point distribution simplify the determination of the entanglement, and enable the study of quantum states in novel ways. Here it is shown that the duality relationship of Platonic solids has a counterpart in the Majorana representation, and that in general maximally entangled symmetric states neither correspond to anticoherent spin states nor to spherical designs. The usability of symmetric states as resources for measurement-based quantum computing is also discussed.Comment: 10 pages, 8 figures; submitted to Lecture Notes in Computer Science (LNCS

Atlas construction and image analysis using statistical cardiac models

International audienceThis paper presents a brief overview of current trends in the construction of population and multi-modal heart atlases in our group and their application to atlas-based cardiac image analysis. The technical challenges around the construction of these atlases are organized around two main axes: groupwise image registration of anatomical, motion and fiber images and construction of statistical shape models. Application-wise, this paper focuses on the extraction of atlas-based biomarkers for the detection of local shape or motion abnormalities, addressing several cardiac applications where the extracted information is used to study and grade different pathologies. The paper is concluded with a discussion about the role of statistical atlases in the integration of multiple information sources and the potential this can bring to in-silico simulations

Tensor based multichannel reconstruction for breast tumours identification from DCE-MRIs

A new methodology based on tensor algebra that uses a higher order singular value decomposition to perform three-dimensional voxel reconstruction from a series of temporal images obtained using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is proposed. Principal component analysis (PCA) is used to robustly extract the spatial and temporal image features and simultaneously de-noise the datasets. Tumour segmentation on enhanced scaled (ES) images performed using a fuzzy C-means (FCM) cluster algorithm is compared with that achieved using the proposed tensorial framework. The proposed algorithm explores the correlations between spatial and temporal features in the tumours. The multi-channel reconstruction enables improved breast tumour identification through enhanced de-noising and improved intensity consistency. The reconstructed tumours have clear and continuous boundaries; furthermore the reconstruction shows better voxel clustering in tumour regions of interest. A more homogenous intensity distribution is also observed, enabling improved image contrast between tumours and background, especially in places where fatty tissue is imaged. The fidelity of reconstruction is further evaluated on the basis of five new qualitative metrics. Results confirm the superiority of the tensorial approach. The proposed reconstruction metrics should also find future applications in the assessment of other reconstruction algorithms