134 research outputs found
Singular value decay of operator-valued differential Lyapunov and Riccati equations
We consider operator-valued differential Lyapunov and Riccati equations,
where the operators and may be relatively unbounded with respect to
(in the standard notation). In this setting, we prove that the singular values
of the solutions decay fast under certain conditions. In fact, the decay is
exponential in the negative square root if generates an analytic semigroup
and the range of has finite dimension. This extends previous similar
results for algebraic equations to the differential case. When the initial
condition is zero, we also show that the singular values converge to zero as
time goes to zero, with a certain rate that depends on the degree of
unboundedness of . A fast decay of the singular values corresponds to a low
numerical rank, which is a critical feature in large-scale applications. The
results reported here provide a theoretical foundation for the observation
that, in practice, a low-rank factorization usually exists.Comment: Corrected some misconceptions, which lead to more general results
(e.g. exponential stability is no longer required). Also fixed some
off-by-one errors, improved the presentation, and added/extended several
remarks on possible generalizations. Now 22 pages, 8 figure
Sparse Modeling for Image and Vision Processing
In recent years, a large amount of multi-disciplinary research has been
conducted on sparse models and their applications. In statistics and machine
learning, the sparsity principle is used to perform model selection---that is,
automatically selecting a simple model among a large collection of them. In
signal processing, sparse coding consists of representing data with linear
combinations of a few dictionary elements. Subsequently, the corresponding
tools have been widely adopted by several scientific communities such as
neuroscience, bioinformatics, or computer vision. The goal of this monograph is
to offer a self-contained view of sparse modeling for visual recognition and
image processing. More specifically, we focus on applications where the
dictionary is learned and adapted to data, yielding a compact representation
that has been successful in various contexts.Comment: 205 pages, to appear in Foundations and Trends in Computer Graphics
and Visio
Information Theory and Machine Learning
The recent successes of machine learning, especially regarding systems based on deep neural networks, have encouraged further research activities and raised a new set of challenges in understanding and designing complex machine learning algorithms. New applications require learning algorithms to be distributed, have transferable learning results, use computation resources efficiently, convergence quickly on online settings, have performance guarantees, satisfy fairness or privacy constraints, incorporate domain knowledge on model structures, etc. A new wave of developments in statistical learning theory and information theory has set out to address these challenges. This Special Issue, "Machine Learning and Information Theory", aims to collect recent results in this direction reflecting a diverse spectrum of visions and efforts to extend conventional theories and develop analysis tools for these complex machine learning systems
Generalized averaged Gaussian quadrature and applications
A simple numerical method for constructing the optimal generalized averaged Gaussian quadrature formulas will be presented. These formulas exist in many cases in which real positive GaussKronrod formulas do not exist, and can be used as an adequate alternative in order to estimate the error of a Gaussian rule. We also investigate the conditions under which the optimal averaged Gaussian quadrature formulas and their truncated variants are internal
MS FT-2-2 7 Orthogonal polynomials and quadrature: Theory, computation, and applications
Quadrature rules find many applications in science and engineering. Their analysis is a classical area of applied mathematics and continues to attract considerable attention. This seminar brings together speakers with expertise in a large variety of quadrature rules. It is the aim of the seminar to provide an overview of recent developments in the analysis of quadrature rules. The computation of error estimates and novel applications also are described
- …