Hyperbolic development and inversion of signature

We develop a simple procedure that allows one to explicitly reconstruct any piecewise linear path from its signature. The construction is based on the development of the path onto the hyperbolic space.Comment: Revised; 19 pages. We splitted our older article (arXiv:1406.7833) into two independent ones; this is one of the

Inverting the signature of a path

The aim of this article is to develop an explicit procedure that enables one to reconstruct any $C^1$ path (at natural parametrization) from its signature. We also explicitly quantify the distance between the reconstructed path and the original path in terms of the number of terms in the signature that are used for the construction and the modulus of continuity of the derivative of the path. A key ingredient in the construction is the use of a procedure of symmetrization that separates the behavior of the path at small and large scales.Comment: 31 pages; minor change

Universal Approximation with Deep Narrow Networks

The classical Universal Approximation Theorem holds for neural networks of arbitrary width and bounded depth. Here we consider the natural `dual' scenario for networks of bounded width and arbitrary depth. Precisely, let $n$ be the number of inputs neurons, $m$ be the number of output neurons, and let $\rho$ be any nonaffine continuous function, with a continuous nonzero derivative at some point. Then we show that the class of neural networks of arbitrary depth, width $n + m + 2$, and activation function $\rho$, is dense in $C(K; \mathbb{R}^m)$ for $K \subseteq \mathbb{R}^n$ with $K$ compact. This covers every activation function possible to use in practice, and also includes polynomial activation functions, which is unlike the classical version of the theorem, and provides a qualitative difference between deep narrow networks and shallow wide networks. We then consider several extensions of this result. In particular we consider nowhere differentiable activation functions, density in noncompact domains with respect to the $L^p$-norm, and how the width may be reduced to just $n + m + 1$ for `most' activation functions.Comment: Accepted at COLT 202

A new definition of rough paths on manifolds

Smooth manifolds are not the suitable context for trying to generalize the concept of rough paths on a manifold. Indeed, when one is working with smooth maps instead of Lipschitz maps and trying to solve a rough differential equation, one loses the quantitative estimates controlling the convergence of the Picard sequence. Moreover, even with a definition of rough paths in smooth manifolds, ordinary and rough differential equations can only be solved locally in such case. In this paper, we first recall the foundations of the Lipschitz geometry, introduced in "Rough Paths on Manifolds" (Cass, T., Litterer, C. & Lyons, T.), along with the main findings that encompass the classical theory of rough paths in Banach spaces. Then we give what we believe to be a minimal framework for defining rough paths on a manifold that is both less rigid than the classical one and emphasized on the local behaviour of rough paths. We end by explaining how this same idea can be used to define any notion of coloured paths on a manifold

The adaptive patched cubature filter and its implementation

There are numerous contexts where one wishes to describe the state of a randomly evolving system. Effective solutions combine models that quantify the underlying uncertainty with available observational data to form scientifically reasonable estimates for the uncertainty in the system state. Stochastic differential equations are often used to mathematically model the underlying system. The Kusuoka-Lyons-Victoir (KLV) approach is a higher order particle method for approximating the weak solution of a stochastic differential equation that uses a weighted set of scenarios to approximate the evolving probability distribution to a high order of accuracy. The algorithm can be performed by integrating along a number of carefully selected bounded variation paths. The iterated application of the KLV method has a tendency for the number of particles to increase. This can be addressed and, together with local dynamic recombination, which simplifies the support of discrete measure without harming the accuracy of the approximation, the KLV method becomes eligible to solve the filtering problem in contexts where one desires to maintain an accurate description of the ever-evolving conditioned measure. In addition to the alternate application of the KLV method and recombination, we make use of the smooth nature of the likelihood function and high order accuracy of the approximations to lead some of the particles immediately to the next observation time and to build into the algorithm a form of automatic high order adaptive importance sampling.Comment: to appear in Communications in Mathematical Sciences. arXiv admin note: substantial text overlap with arXiv:1311.675

Uniqueness for the signature of a path of bounded variation and the reduced path group

We introduce the notions of tree-like path and tree-like equivalence between paths and prove that the latter is an equivalence relation for paths of finite length. We show that the equivalence classes form a group with some similarity to a free group, and that in each class there is one special tree reduced path. The set of these paths is the Reduced Path Group. It is a continuous analogue to the group of reduced words. The signature of the path is a power series whose coefficients are definite iterated integrals of the path. We identify the paths with trivial signature as the tree-like paths, and prove that two paths are in tree-like equivalence if and only if they have the same signature. In this way, we extend Chen's theorems on the uniqueness of the sequence of iterated integrals associated with a piecewise regular path to finite length paths and identify the appropriate extended meaning for reparameterisation in the general setting. It is suggestive to think of this result as a non-commutative analogue of the result that integrable functions on the circle are determined, up to Lebesgue null sets, by their Fourier coefficients. As a second theme we give quantitative versions of Chen's theorem in the case of lattice paths and paths with continuous derivative, and as a corollary derive results on the triviality of exponential products in the tensor algebra.Comment: 52 pages - considerably extended and revised version of the previous version of the pape