3,980 research outputs found
Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Review
The paper characterizes classes of functions for which deep learning can be
exponentially better than shallow learning. Deep convolutional networks are a
special case of these conditions, though weight sharing is not the main reason
for their exponential advantage
Rectified deep neural networks overcome the curse of dimensionality for nonsmooth value functions in zero-sum games of nonlinear stiff systems
In this paper, we establish that for a wide class of controlled stochastic
differential equations (SDEs) with stiff coefficients, the value functions of
corresponding zero-sum games can be represented by a deep artificial neural
network (DNN), whose complexity grows at most polynomially in both the
dimension of the state equation and the reciprocal of the required accuracy.
Such nonlinear stiff systems may arise, for example, from Galerkin
approximations of controlled stochastic partial differential equations (SPDEs),
or controlled PDEs with uncertain initial conditions and source terms. This
implies that DNNs can break the curse of dimensionality in numerical
approximations and optimal control of PDEs and SPDEs. The main ingredient of
our proof is to construct a suitable discrete-time system to effectively
approximate the evolution of the underlying stochastic dynamics. Similar ideas
can also be applied to obtain expression rates of DNNs for value functions
induced by stiff systems with regime switching coefficients and driven by
general L\'{e}vy noise.Comment: This revised version has been accepted for publication in Analysis
and Application
Using Machine Learning for Model Physics: an Overview
In the overview, a generic mathematical object (mapping) is introduced, and
its relation to model physics parameterization is explained. Machine learning
(ML) tools that can be used to emulate and/or approximate mappings are
introduced. Applications of ML to emulate existing parameterizations, to
develop new parameterizations, to ensure physical constraints, and control the
accuracy of developed applications are described. Some ML approaches that allow
developers to go beyond the standard parameterization paradigm are discussed.Comment: 50 pages, 3 figures, 1 tabl
- …