45,138 research outputs found
Fast Ensemble Smoothing
Smoothing is essential to many oceanographic, meteorological and hydrological
applications. The interval smoothing problem updates all desired states within
a time interval using all available observations. The fixed-lag smoothing
problem updates only a fixed number of states prior to the observation at
current time. The fixed-lag smoothing problem is, in general, thought to be
computationally faster than a fixed-interval smoother, and can be an
appropriate approximation for long interval-smoothing problems. In this paper,
we use an ensemble-based approach to fixed-interval and fixed-lag smoothing,
and synthesize two algorithms. The first algorithm produces a linear time
solution to the interval smoothing problem with a fixed factor, and the second
one produces a fixed-lag solution that is independent of the lag length.
Identical-twin experiments conducted with the Lorenz-95 model show that for lag
lengths approximately equal to the error doubling time, or for long intervals
the proposed methods can provide significant computational savings. These
results suggest that ensemble methods yield both fixed-interval and fixed-lag
smoothing solutions that cost little additional effort over filtering and model
propagation, in the sense that in practical ensemble application the additional
increment is a small fraction of either filtering or model propagation costs.
We also show that fixed-interval smoothing can perform as fast as fixed-lag
smoothing and may be advantageous when memory is not an issue
What does fault tolerant Deep Learning need from MPI?
Deep Learning (DL) algorithms have become the de facto Machine Learning (ML)
algorithm for large scale data analysis. DL algorithms are computationally
expensive - even distributed DL implementations which use MPI require days of
training (model learning) time on commonly studied datasets. Long running DL
applications become susceptible to faults - requiring development of a fault
tolerant system infrastructure, in addition to fault tolerant DL algorithms.
This raises an important question: What is needed from MPI for de- signing
fault tolerant DL implementations? In this paper, we address this problem for
permanent faults. We motivate the need for a fault tolerant MPI specification
by an in-depth consideration of recent innovations in DL algorithms and their
properties, which drive the need for specific fault tolerance features. We
present an in-depth discussion on the suitability of different parallelism
types (model, data and hybrid); a need (or lack thereof) for check-pointing of
any critical data structures; and most importantly, consideration for several
fault tolerance proposals (user-level fault mitigation (ULFM), Reinit) in MPI
and their applicability to fault tolerant DL implementations. We leverage a
distributed memory implementation of Caffe, currently available under the
Machine Learning Toolkit for Extreme Scale (MaTEx). We implement our approaches
by ex- tending MaTEx-Caffe for using ULFM-based implementation. Our evaluation
using the ImageNet dataset and AlexNet, and GoogLeNet neural network topologies
demonstrates the effectiveness of the proposed fault tolerant DL implementation
using OpenMPI based ULFM
Uniform-Velocity Spacetime Crystals
We perform a comprehensive analysis of uniform-velocity bilayer spacetime
crystals, combining concepts of conventional photonic crystallography and
special relativity. Given that a spacetime crystal consists of a sequence of
spacetime discontinuities, we do this by solving the following sequence of
problems: 1) the spacetime interface, 2) the double spacetime interface, or
spacetime slab, 3) the unbounded crystal, and 4) the truncated crystal. For
these problems, we present the following respective new results: 1) an
extension of the Stokes principle to spacetime interfaces, 2) an
interference-based analysis of the interference phenomenology, 3) a quick
linear approximation of the dispersion diagrams, a description of simultaneous
wavenumber and frequency bandgaps, and 4) the explanation of the effects of
different types of spacetime crystal truncations, and the corresponding
scattering coefficients. This work may constitute the foundation for a
virtually unlimited number of novel canonical spacetime media and metamaterial
problems
- …