32,659 research outputs found
Conic Optimization Theory: Convexification Techniques and Numerical Algorithms
Optimization is at the core of control theory and appears in several areas of
this field, such as optimal control, distributed control, system
identification, robust control, state estimation, model predictive control and
dynamic programming. The recent advances in various topics of modern
optimization have also been revamping the area of machine learning. Motivated
by the crucial role of optimization theory in the design, analysis, control and
operation of real-world systems, this tutorial paper offers a detailed overview
of some major advances in this area, namely conic optimization and its emerging
applications. First, we discuss the importance of conic optimization in
different areas. Then, we explain seminal results on the design of hierarchies
of convex relaxations for a wide range of nonconvex problems. Finally, we study
different numerical algorithms for large-scale conic optimization problems.Comment: 18 page
Accurate and Efficient Expression Evaluation and Linear Algebra
We survey and unify recent results on the existence of accurate algorithms
for evaluating multivariate polynomials, and more generally for accurate
numerical linear algebra with structured matrices. By "accurate" we mean that
the computed answer has relative error less than 1, i.e., has some correct
leading digits. We also address efficiency, by which we mean algorithms that
run in polynomial time in the size of the input. Our results will depend
strongly on the model of arithmetic: Most of our results will use the so-called
Traditional Model (TM). We give a set of necessary and sufficient conditions to
decide whether a high accuracy algorithm exists in the TM, and describe
progress toward a decision procedure that will take any problem and provide
either a high accuracy algorithm or a proof that none exists. When no accurate
algorithm exists in the TM, it is natural to extend the set of available
accurate operations by a library of additional operations, such as , dot
products, or indeed any enumerable set which could then be used to build
further accurate algorithms. We show how our accurate algorithms and decision
procedure for finding them extend to this case. Finally, we address other
models of arithmetic, and the relationship between (im)possibility in the TM
and (in)efficient algorithms operating on numbers represented as bit strings.Comment: 49 pages, 6 figures, 1 tabl
Block Circulant and Toeplitz Structures in the Linearized Hartree–Fock Equation on Finite Lattices: Tensor Approach
This paper introduces and analyses the new grid-based tensor approach to
approximate solution of the elliptic eigenvalue problem for the 3D
lattice-structured systems. We consider the linearized Hartree-Fock equation
over a spatial lattice for both periodic and
non-periodic problem setting, discretized in the localized Gaussian-type
orbitals basis. In the periodic case, the Galerkin system matrix obeys a
three-level block-circulant structure that allows the FFT-based
diagonalization, while for the finite extended systems in a box (Dirichlet
boundary conditions) we arrive at the perturbed block-Toeplitz representation
providing fast matrix-vector multiplication and low storage size. The proposed
grid-based tensor techniques manifest the twofold benefits: (a) the entries of
the Fock matrix are computed by 1D operations using low-rank tensors
represented on a 3D grid, (b) in the periodic case the low-rank tensor
structure in the diagonal blocks of the Fock matrix in the Fourier space
reduces the conventional 3D FFT to the product of 1D FFTs. Lattice type systems
in a box with Dirichlet boundary conditions are treated numerically by our
previous tensor solver for single molecules, which makes possible calculations
on rather large lattices due to reduced numerical
cost for 3D problems. The numerical simulations for both box-type and periodic
lattice chain in a 3D rectangular "tube" with up to
several hundred confirm the theoretical complexity bounds for the
block-structured eigenvalue solvers in the limit of large .Comment: 30 pages, 12 figures. arXiv admin note: substantial text overlap with
arXiv:1408.383
- …