7,692 research outputs found
On the Minimization of Convex Functionals of Probability Distributions Under Band Constraints
The problem of minimizing convex functionals of probability distributions is
solved under the assumption that the density of every distribution is bounded
from above and below. A system of sufficient and necessary first-order
optimality conditions as well as a bound on the optimality gap of feasible
candidate solutions are derived. Based on these results, two numerical
algorithms are proposed that iteratively solve the system of optimality
conditions on a grid of discrete points. Both algorithms use a block coordinate
descent strategy and terminate once the optimality gap falls below the desired
tolerance. While the first algorithm is conceptually simpler and more
efficient, it is not guaranteed to converge for objective functions that are
not strictly convex. This shortcoming is overcome in the second algorithm,
which uses an additional outer proximal iteration, and, which is proven to
converge under mild assumptions. Two examples are given to demonstrate the
theoretical usefulness of the optimality conditions as well as the high
efficiency and accuracy of the proposed numerical algorithms.Comment: 13 pages, 5 figures, 2 tables, published in the IEEE Transactions on
Signal Processing. In previous versions, the example in Section VI.B
contained some mistakes and inaccuracies, which have been fixed in this
versio
Optimizing Measures of Risk: A Simplex-like Algorithm
The minimization of general risk or dispersion measures is becoming more and more important in Portfolio Choice Theory. There are two major reasons. Firstly, the lack of symmetry in the returns of many assets provokes that the classical optimization of the standard deviation may lead to dominated strategies, from the point of view of the second order stochastic dominance. Secondly, but not less important, many institutional investors must respect legal capital requirements, which may be more easily studied if one deals with a risk measure related to capital losses. This paper proposes a new method to simultaneously minimize several risk or dispersion measures. The representation theorems of risk measures are applied to transform the general risk minimization problem in a minimax problem, and later in a linear programming problem between infinite-dimensional Banach spaces. Then, new necessary and sufficient optimality conditions are stated and a simplex-like algorithm is developed. The algorithm solves the dual (and therefore the primal) problem and provides both optimal portfolios and their sensitivities. The approach is general enough and does not depend on any particular risk measure, but some of the most important cases are specially analyzed.Risk Measure. Deviation Measure. Portfolio Selection. Infinite-Dimensional Linear Programming. Simpl
Non-stationary Stochastic Optimization
We consider a non-stationary variant of a sequential stochastic optimization
problem, in which the underlying cost functions may change along the horizon.
We propose a measure, termed variation budget, that controls the extent of said
change, and study how restrictions on this budget impact achievable
performance. We identify sharp conditions under which it is possible to achieve
long-run-average optimality and more refined performance measures such as rate
optimality that fully characterize the complexity of such problems. In doing
so, we also establish a strong connection between two rather disparate strands
of literature: adversarial online convex optimization; and the more traditional
stochastic approximation paradigm (couched in a non-stationary setting). This
connection is the key to deriving well performing policies in the latter, by
leveraging structure of optimal policies in the former. Finally, tight bounds
on the minimax regret allow us to quantify the "price of non-stationarity,"
which mathematically captures the added complexity embedded in a temporally
changing environment versus a stationary one
Global Solutions to Nonconvex Optimization of 4th-Order Polynomial and Log-Sum-Exp Functions
This paper presents a canonical dual approach for solving a nonconvex global
optimization problem governed by a sum of fourth-order polynomial and a
log-sum-exp function. Such a problem arises extensively in engineering and
sciences. Based on the canonical duality-triality theory, this nonconvex
problem is transformed to an equivalent dual problem, which can be solved
easily under certain conditions. We proved that both global minimizer and the
biggest local extrema of the primal problem can be obtained analytically from
the canonical dual solutions. As two special cases, a quartic polynomial
minimization and a minimax problem are discussed. Existence conditions are
derived, which can be used to classify easy and relative hard instances.
Applications are illustrated by several nonconvex and nonsmooth examples
- ā¦