29,617 research outputs found
Nonlinear Optimization over a Weighted Independence System
We consider the problem of optimizing a nonlinear objective function over a
weighted independence system presented by a linear-optimization oracle. We
provide a polynomial-time algorithm that determines an r-best solution for
nonlinear functions of the total weight of an independent set, where r is a
constant that depends on certain Frobenius numbers of the individual weights
and is independent of the size of the ground set. In contrast, we show that
finding an optimal (0-best) solution requires exponential time even in a very
special case of the problem
Intractability of approximate multi-dimensional nonlinear optimization on independence systems
We consider optimization of nonlinear objective functions that balance
linear criteria over -element independence systems presented by
linear-optimization oracles. For , we have previously shown that an
-best approximate solution can be found in polynomial time. Here, using an
extended Erd\H{o}s-Ko-Rado theorem of Frankl, we show that for , finding a
-best solution requires exponential time
Nonlinear Integer Programming
Research efforts of the past fifty years have led to a development of linear
integer programming as a mature discipline of mathematical optimization. Such a
level of maturity has not been reached when one considers nonlinear systems
subject to integrality requirements for the variables. This chapter is
dedicated to this topic.
The primary goal is a study of a simple version of general nonlinear integer
problems, where all constraints are still linear. Our focus is on the
computational complexity of the problem, which varies significantly with the
type of nonlinear objective function in combination with the underlying
combinatorial structure. Numerous boundary cases of complexity emerge, which
sometimes surprisingly lead even to polynomial time algorithms.
We also cover recent successful approaches for more general classes of
problems. Though no positive theoretical efficiency results are available, nor
are they likely to ever be available, these seem to be the currently most
successful and interesting approaches for solving practical problems.
It is our belief that the study of algorithms motivated by theoretical
considerations and those motivated by our desire to solve practical instances
should and do inform one another. So it is with this viewpoint that we present
the subject, and it is in this direction that we hope to spark further
research.Comment: 57 pages. To appear in: M. J\"unger, T. Liebling, D. Naddef, G.
Nemhauser, W. Pulleyblank, G. Reinelt, G. Rinaldi, and L. Wolsey (eds.), 50
Years of Integer Programming 1958--2008: The Early Years and State-of-the-Art
Surveys, Springer-Verlag, 2009, ISBN 354068274
Nonlinear Matroid Optimization and Experimental Design
We study the problem of optimizing nonlinear objective functions over
matroids presented by oracles or explicitly. Such functions can be interpreted
as the balancing of multi-criteria optimization. We provide a combinatorial
polynomial time algorithm for arbitrary oracle-presented matroids, that makes
repeated use of matroid intersection, and an algebraic algorithm for vectorial
matroids.
Our work is partly motivated by applications to minimum-aberration
model-fitting in experimental design in statistics, which we discuss and
demonstrate in detail
Parameter estimation by implicit sampling
Implicit sampling is a weighted sampling method that is used in data
assimilation, where one sequentially updates estimates of the state of a
stochastic model based on a stream of noisy or incomplete data. Here we
describe how to use implicit sampling in parameter estimation problems, where
the goal is to find parameters of a numerical model, e.g.~a partial
differential equation (PDE), such that the output of the numerical model is
compatible with (noisy) data. We use the Bayesian approach to parameter
estimation, in which a posterior probability density describes the probability
of the parameter conditioned on data and compute an empirical estimate of this
posterior with implicit sampling. Our approach generates independent samples,
so that some of the practical difficulties one encounters with Markov Chain
Monte Carlo methods, e.g.~burn-in time or correlations among dependent samples,
are avoided. We describe a new implementation of implicit sampling for
parameter estimation problems that makes use of multiple grids (coarse to fine)
and BFGS optimization coupled to adjoint equations for the required gradient
calculations. The implementation is "dimension independent", in the sense that
a well-defined finite dimensional subspace is sampled as the mesh used for
discretization of the PDE is refined. We illustrate the algorithm with an
example where we estimate a diffusion coefficient in an elliptic equation from
sparse and noisy pressure measurements. In the example, dimension\slash
mesh-independence is achieved via Karhunen-Lo\`{e}ve expansions
Coverage, Matching, and Beyond: New Results on Budgeted Mechanism Design
We study a type of reverse (procurement) auction problems in the presence of
budget constraints. The general algorithmic problem is to purchase a set of
resources, which come at a cost, so as not to exceed a given budget and at the
same time maximize a given valuation function. This framework captures the
budgeted version of several well known optimization problems, and when the
resources are owned by strategic agents the goal is to design truthful and
budget feasible mechanisms, i.e. elicit the true cost of the resources and
ensure the payments of the mechanism do not exceed the budget. Budget
feasibility introduces more challenges in mechanism design, and we study
instantiations of this problem for certain classes of submodular and XOS
valuation functions. We first obtain mechanisms with an improved approximation
ratio for weighted coverage valuations, a special class of submodular functions
that has already attracted attention in previous works. We then provide a
general scheme for designing randomized and deterministic polynomial time
mechanisms for a class of XOS problems. This class contains problems whose
feasible set forms an independence system (a more general structure than
matroids), and some representative problems include, among others, finding
maximum weighted matchings, maximum weighted matroid members, and maximum
weighted 3D-matchings. For most of these problems, only randomized mechanisms
with very high approximation ratios were known prior to our results
- …