Branch-and-Prune Search Strategies for Numerical Constraint Solving

When solving numerical constraints such as nonlinear equations and inequalities, solvers often exploit pruning techniques, which remove redundant value combinations from the domains of variables, at pruning steps. To find the complete solution set, most of these solvers alternate the pruning steps with branching steps, which split each problem into subproblems. This forms the so-called branch-and-prune framework, well known among the approaches for solving numerical constraints. The basic branch-and-prune search strategy that uses domain bisections in place of the branching steps is called the bisection search. In general, the bisection search works well in case (i) the solutions are isolated, but it can be improved further in case (ii) there are continuums of solutions (this often occurs when inequalities are involved). In this paper, we propose a new branch-and-prune search strategy along with several variants, which not only allow yielding better branching decisions in the latter case, but also work as well as the bisection search does in the former case. These new search algorithms enable us to employ various pruning techniques in the construction of inner and outer approximations of the solution set. Our experiments show that these algorithms speed up the solving process often by one order of magnitude or more when solving problems with continuums of solutions, while keeping the same performance as the bisection search when the solutions are isolated.Comment: 43 pages, 11 figure

Formal Proofs for Nonlinear Optimization

We present a formally verified global optimization framework. Given a semialgebraic or transcendental function $f$ and a compact semialgebraic domain $K$, we use the nonlinear maxplus template approximation algorithm to provide a certified lower bound of $f$ over $K$. This method allows to bound in a modular way some of the constituents of $f$ by suprema of quadratic forms with a well chosen curvature. Thus, we reduce the initial goal to a hierarchy of semialgebraic optimization problems, solved by sums of squares relaxations. Our implementation tool interleaves semialgebraic approximations with sums of squares witnesses to form certificates. It is interfaced with Coq and thus benefits from the trusted arithmetic available inside the proof assistant. This feature is used to produce, from the certificates, both valid underestimators and lower bounds for each approximated constituent. The application range for such a tool is widespread; for instance Hales' proof of Kepler's conjecture yields thousands of multivariate transcendental inequalities. We illustrate the performance of our formal framework on some of these inequalities as well as on examples from the global optimization literature.Comment: 24 pages, 2 figures, 3 table

Conditioning moments of singular measures for entropy optimization. I

In order to process a potential moment sequence by the entropy optimization method one has to be assured that the original measure is absolutely continuous with respect to Lebesgue measure. We propose a non-linear exponential transform of the moment sequence of any measure, including singular ones, so that the entropy optimization method can still be used in the reconstruction or approximation of the original. The Cauchy transform in one variable, used for this very purpose in a classical context by A.\ A.\ Markov and followers, is replaced in higher dimensions by the Fantappi\`{e} transform. Several algorithms for reconstruction from moments are sketched, while we intend to provide the numerical experiments and computational aspects in a subsequent article. The essentials of complex analysis, harmonic analysis, and entropy optimization are recalled in some detail, with the goal of making the main results more accessible to non-expert readers. Keywords: Fantappi\`e transform; entropy optimization; moment problem; tube domain; exponential transformComment: Submitted to Indagnationes Mathematicae, I. Gohberg Memorial issu

Computational optimization of networks of dynamical systems under uncertainties: application to the air transportation system

To efficiently balance traffic demand and capacity, optimization of air traffic management relies on accurate predictions of future capacities, which are inherently uncertain due to weather forecast. This dissertation presents a novel computational efficient approach to address the uncertainties in air traffic system by using chance constrained optimization model. First, a chance constrained model for a single airport ground holding problem is proposed with the concept of service level, which provides a event-oriented performance criterion for uncertainty. With the validated advantage on robust optimal planning under uncertainty, the chance constrained model is developed for joint planning for multiple related airports. The probabilistic capacity constraints of airspace resources provide a quantized way to balance the solution’s robustness and potential cost, which is well validated against the classic stochastic scenario tree-based method. Following the similar idea, the chance constrained model is extended to formulate a traffic flow management problem under probabilistic sector capacities, which is derived from a previous deterministic linear model. The nonlinearity from the chance constraint makes this problem difficult to solve, especially for a large scale case. To address the computational efficiency problem, a novel convex approximation based approach is proposed based on the numerical properties of the Bernstein polynomial. By effectively controlling the approximation error for both the function value and gradient, a first-order algorithm can be adopted to obtain a satisfactory solution which is expected to be optimal. The convex approximation approach is evaluated to be reliable by comparing with a brute-force method.Finally, the specially designed architecture of the convex approximation provides massive independent internal approximation processes, which makes parallel computing to be suitable. A distributed computing framework is designed based on Spark, a big data cluster computing system, to further improve the computational efficiency. By taking the advantage of Spark, the distributed framework enables concurrent executions for the convex approximation processes. Evolved from a basic cloud computing package, Hadoop MapReduce, Spark provides advanced features on in-memory computing and dynamical task allocation. Performed on a small cluster of six workstations, these features are well demonstrated by comparing with MapReduce in solving the chance constrained model