368 research outputs found
Converting some global optimization problems to mixed integer linear problems using piecewise linear approximations
Some global optimization problems are converted to mixed-integer linear problems (MILP) using piecewise-linear approximations in this thesis so that they can be solved using commercial MILP solvers, such as CPLEX. Special attention is given to approximating two-term log-sum functions, which appears frequently in generalized geometric programming problems. Numerical results indicate the proposed approach is sound and efficient --Abstract, page iii
When Deep Learning Meets Polyhedral Theory: A Survey
In the past decade, deep learning became the prevalent methodology for
predictive modeling thanks to the remarkable accuracy of deep neural networks
in tasks such as computer vision and natural language processing. Meanwhile,
the structure of neural networks converged back to simpler representations
based on piecewise constant and piecewise linear functions such as the
Rectified Linear Unit (ReLU), which became the most commonly used type of
activation function in neural networks. That made certain types of network
structure \unicode{x2014}such as the typical fully-connected feedforward
neural network\unicode{x2014} amenable to analysis through polyhedral theory
and to the application of methodologies such as Linear Programming (LP) and
Mixed-Integer Linear Programming (MILP) for a variety of purposes. In this
paper, we survey the main topics emerging from this fast-paced area of work,
which bring a fresh perspective to understanding neural networks in more detail
as well as to applying linear optimization techniques to train, verify, and
reduce the size of such networks
Relaxations and discretizations for the pooling problem
The pooling problem is a folklore NP-hard global optimization problem that finds applications in industries such as petrochemical refining, wastewater treatment and mining. This paper assimilates the vast literature on this problem that is dispersed over different areas and gives new insights on prevalent techniques. We also present new ideas for computing dual bounds on the global optimum by solving high-dimensional linear programs. Finally, we propose discretization methods for inner approximating the feasible region and obtaining good primal bounds. Valid inequalities are derived for the discretized models, which are formulated as mixed integer linear programs. The strength of our relaxations and usefulness of our discretizations is empirically validated on random test instances. We report best known primal bounds on some of the large-scale instances
Joint Metering and Conflict Resolution in Air Traffic Control
This paper describes a novel optimization-based approach to conflict resolution in air traffic control, based on geometric programming. The main advantage of the approach is that Geometric Programs (GPs) can also capture various metering directives issued by the traffic flow management level, in contrast to most recent methods focusing purely on aircraft separation issues. GPs can also account for some of the nonlinearities present in the formulations of conflict resolution problems, while incurring only a small penalty in computation time with respect to the fastest linear programming based approaches. Additional integer variables can be introduced to improve the quality of the obtained solutions and handle combinatorial choices, resulting in Mixed-Integer Geometric Programs (MIGPs). We present GPs and MIGPs to solve a variety of joint metering and separation scenarios, e.g. including miles-in-trail and minutes-in-trail restrictions through airspace fixes and boundaries. Simulation results demonstrate the efficiency of the approach
A Review of Formal Methods applied to Machine Learning
We review state-of-the-art formal methods applied to the emerging field of
the verification of machine learning systems. Formal methods can provide
rigorous correctness guarantees on hardware and software systems. Thanks to the
availability of mature tools, their use is well established in the industry,
and in particular to check safety-critical applications as they undergo a
stringent certification process. As machine learning is becoming more popular,
machine-learned components are now considered for inclusion in critical
systems. This raises the question of their safety and their verification. Yet,
established formal methods are limited to classic, i.e. non machine-learned
software. Applying formal methods to verify systems that include machine
learning has only been considered recently and poses novel challenges in
soundness, precision, and scalability.
We first recall established formal methods and their current use in an
exemplar safety-critical field, avionic software, with a focus on abstract
interpretation based techniques as they provide a high level of scalability.
This provides a golden standard and sets high expectations for machine learning
verification. We then provide a comprehensive and detailed review of the formal
methods developed so far for machine learning, highlighting their strengths and
limitations. The large majority of them verify trained neural networks and
employ either SMT, optimization, or abstract interpretation techniques. We also
discuss methods for support vector machines and decision tree ensembles, as
well as methods targeting training and data preparation, which are critical but
often neglected aspects of machine learning. Finally, we offer perspectives for
future research directions towards the formal verification of machine learning
systems
- âŠ