389 research outputs found
Optimizing Chance-Constrained Submodular Problems with Variable Uncertainties
Chance constraints are frequently used to limit the probability of constraint
violations in real-world optimization problems where the constraints involve
stochastic components. We study chance-constrained submodular optimization
problems, which capture a wide range of optimization problems with stochastic
constraints. Previous studies considered submodular problems with stochastic
knapsack constraints in the case where uncertainties are the same for each item
that can be selected. However, uncertainty levels are usually variable with
respect to the different stochastic components in real-world scenarios, and
rigorous analysis for this setting is missing in the context of submodular
optimization. This paper provides the first such analysis for this case, where
the weights of items have the same expectation but different dispersion. We
present greedy algorithms that can obtain a high-quality solution, i.e., a
constant approximation ratio to the given optimal solution from the
deterministic setting. In the experiments, we demonstrate that the algorithms
perform effectively on several chance-constrained instances of the maximum
coverage problem and the influence maximization problem
Analysis of the (1+1) EA on LeadingOnes with Constraints
Understanding how evolutionary algorithms perform on constrained problems has
gained increasing attention in recent years. In this paper, we study how
evolutionary algorithms optimize constrained versions of the classical
LeadingOnes problem. We first provide a run time analysis for the classical
(1+1) EA on the LeadingOnes problem with a deterministic cardinality
constraint, giving as the tight bound. Our
results show that the behaviour of the algorithm is highly dependent on the
constraint bound of the uniform constraint. Afterwards, we consider the problem
in the context of stochastic constraints and provide insights using
experimental studies on how the (+1) EA is able to deal with these
constraints in a sampling-based setting
3-Objective Pareto Optimization for Problems with Chance Constraints
Evolutionary multi-objective algorithms have successfully been used in the
context of Pareto optimization where a given constraint is relaxed into an
additional objective. In this paper, we explore the use of 3-objective
formulations for problems with chance constraints. Our formulation trades off
the expected cost and variance of the stochastic component as well as the given
deterministic constraint. We point out benefits that this 3-objective
formulation has compared to a bi-objective one recently investigated for chance
constraints with Normally distributed stochastic components. Our analysis shows
that the 3-objective formulation allows to compute all required trade-offs
using 1-bit flips only, when dealing with a deterministic cardinality
constraint. Furthermore, we carry out experimental investigations for the
chance constrained dominating set problem and show the benefit for this
classical NP-hard problem
Efficient Hill Climber for Constrained Pseudo-Boolean Optimization Problems
Efficient hill climbers have been recently proposed for single- and multi-objective pseudo-Boolean optimization problems. For -bounded pseudo-Boolean functions where each variable appears in at most a constant number of subfunctions, it has been theoretically proven that the neighborhood of a solution can be explored in constant time. These hill climbers, combined with a high-level exploration strategy, have shown to improve state of the art methods in experimental studies and open the door to the so-called Gray Box Optimization, where part, but not all, of the details of the objective functions are used to better explore the search space. One important limitation of all the previous proposals is that they can only be applied to unconstrained pseudo-Boolean optimization problems. In this work, we address the constrained case for multi-objective -bounded pseudo-Boolean optimization problems. We find that adding constraints to the pseudo-Boolean problem has a linear computational cost in the hill climber.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech
Noisy combinatorial optimisation with evolutionary algorithms
The determination of the efficient evolutionary optimisation approaches in solving noisy combinatorial problems is the main focus in this research. Initially, we present an empirical study of a range of evolutionary algorithms applied to various noisy combinatorial optimisation problems. There are four sets of experiments. The first looks at several toy problems, such as OneMax and other linear problems. We find that Univariate Marginal Distribution Algorithm (UMDA) and the Paired-Crossover Evolutionary Algorithm (PCEA) are the only ones able to cope robustly with noise, within a reasonable fixed time budget. In the second stage, UMDA and PCEA are then tested on more complex noisy problems: SubsetSum, Knapsack and SetCover. Both perform well under increasing levels of noise, with UMDA being the better of the two. In the third stage, we consider two noisy multi-objective problems (CountingOnesCountingZeros and a multi-objective formulation of SetCover). We compare several adaptations of UMDA for multi-objective problems with the Simple Evolutionary Multi-objective Optimiser (SEMO) and NSGA-II. In the last stage of empirical analysis, a realistic problem of the path planning for the ground surveillance with Unmanned Aerial Vehicles is considered. We conclude that UMDA, and its variants, can be highly effective on a variety of noisy combinatorial optimisation, outperforming many other evolutionary algorithms.
Next, we study the use of voting mechanisms in populations, and introduce a new Voting algorithm which can solve OneMax and Jump in O(n log n), even for gaps as large as O(n). More significantly, the algorithm solves OneMax with added posterior noise in O(n log n), when the variance of the noise distribution is sigma = O(n) and in O(sigma log n) when the noise variance is greater than this. We assume only that the noise distribution has finite mean and variance and (for the larger noise case) that it is unimodal. Building upon this promising performance, we consider other noise models prevalent in optimisation and learning and show that the Voting algorithm has efficient performance in solving OneMax in presence of these noise variants. We also examine the performance on arbitrary linear and monotonic functions. The Voting algorithm fails on LeadingOnes but we give a variant which can solve the problem in O(n log n). We empirically study the use of voting in population based algorithms (UMDA, PCEA and cGA) and show that this can be effective for large population sizes
Exact and heuristic approaches for multi-component optimisation problems
Modern real world applications are commonly complex, consisting of multiple subsystems
that may interact with or depend on each other. Our case-study about wave
energy converters (WEC) for the renewable energy industry shows that in such a
multi-component system, optimising each individual component cannot yield global
optimality for the entire system, owing to the influence of their interactions or the
dependence on one another. Moreover, modelling a multi-component problem is
rarely easy due to the complexity of the issues, which leads to a desire for existent
models on which to base, and against which to test, calculations. Recently,
the travelling thief problem (TTP) has attracted significant attention in the Evolutionary
Computation community. It is intended to offer a better model for multicomponent
systems, where researchers can push forward their understanding of
the optimisation of such systems, especially for understanding of the interconnections
between the components. The TTP interconnects with two classic NP-hard
problems, namely the travelling salesman problem and the 0-1 knapsack problem,
via the transportation cost that non-linearly depends on the accumulated weight
of items. This non-linear setting introduces additional complexity. We study this
nonlinearity through a simplified version of the TTP - the packing while travelling
(PWT) problem, which aims to maximise the total reward for a given travelling tour.
Our theoretical and experimental investigations demonstrate that the difficulty of a
given problem instance is significantly influenced by adjusting a single parameter,
the renting rate, which prompted our method of creating relatively hard instances
using simple evolutionary algorithms. Our further investigations into the PWT
problem yield a dynamic programming (DP) approach that can solve the problem in
pseudo polynomial time and a corresponding approximation scheme. The experimental
investigations show that the new approaches outperform the state-of-the-art
ones. We furthermore propose three exact algorithms for the TTP, based on the DP
of the PWT problem. By employing the exact DP for the underlying PWT problem
as a subroutine, we create a novel indicator-based hybrid evolutionary approach for
a new bi-criteria formulation of the TTP. This hybrid design takes advantage of the
DP approach, along with a number of novel indicators and selection mechanisms
to achieve better solutions. The results of computational experiments show that the
approach is capable to outperform the state-of-the-art results.Thesis (Ph.D.) -- University of Adelaide, School of Computer Science, 201
- …