564 research outputs found
Unimodal optimization using a genetic-programming-based method with periodic boundary conditions
This article describes a new genetic-programming-based optimization method using a multi-gene approach along with a niching strategy and periodic domain constraints. The method is referred to as Niching MG-PMA, where MG refers to multi-gene and PMA to parameter mapping approach. Although it was designed to be a multimodal optimization method, recent tests have revealed its suitability for unimodal optimization. The definition of Niching MG-PMA is provided in a detailed fashion, along with an in-depth explanation of two novelties in our implementation: the feedback of initial parameters and the domain constraints using periodic boundary conditions. These ideas can be potentially useful for other optimization techniques. The method is tested on the basis of the CEC’2015 benchmark functions. Statistical analysis shows that Niching MG-PMA performs similarly to the winners of the competition even without any parametrization towards the benchmark, indicating that the method is robust and applicable to a wide range of problems
Meta-heuristic algorithms in car engine design: a literature survey
Meta-heuristic algorithms are often inspired by natural phenomena, including the evolution of species in Darwinian natural selection theory, ant behaviors in biology, flock behaviors of some birds, and annealing in metallurgy. Due to their great potential in solving difficult optimization problems, meta-heuristic algorithms have found their way into automobile engine design. There are different optimization problems arising in different areas of car engine management including calibration, control system, fault diagnosis, and modeling. In this paper we review the state-of-the-art applications of different meta-heuristic algorithms in engine management systems. The review covers a wide range of research, including the application of meta-heuristic algorithms in engine calibration, optimizing engine control systems, engine fault diagnosis, and optimizing different parts of engines and modeling. The meta-heuristic algorithms reviewed in this paper include evolutionary algorithms, evolution strategy, evolutionary programming, genetic programming, differential evolution, estimation of distribution algorithm, ant colony optimization, particle swarm optimization, memetic algorithms, and artificial immune system
Seeking multiple solutions:an updated survey on niching methods and their applications
Multi-Modal Optimization (MMO) aiming to locate multiple optimal (or near-optimal) solutions in a single simulation run has practical relevance to problem solving across many fields. Population-based meta-heuristics have been shown particularly effective in solving MMO problems, if equipped with specificallydesigned diversity-preserving mechanisms, commonly known as niching methods. This paper provides an updated survey on niching methods. The paper first revisits the fundamental concepts about niching and its most representative schemes, then reviews the most recent development of niching methods, including novel and hybrid methods, performance measures, and benchmarks for their assessment. Furthermore, the paper surveys previous attempts at leveraging the capabilities of niching to facilitate various optimization tasks (e.g., multi-objective and dynamic optimization) and machine learning tasks (e.g., clustering, feature selection, and learning ensembles). A list of successful applications of niching methods to real-world problems is presented to demonstrate the capabilities of niching methods in providing solutions that are difficult for other optimization methods to offer. The significant practical value of niching methods is clearly exemplified through these applications. Finally, the paper poses challenges and research questions on niching that are yet to be appropriately addressed. Providing answers to these questions is crucial before we can bring more fruitful benefits of niching to real-world problem solving
Bio-inspired computation: where we stand and what's next
In recent years, the research community has witnessed an explosion of literature dealing with the adaptation of behavioral patterns and social phenomena observed in nature towards efficiently solving complex computational tasks. This trend has been especially dramatic in what relates to optimization problems, mainly due to the unprecedented complexity of problem instances, arising from a diverse spectrum of domains such as transportation, logistics, energy, climate, social networks, health and industry 4.0, among many others. Notwithstanding this upsurge of activity, research in this vibrant topic should be steered towards certain areas that, despite their eventual value and impact on the field of bio-inspired computation, still remain insufficiently explored to date. The main purpose of this paper is to outline the state of the art and to identify open challenges concerning the most relevant areas within bio-inspired optimization. An analysis and discussion are also carried out over the general trajectory followed in recent years by the community working in this field, thereby highlighting the need for reaching a consensus and joining forces towards achieving valuable insights into the understanding of this family of optimization techniques
Adaptive multimodal continuous ant colony optimization
Seeking multiple optima simultaneously, which multimodal optimization aims at, has attracted increasing attention but remains challenging. Taking advantage of ant colony optimization algorithms in preserving high diversity, this paper intends to extend ant colony optimization algorithms to deal with multimodal optimization. First, combined with current niching methods, an adaptive multimodal continuous ant colony optimization algorithm is introduced. In this algorithm, an adaptive parameter adjustment is developed, which takes the difference among niches into consideration. Second, to accelerate convergence, a differential evolution mutation operator is alternatively utilized to build base vectors for ants to construct new solutions. Then, to enhance the exploitation, a local search scheme based on Gaussian distribution is self-adaptively performed around the seeds of niches. Together, the proposed algorithm affords a good balance between exploration and exploitation. Extensive experiments on 20 widely used benchmark multimodal functions are conducted to investigate the influence of each algorithmic component and results are compared with several state-of-the-art multimodal algorithms and winners of competitions on multimodal optimization. These comparisons demonstrate the competitive efficiency and effectiveness of the proposed algorithm, especially in dealing with complex problems with high numbers of local optima
Multimodal Multiple Federated Feature Construction Method for IoT Environments
The fast development of Internet-of-Things (IoT) devices and applications has
led to vast data collection, potentially containing irrelevant, noisy, or
redundant features that degrade learning model performance. These collected
data can be processed on either end-user devices (clients) or edge/cloud
server. Feature construction is a pre-processing technique that can generate
discriminative features and reveal hidden relationships between original
features within a dataset, leading to improved performance and reduced
computational complexity of learning models. Moreover, the communication cost
between clients and edge/cloud server can be minimized in situations where a
dataset needs to be transmitted for further processing. In this paper, the
first federated feature construction (FFC) method called multimodal multiple
FFC (MMFFC) is proposed by using multimodal optimization and gravitational
search programming algorithm. This is a collaborative method for constructing
multiple high-level features without sharing clients' datasets to enhance the
trade-off between accuracy of the trained model and overall communication cost
of the system, while also reducing computational complexity of the learning
model. We analyze and compare the accuracy-cost trade-off of two scenarios,
namely, 1) MMFFC federated learning (FL), using vanilla FL with pre-processed
datasets on clients and 2) MMFFC centralized learning, transferring
pre-processed datasets to an edge server and using centralized learning model.
The results on three datasets for the first scenario and eight datasets for the
second one demonstrate that the proposed method can reduce the size of datasets
for about 60, thereby reducing communication cost and improving accuracy
of the learning models tested on almost all datasets.Comment: This paper has been accepted at 2023 IEEE Global Communications
Conference: IoT and Sensor Network
Evolutionary Algorithms
Evolutionary algorithms (EAs) are population-based metaheuristics, originally
inspired by aspects of natural evolution. Modern varieties incorporate a broad
mixture of search mechanisms, and tend to blend inspiration from nature with
pragmatic engineering concerns; however, all EAs essentially operate by
maintaining a population of potential solutions and in some way artificially
'evolving' that population over time. Particularly well-known categories of EAs
include genetic algorithms (GAs), Genetic Programming (GP), and Evolution
Strategies (ES). EAs have proven very successful in practical applications,
particularly those requiring solutions to combinatorial problems. EAs are
highly flexible and can be configured to address any optimization task, without
the requirements for reformulation and/or simplification that would be needed
for other techniques. However, this flexibility goes hand in hand with a cost:
the tailoring of an EA's configuration and parameters, so as to provide robust
performance for a given class of tasks, is often a complex and time-consuming
process. This tailoring process is one of the many ongoing research areas
associated with EAs.Comment: To appear in R. Marti, P. Pardalos, and M. Resende, eds., Handbook of
Heuristics, Springe
Bio-inspired computation: where we stand and what's next
In recent years, the research community has witnessed an explosion of literature dealing with the adaptation of behavioral patterns and social phenomena observed in nature towards efficiently solving complex computational tasks. This trend has been especially dramatic in what relates to optimization problems, mainly due to the unprecedented complexity of problem instances, arising from a diverse spectrum of domains such as transportation, logistics, energy, climate, social networks, health and industry 4.0, among many others. Notwithstanding this upsurge of activity, research in this vibrant topic should be steered towards certain areas that, despite their eventual value and impact on the field of bio-inspired computation, still remain insufficiently explored to date. The main purpose of this paper is to outline the state of the art and to identify open challenges concerning the most relevant areas within bio-inspired optimization. An analysis and discussion are also carried out over the general trajectory followed in recent years by the community working in this field, thereby highlighting the need for reaching a consensus and joining forces towards achieving valuable insights into the understanding of this family of optimization techniques
Uncertainty evaluation of reservoir simulation models using particle swarms and hierarchical clustering
History matching production data in finite difference reservoir simulation
models has been and always will be a challenge for the industry. The
principal hurdles that need to be overcome are finding a match in the first
place and more importantly a set of matches that can capture the uncertainty
range of the simulation model and to do this in as short a time as possible
since the bottleneck in this process is the length of time taken to run the
model. This study looks at the implementation of Particle Swarm
Optimisation (PSO) in history matching finite difference simulation models.
Particle Swarms are a class of evolutionary algorithms that have shown
much promise over the last decade. This method draws parallels from the
social interaction of swarms of bees, flocks of birds and shoals of fish.
Essentially a swarm of agents are allowed to search the solution hyperspace
keeping in memory each individual’s historical best position and iteratively
improving the optimisation by the emergent interaction of the swarm. An
intrinsic feature of PSO is its local search capability. A sequential niching
variation of the PSO has been developed viz. Flexi-PSO that enhances the
exploration and exploitation of the hyperspace and is capable of finding
multiple minima. This new variation has been applied to history matching
synthetic reservoir simulation models to find multiple distinct history
3
matches to try to capture the uncertainty range. Hierarchical clustering is
then used to post-process the history match runs to reduce the size of the
ensemble carried forward for prediction.
The success of the uncertainty modelling exercise is then assessed by
checking whether the production profile forecasts generated by the ensemble
covers the truth case
- …