Hybridizing Non-dominated Sorting Algorithms: Divide-and-Conquer Meets Best Order Sort

Many production-grade algorithms benefit from combining an asymptotically efficient algorithm for solving big problem instances, by splitting them into smaller ones, and an asymptotically inefficient algorithm with a very small implementation constant for solving small subproblems. A well-known example is stable sorting, where mergesort is often combined with insertion sort to achieve a constant but noticeable speed-up. We apply this idea to non-dominated sorting. Namely, we combine the divide-and-conquer algorithm, which has the currently best known asymptotic runtime of $O(N (\log N)^{M - 1})$, with the Best Order Sort algorithm, which has the runtime of $O(N^2 M)$ but demonstrates the best practical performance out of quadratic algorithms. Empirical evaluation shows that the hybrid's running time is typically not worse than of both original algorithms, while for large numbers of points it outperforms them by at least 20%. For smaller numbers of objectives, the speedup can be as large as four times.Comment: A two-page abstract of this paper will appear in the proceedings companion of the 2017 Genetic and Evolutionary Computation Conference (GECCO 2017

Various Degrees of Steadiness in NSGA-II and Their Influence on the Quality of Results

ABSTRACT Steady-state evolutionary algorithms are often favoured over generational ones due to better scalability in parallel and distributed environments. However, in certain conditions they are able to produce results of better quality as well. We consider several ways to introduce various "degrees of steadiness" in the NSGA-II algorithm, some of which have not been known in literature, and show experimentally (on a corpus of 21 test problems) the presence of a general trend: algorithms with more steadiness yield better results

МОДИФИКАЦИЯ МЕТАЭВРИСТИЧЕСКОГО МЕТОДА ФЕЙЕРВЕРКОВ ДЛЯ ЗАДАЧ МНОГОКРИТЕРИАЛЬНОЙ ОПТИМИЗАЦИИ НА ОСНОВЕ НЕДОМИНИРУЕМОЙ СОРТИРОВКИ

The article suggests a modification for numerical fireworks method of the single-objective optimization for solving the problem of multiobjective optimization. The method is metaheuristic. It does not guarantee finding the exact solution, but can give a good approximate result. Multiobjective optimization problem is considered with numerical criteria of equal importance. A possible solution to the problem is a vector of real numbers. Each component of the vector of a possible solution belongs to a certain segment. The optimal solution of the problem is considered a Pareto optimal solution. Because the set of Pareto optimal solutions can be infinite; we consider a method for finding an approximation consisting of a finite number of Pareto optimal solutions. The modification is based on the procedure of non-dominated sorting. It is the main procedure for solutions search. Non-dominated sorting is the ranking of decisions based on the values of the numerical vector obtained using the criteria. Solutions are divided into disjoint subsets. The first subset is the Pareto optimal solutions, the second subset is the Pareto optimal solutions if the first subset is not taken into account, and the last subset is the Pareto optimal solutions if the rest subsets are not taken into account. After such a partition, the decision is made to create new solutions. The method was tested on well-known bi-objective optimization problems: ZDT2, LZ01. Structure of the location of Pareto optimal solutions differs for the problems. LZ01 have complex structure of Pareto optimal solutions. In conclusion, the question of future research and the issue of modifying the method for problems with general constraints are discussed.В работе предлагается модификация численного метода фейерверков однокритериальной оптимизации для решения задач многокритериальной оптимизации. Метод относится к метаэвристическим алгоритмам, он не гарантирует нахождения точного решения, но может найти достаточно хорошее приближенное решение. Рассматриваются многокритериальные задачи оптимизации с числовыми критериями, имеющими одинаковую важность. Допустимое решение задачи представляется вектором из действительных чисел, значение каждой компоненты которого принадлежит определенному отрезку. Под оптимальным решением понимается решение, оптимальное по Парето. Так как точных решений, оптимальных по Парето, может быть бесконечно много, рассматривается способ нахождения приближения, состоящего из конечного числа решений, оптимальных по Парето. Модификация основана на процедуре недоминируемой сортировки, которая является основной процедурой для управления процессом поиска приближенного решения. Недоминируемая сортировка – это ранжирование решений на основе значений компонент числового вектора, полученных с помощью вычисления критериев. Каждая компонента соответствует определенному критерию, а множество решений разбивается на непересекающиеся подмножества. Первое подмножество – это решения, оптимальные по Парето, второе подмножество – это решения, оптимальные по Парето, если не учитывать первое подмножество, последнее подмножество – это решения, оптимальные по Парето, если не учитывать все предыдущие подмножества. После такого разбиения принимается решение о генерировании новых допустимых решений. Работа метода протестирована на общеизвестных задачах многокритериальной оптимизации с двумя критериями: ZDT2, LZ01. Задачи отличаются структурой расположения решений, оптимальных по Парето. Так LZ01 имеет достаточно сложную структуру решений, оптимальных по Парето. В заключении обсуждаются вопросы о дальнейшем направлении исследований и о возможности модификации метода для задач многокритериальной оптимизации с произвольными, а не параллелепипедными ограничениями

Incremental non-dominated sorting with O(N) insertion for the two-dimensional case.

Abstract-We propose a new algorithm for incremental nondominated sorting of two-dimensional points. The data structure which stores non-dominating layers is based on a tree of Cartesian trees. If there are N points in M layers, the running time for of an insertion is O(M (1 + log(N/M )) + log M log(N/ log M )), which is O(N ) in the worst case. This algorithm can be a basic building block for efficient implementations of steady-state multiobjective algorithms such as NSGA-II

05201 Abstracts Collection -- Design and Analysis of Randomized and Approximation Algorithms

From 15.05.05 to 20.05.05, the Dagstuhl Seminar 05201 ``Design and Analysis of Randomized and Approximation Algorithms\u27\u27 was held in the International Conference and Research Center (IBFI), Schloss Dagstuhl. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper. The first section describes the seminar topics and goals in general. Links to extended abstracts or full papers are provided, if available

Dominance-based variable analysis for large-scale multi-objective problems

Optimization problems with multiple objectives and many input variables inherit challenges from both large-scale optimization and multi-objective optimization. To solve the problems, decomposition and transformation methods are frequently used. In this study, an improved control variable analysis is proposed based on dominance and diversity in Pareto optimization. Further, the decomposition method is used in a cooperative coevolution framework with orthogonal sampling mutation. The algorithm's performances are compared against the weighted optimization framework. The results show that the proposed decomposition method has much better accuracy compared to the traditional method. The results also show that the cooperative coevolution framework with a good grouping is very competitive. Additionally, the number of search directions in orthogonal sampling can be easily configured. A small number of search directions will reduce the search space greatly while also restricting the area that can be explored and vice versa.Algorithms and the Foundations of Software technolog

Engineering Aggregation Operators for Relational In-Memory Database Systems

In this thesis we study the design and implementation of Aggregation operators in the context of relational in-memory database systems. In particular, we identify and address the following challenges: cache-efficiency, CPU-friendliness, parallelism within and across processors, robust handling of skewed data, adaptive processing, processing with constrained memory, and integration with modern database architectures. Our resulting algorithm outperforms the state-of-the-art by up to 3.7x

Combining Disparate Information for Machine Learning.

This thesis considers information fusion for four different types of machine learning problems: anomaly detection, information retrieval, collaborative filtering and structure learning for time series, and focuses on a common theme -- the benefit to combining disparate information resulting in improved algorithm performance. In this dissertation, several new algorithms and applications to real-world datasets are presented. In Chapter II, a novel approach called Pareto Depth Analysis (PDA) is proposed for combining different dissimilarity metrics for anomaly detection. PDA is applied to video-based anomaly detection of pedestrian trajectories. Following a similar idea, in Chapter III we propose to use a similar Pareto Front method for a multiple-query information retrieval problem when different queries represent different semantic concepts. Pareto Front information retrieval is applied to multiple query image retrieval. In Chapter IV, we extend a recently proposed collaborative retrieval approach to incorporate complementary social network information, an approach we call Social Collaborative Retrieval (SCR). SCR is applied to a music recommendation system that combines both user history and friendship network information to improve recall and weighted recall performance. In Chapter V, we propose a framework that combines time series data at different time scales and offsets for more accurate estimation of multiple precision matrices. We propose a general fused graphical lasso approach to jointly estimate these precision matrices. The framework is applied to modeling financial time series data.PhDElectrical Engineering: SystemsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/108878/1/coolmark_1.pd

LIPIcs, Volume 274, ESA 2023, Complete Volume

LIPIcs, Volume 274, ESA 2023, Complete Volum