GENDIRECT: a GENeralized DIRECT-type algorithmic framework for derivative-free global optimization

Over the past three decades, numerous articles have been published discussing the renowned DIRECT algorithm (DIvididing RECTangles). These articles present innovative ideas to enhance its performance and adapt it to various types of optimization problems. A comprehensive collection of deterministic, derivative-free algorithmic implementations based on the DIRECT framework has recently been introduced as part of the DIRECTGO project. DIRECTGO empowers users to conveniently employ diverse DIRECT-type algorithms, enabling efficient solutions to practical optimization problems. Despite their variations, DIRECT-type algorithms share a common algorithmic structure and typically differ only at certain steps. Therefore, we propose GENDIRECT -- GENeralized DIRECT-type framework that encompasses and unifies DIRECT-type algorithms into a single, generalized framework within this paper. GENDIRECT offers a practical alternative to the creation of yet another ``new'' DIRECT-type algorithm that closely resembles existing ones. Instead, GENDIRECT allows the efficient generation of known or novel DIRECT-type optimization algorithms by assembling different algorithmic components. This approach provides considerably more flexibility compared to both the DIRECTGO toolbox and individual DIRECT-type algorithms. A few hundred thousand DIRECT-type algorithms can be combined using GENDIRECT, facilitating users' easy customization and the addition of new algorithmic components. By modifying specific components of five highly promising DIRECT-type algorithms found in the existing literature using GENDIRECT, the significant potential of GENDIRECT has been demonstrated. The resulting newly developed improved approaches exhibit greater efficiency and enhanced robustness in dealing with problems of varying complexity.Comment: 29 pages, 6 figures, 8 table

Global optimization using the branch‐and‐bound algorithm with a combination of Lipschitz bounds over simplices

Many problems in economy may be formulated as global optimization problems. Most numerically promising methods for solution of multivariate unconstrained Lipschitz optimization problems of dimension greater than 2 use rectangular or simplicial branch‐and‐bound techniques with computationally cheap, but rather crude lower bounds. The proposed branch‐and‐bound algorithm with simplicial partitions for global optimization uses a combination of 2 types of Lipschitz bounds. One is an improved Lipschitz bound with the first norm. The other is a combination of simple bounds with different norms. The efficiency of the proposed global optimization algorithm is evaluated experimentally and compared with the results of other well‐known algorithms. The proposed algorithm often outperforms the comparable branch‐and‐bound algorithms. Santrauka Daug įvairių ekonomikos uždavinių yra formuluojami kaip globaliojo optimizavimo uždaviniai. Didžioji dalis Lipšico globaliojo optimizavimo metodų, tinkamų spręsti didesnės dimensijos, t. y. n > 2, uždavinius, naudoja stačiakampį arba simpleksinį šakų ir rėžių metodus bei paprastesnius rėžius. Šiame darbe pasiūlytas simpleksinis šakų ir rėžių algoritmas, naudojantis dviejų tipų viršutinių rėžių junginį. Pirmasis yra pagerintas rėžis su pirmąja norma, kitas – trijų paprastesnių rėžių su skirtingomis normomis junginys. Gautieji eksperimentiniai pasiūlyto algoritmo rezultatai yra palyginti su kitų gerai žinomų Lipšico optimizavimo algoritmų rezultatais.  First published online: 21 Oct 2010 Reikšminiai žodžiai: šakų ir rėžių algoritmas, globalusis optimizavimas, Lipšico optimizavimas, Lipšico rėžis

Influence of Lipschitz bounds on the speed of global optimization

Global optimization methods based on Lipschitz bounds have been analyzed and applied widely to solve various optimization problems. In this paper a bound for Lipschitz function is proposed, which is computed using function values at the vertices of a simplex and the radius of the circumscribed sphere. The efficiency of a branch and bound algorithm with proposed bound and combinations of bounds is evaluated experimentally while solving a number of multidimensional test problems for global optimization. The influence of different bounds on the performance of a branch and bound algorithm has been investigated

Improved Lipschitz bounds with the first norm for function values over multidimensional simplex

A branch and bound algorithm for global optimization is proposed, where the maximum of an upper bounding function based on Lipschitz condition and the first norm over a simplex is used as the upper bound of function. In this case the graph of bounding function is intersection of n‐dimensional pyramids and its maximum point is found solving a system of linear equations. The efficiency of the proposed global optimization algorithm is evaluated experimentally. First Published Online: 14 Oct 201

On parallel Branch and Bound frameworks for Global Optimization

Branch and Bound (B&B) algorithms are known to exhibit an irregularity of the search tree. Therefore, developing a parallel approach for this kind of algorithms is a challenge. The efficiency of a B&B algorithm depends on the chosen Branching, Bounding, Selection, Rejection, and Termination rules. The question we investigate is how the chosen platform consisting of programming language, used libraries, or skeletons influences programming effort and algorithm performance. Selection rule and data management structures are usually hidden to programmers for frameworks with a high level of abstraction, as well as the load balancing strategy, when the algorithm is run in parallel. We investigate the question by implementing a multidimensional Global Optimization B&B algorithm with the help of three frameworks with a different level of abstraction (from more to less): Bobpp, Threading Building Blocks (TBB), and a customized Pthread implementation. The following has been found. The Bobpp implementation is easy to code, but exhibits the poorest scalability. On the contrast, the TBB and Pthread implementations scale almost linearly on the used platform. The TBB approach shows a slightly better productivity

Objective and violation upper bounds on a DIRECT-filter method for global optimization

This paper addresses the problem of solving a constrained global optimization problem using a modification of the DIRECT method that incorporates the filter methodology to simultaneously minimize the objective function and the constraints violation. Thus, in the “Selection” step of the herein proposed DIRECT-filter algorithm, the hyperrectangles are classified in four categories and subsequently handled separately. The new algorithm also imposes upper bounds on the objective function and constraints violation aiming to discard some hyperrectangles from the process of identifying the potentially optimal ones. A heuristic to avoid the exploration of the hyperrectangles that have been mostly divided is also implemented. Preliminary numerical experiments are carried out to show the effectiveness of the imposed upper bounds on the objective and violation as well as the goodness of the heuristic.The authors wish to thank two anonymous referees for theircomments and suggestions to improve the paper. This work has been supported by FCT{ Fundação para a Ciência e Tecnologia within the Projects Scope: UID/CEC/00319/2019 and UID/MAT/00013/2013