Expedited Design Closure of Antenna Input Characteristics by Trust Region Gradient Search and Principal Component Analysis

Publisher's version (útgefin grein)Optimization-based parameter tuning has become an inherent part of contemporary antenna design process. For the sake of reliability, it is typically conducted at the level of full-wave electromagnetic (EM) simulation models. This may incur considerable computational expenses depending on the cost of an individual EM analysis, the number of adjustable variables, the type of task (local, global, single-/multi-objective optimization), and the constraints involved. For these reasons, utilization of conventional algorithms is often impractical. This paper proposes a novel gradient-based algorithm with numerical derivatives for expedited antenna optimization. The improvement of computational efficiency is obtained by employing a rank-one Broyden formula and restricting finite differentiation sensitivity updates to the principal directions of the Jacobian matrix, i.e., those corresponding to the most significant changes of the antenna responses. Comprehensive numerical validation carried out using three wideband antennas indicates that the presented methodology offers considerable savings of sixty percent with respect to the reference trust-region algorithm. At the same time, virtually no degradation of the design quality is observed. Furthermore, algorithm reliability is greatly improved (while offering comparable computational efficiency) over the recent state-of-the-art accelerated gradient-based procedures.The Icelandic Centre for Research (RANNIS) Grant 174114051, and in part by the National Science Centre of Poland Grant 2015/17/B/ST6/01857."Peer Reviewed

Antenna Modeling Using Variable-Fidelity EM Simulations and Constrained Co-Kriging

Publisher's version (útgefin grein)Utilization of fast surrogate models has become a viable alternative to direct handling of full-wave electromagnetic (EM) simulations in EM-driven design. Their purpose is to alleviate the difficulties related to high computational cost of multiple simulations required by the common numerical procedures such as parametric optimization or uncertainty quantification. Yet, conventional data-driven (or approximation) modeling techniques are severely affected by the curse of dimensionality. This is a serious limitation when it comes to modeling of highly nonlinear antenna characteristics. In practice, general-purpose surrogates can be rendered for the structures described by a few parameters within limited ranges thereof, which is grossly insufficient from the utility point of view. This paper proposes a novel modeling approach involving variable-fidelity EM simulations incorporated into the recently reported nested kriging modeling framework. Combining the information contained in the densely sampled low- and sparsely sampled high-fidelity models is realized using co-kriging. The resulting surrogate exhibits the predictive power comparable to the model constructed using exclusively high-fidelity data while offering significantly reduced setup cost. The advantages over conventional surrogates are pronounced even further. The presented modeling procedure is demonstrated using two antenna examples and further validated through the application case studies.This work was supported in part by the Icelandic Centre for Research (RANNIS) under Grant 206606051, and in part by the National Science Centre of Poland under Grant 2018/31/B/ST7/02369.Peer reviewe

EM-driven miniaturization of high-frequency structures through constrained optimization

The trends afoot for miniaturization of high-frequency electronic devices require integration of active and passive high-frequency circuit elements within a single system. This high level of accomplishment not only calls for a cutting-edge integration technology but also necessitates accommodation of the corresponding circuit components within a restricted space in applications such as implantable devices, internet of things (IoT), or 5G communication systems. At the same time, size reduction does not remain the only demand. The performance requirements of the abovementioned systems form a conjugate demand to that of the size reduction, yet with a contrasting nature. A compromise can be achieved through constrained numerical optimization, in which two kinds of constrains may exist: equality and inequality ones. Still, the high cost of electromagnetic-based (EM-based) constraint evaluations remains an obstruction. This issue can be partly mitigated by implicit constraint handling using the penalty function approach. Nevertheless, securing its performance requires expensive guess-work-based identification of the optimum setup of the penalty coefficients. An additional challenge lies in allocating the design within or in the vicinity of a thin feasible region corresponding to equality constraints. Furthermore, multimodal nature of constrained miniaturization problems leads to initial design dependency of the optimization results. Regardless of the constraint type and the corresponding treatment techniques, the computational expenses of the optimization-based size reduction persist as a main challenge. This thesis attempts to address the abovementioned issues specifically pertaining to optimization-driven miniaturization of high frequency structures by developing relevant algorithms in a proper sequence. The first proposed approach with automated adjustment of the penalty functions is based on the concept of sufficient constraint violation improvement, thereby eliminating the costly initial trial-and-error stage for the identification of the optimum setup of the penalty factors. Another introduced approach, i.e., correction-based treatment of the equality constraints alleviates the difficulty of allocating the design within a thin feasible region where designs satisfying the equality constraints reside. The next developed technique allows for global size reduction of high-frequency components. This approach not only eliminates the aforementioned multimodality issues, but also accelerates the overall global optimization process by constructing a dimensionality-reduced surrogate model over a pre-identified feasible region as compared to the complete parameter search space. Further to the latter, an optimization framework employing multi-resolution EM-model management has been proposed to address the high cost issue. The said technique provides nearly 50 percent average acceleration of the optimization-based miniaturization process. The proposed technique pivots upon a newly-defined concept of model-fidelity control based on a combination of algorithmic metrics, namely convergence status and constraint violation level. Numerical validation of the abovementioned algorithms has also been provided using an extensive set of high-frequency benchmark structures. To the best of the author´s knowledge, the presented study is the first investigation of this kind in the literature and can be considered a contribution to the state of the art of automated high-frequency design and miniaturization

Cost-Efficient Bi-Layer Modeling of Antenna Input Characteristics Using Gradient Kriging Surrogates

Publisher's version (útgefin grein)Over the recent years, surrogate modeling has been playing an increasing role in the design of antenna structures. The main incentive is to mitigate the issues related to high cost of electromagnetic (EM)-based procedures. Among the various techniques, approximation surrogates are the most popular ones due to their flexibility and easy access. Notwithstanding, data-driven modeling of antenna characteristics is associated with serious practical issues, the primary one being the curse of dimensionality, particularly troublesome due to typically high nonlinearity of antenna responses. This limits applicability of conventional surrogates to simple structures described by a few parameters within narrow ranges thereof, which is grossly insufficient from the point of view of design utility. Many of these issues can be alleviated by the recently proposed constrained modeling techniques that restrict the surrogate domain to regions containing high-quality designs with respect to the relevant performance figures, which are identified using the pre-optimized reference designs at an extra computational effort. This paper proposes a methodology based on gradient-enhanced kriging (GEK). It enables a considerable reduction of the number of reference points required to construct the inverse surrogate (employed in surrogate model definition) by incorporating the sensitivity data into the nested kriging framework. Using two antenna examples, it is demonstrated to yield significant savings in terms of the surrogate model setup cost as compared to both conventional modeling methods and the original nested kriging.The Icelandic Centre for Research (RANNIS) under Grant 206606051, in part by the National Science Centre of Poland under Grant 2017/27/B/ST7/00563, and in part by the Abu-Dhabi Department of Education and Knowledge (ADEK) Award for Research Excellence, in 2019, under Grant AARE19-245."Peer Reviewed

On Inadequacy of Sequential Design of Experiments for Performance-Driven Surrogate Modeling of Antenna Input Characteristics

Publisher's version (útgefin grein)Design of contemporary antennas necessarily involves electromagnetic (EM) simulation tools. Their employment is imperative to ensure evaluation reliability but also to carry out the design process itself, especially, the adjustment of antenna dimensions. For the latter, traditionally used parameter sweeping is more and more often replaced by rigorous numerical optimization, which entails considerable computational expenses, sometimes prohibitive. A potentially attractive way of expediting the simulation-based design procedures is the replacement of expensive EM analysis by fast surrogate models (or metamodels). Unfortunately, due to the curse of dimensionality and considerable nonlinearity of antenna characteristics, applicability of conventional modeling methods is limited to structures described by small numbers of parameters within narrow ranges thereof. A recently proposed nested kriging technique works around these issues by allocating the surrogate model domain within the regions containing designs that are of high quality with respect to the selected performance figures. This paper investigates whether sequential design of experiments (DoE) is capable of enhancing the modeling accuracy over one-shot space-filling data sampling originally implemented in the nested kriging framework. Numerical verification carried out for two microstrip antennas indicates that no noticeable benefits can be achieved, which contradicts the common-sense expectations. This result can be explained by a particular geometry of the confined domain of the performance-driven surrogate. As this set consists of nearly-optimum designs, the average nonlinearity of the antenna responses therein is almost location independent, therefore optimum training data allocation should be close to uniform. This is indeed corroborated by our experiments.This work was supported in part by the Icelandic Centre for Research (RANNIS) under Grant 174114051 and Grant174573051, and in part by the National Science Centre of Poland under Grant 2018/31/B/ST7/02369.Peer Reviewe

An Early History of Optimization Technology for Automated Design of Microwave Circuits

This paper outlines the early history of optimization technology for the design of microwave circuits—a personal journey filled with aspirations, academic contributions, and commercial innovations. Microwave engineers have evolved from being consumers of mathematical optimization algorithms to originators of exciting concepts and technologies that have spread far beyond the boundaries of microwaves. From the early days of simple direct search algorithms based on heuristic methods through gradient-based electromagnetic optimization to space mapping technology we arrive at today’s surrogate methodologies. Our path finally connects to today’s multi-physics, system-level, and measurement-based optimization challenges exploiting confined and feature-based surrogates, cognition-driven space mapping, Bayesian approaches, and more. Our story recognizes visionaries such as William J. Getsinger of the 1960s and Robert Pucel of the 1980s, and highlights a seminal decades-long collaboration with mathematician Kaj Madsen. We address not only academic contributions that provide proof of concept, but also indicate early formative milestones in the development of commercially competitive software specifically featuring optimization technology.ITESO, A.C

Design-Oriented Two-Stage Surrogate Modeling of Miniaturized Microstrip Circuits With Dimensionality Reduction

Publisher's version (útgefin grein)Contemporary microwave design heavily relies on full-wave electromagnetic (EM) simulation tools. This is especially the case for miniaturized devices where EM cross-coupling effects cannot be adequately accounted for using equivalent network models. Unfortunately, EM analysis incurs considerable computational expenses, which becomes a bottleneck whenever multiple evaluations are required. Common simulation-based design tasks include parametric optimization and uncertainty quantification. These can be accelerated using fast replacement models, among which the data-driven surrogates are the most popular. Notwithstanding, a construction of approximation models for microwave components is hindered by the dimensionality issues as well as high nonlinearity of system characteristics. A partial alleviation of the mentioned difficulties can be achieved with the recently reported performance-driven modeling methods, including the nested kriging framework. Therein, the computational benefits are obtained by appropriate confinement of the surrogate model domain, spanned by a set of pre-optimized reference designs, and by focusing on the parameter space region that contains high quality designs with respect to the considered performance figures. This paper presents a methodology that incorporates the concept of nested kriging and enhances it by explicit dimensionality reduction based on spectral decomposition of the reference design set. Extensive verification studies conducted for a compact rat-race coupler and a three-section impedance matching transformer demonstrate superiority of the presented approach over both the conventional techniques and the nested kriging in terms of modeling accuracy. Design utility of our surrogates is corroborated through application cases studies.The Icelandic Centre for Research (RANNIS) under Grant 206606051, in part by the National Science Centre of Poland under Grant 2018/31/B/ST7/02369, and in part by the Abu-Dhabi Department of Education and Knowledge (ADEK) Award for Research Excellence, in 2019, under Grant AARE19-245."Peer Reviewed

Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

Reliable Surrogate Modeling of Antenna Input Characteristics by Means of Domain Confinement and Principal Components

Publisher's version (útgefin grein)A reliable design of contemporary antenna structures necessarily involves full-wave electromagnetic (EM) analysis which is the only tool capable of accounting, for example, for element coupling or the effects of connectors. As EM simulations tend to be CPU-intensive, surrogate modeling allows for relieving the computational overhead of design tasks that require numerous analyses, for example, parametric optimization or uncertainty quantification. Notwithstanding, conventional data-driven surrogates are not suitable for handling highly nonlinear antenna characteristics over multidimensional parameter spaces. This paper proposes a novel modeling approach that employs a recently introduced concept of domain confinement, as well as principal component analysis. In our approach, the modeling process is restricted to the region containing high-quality designs with respect to the performance figures of antennas under design, identified using a set of pre-optimized reference designs. The model domain is spanned by the selected principal components of the reference design set, which reduces both its volume and dimensionality. As a result, a reliable surrogate can be constructed over wide ranges of both operating conditions and antenna parameters, using small training datasets. Our technique is demonstrated using two antenna examples and is favorably compared to both conventional and constrained modeling approaches. Application case studies (antenna optimization) are also discussed.This work was supported in part by the Icelandic Centre for Research (RANNIS) grant 174114051, and by the National Science Centre of Poland grant 2017/27/B/ST7/00563.Peer Reviewe

Optimization based energy-efficient control inmobile communication networks

In this work we consider how best to control mobility and transmission for the purpose of datatransfer and aggregation in a network of mobile autonomous agents. In particular we considernetworks containing unmanned aerial vehicles (UAVs). We first consider a single link betweena mobile transmitter-receiver pair, and show that the total amount of transmittable data isbounded. For certain special, but not overly restrictive cases, we can determine closed-formexpressions for this bound, as a function of relevant mobility and communication parameters.We then use nonlinear model predictive control (NMPC) to jointly optimize mobility and trans-mission schemes of all networked nodes for the purpose of minimizing the energy expenditureof the network. This yields a novel nonlinear optimal control problem for arbitrary networksof autonomous agents, which we solve with state-of-the-art nonlinear solvers. Numerical re-sults demonstrate increased network capacity and significant communication energy savingscompared to more na ̈ıve policies. All energy expenditure of an autonomous agent is due tocommunication, computation, or mobility and the actual computation of the NMPC solutionmay be a significant cost in both time and computational resources. Furthermore, frequentbroadcasting of control policies throughout the network can require significant transmit andreceive energies. Motivated by this, we develop an event-triggering scheme which accounts forthe accuracy of the optimal control solution, and provides guarantees of the minimum timebetween successive control updates. Solution accuracy should be accounted for in any triggeredNMPC scheme where the system may be run in open loop for extended times based on pos-sibly inaccurate state predictions. We use this analysis to trade-off the cost of updating ourtransmission and locomotion policies, with the frequency by which they must be updated. Thisgives a method to trade-off the computation, communication and mobility related energies ofthe mobile autonomous network.Open Acces