International Conference on Continuous Optimization (ICCOPT) 2019 Conference Book

The Sixth International Conference on Continuous Optimization took place on the campus of the Technical University of Berlin, August 3-8, 2019. The ICCOPT is a flagship conference of the Mathematical Optimization Society (MOS), organized every three years. ICCOPT 2019 was hosted by the Weierstrass Institute for Applied Analysis and Stochastics (WIAS) Berlin. It included a Summer School and a Conference with a series of plenary and semi-plenary talks, organized and contributed sessions, and poster sessions. This book comprises the full conference program. It contains, in particular, the scientific program in survey style as well as with all details, and information on the social program, the venue, special meetings, and more

Advanced Signal Processing Techniques for Two-Way Relaying Networks and Full-Duplex Communication Systems

Sehr hohe Datenraten und ständig verfügbare Netzabdeckung in zukünftigen drahtlosen Netzwerken erfordern neue Algorithmen auf der physischen Schicht. Die Nutzung von Relais stellt ein vielversprechendes Verfahren dar, da die Netzabdeckung gesteigert werden kann. Zusätzlich steht hierdurch im Vergleich zu Kupfer- oder Glasfaserleitungen eine preiswerte Lösung zur Anbindung an die Netzinfrastruktur zur Verfügung. Traditionelle Einwege-Relais-Techniken (One-Way Relaying [OWR]) nutzen Halbduplex-Verfahren (HD-Verfahren), welche das Übertragungssystem ausbremst und zu spektralen Verlusten führt. Einerseits erlauben es Zweiwege-Relais-Techniken (Two-Way Relaying [TWR]), simultan sowohl an das Relais zu senden als auch von diesem zu empfangen, wodurch im Vergleich zu OWR das Spektrum effizienter genutzt wird. Aus diesem Grunde untersuchen wir Zweiwege-Relais und im Speziellen TWR-Systeme für den Mehrpaar-/Mehrnutzer-Betrieb unter Nutzung von Amplify-and-forward-Relais (AF-Relais). Derartige Szenarien leiden unter Interferenzen zwischen Paaren bzw. zwischen Nutzern. Um diesen Interferenzen Herr zu werden, werden hochentwickelte Signalverarbeitungsalgorithmen – oder in anderen Worten räumliche Mehrfachzugriffsverfahren (Spatial Division Multiple Access [SDMA]) – benötigt. Andererseits kann der spektrale Verlust durch den HD-Betrieb auch kompensiert werden, wenn das Relais im Vollduplexbetrieb arbeitet. Nichtsdestotrotz ist ein FD-Gerät in der Praxis aufgrund starker interner Selbstinterferenz (SI) und begrenztem Dynamikumfang des Tranceivers schwer zu realisieren. Aus diesem Grunde sollten fortschrittliche Verfahren zur SI-Ünterdrückung entwickelt werden. Diese Dissertation trägt diesen beiden Zielen Rechnung, indem optimale und/oder effiziente algebraische Lösungen entwickelt werden, welche verschiedenen Nutzenfunktionen, wie Summenrate und minimale Sendeleistung, maximieren.Im ersten Teil studieren wir zunächst Mehrpaar-TWR-Netzwerke mit einem einzelnen Mehrantennen-AF-Relais. Dieser Anwendungsfall kann auch so betrachtet werden, dass sich mehrere verschiedene Dienstoperatoren Relais und Spektrum teilen, wobei verschiedene Nutzerpaare zu verschiedenen Dienstoperatoren gehören. Aktuelle Ansätzen zielen auf Interferenzunterdrückung ab. Wir schlagen ein auf Projektion basiertes Verfahren zur Trennung mehrerer Dienstoperatoren (projection based separation of multiple operators [ProBaSeMO]) vor. ProBaSeMO ist leicht anpassbar für den Fall, dass jeder Nutzer mehrere Antennen besitzt oder unterschiedliche Systemdesignkriterien angewendet werden müssen. Als Bewertungsmaßstab für ProBaSeMO entwickeln wir optimale Algorithmen zur Maximierung der Summenrate, zur Minimierung der Sendeleistung am Relais oder zur Maximierung des minimalen Signal-zu-Interferenz-und-Rausch-Verhältnisses (Signal to Interference and Noise Ratio [SINR]) am Nutzer. Zur Maximierung der Summenrate wurden spezifische gradientenbasierte Methoden entwickelt, die unabhängig davon sind, ob ein Nutzer mit einer oder mehr Antennen ausgestattet ist. Um im Falle eines „Worst-Case“ immer noch eine polynomielle Laufzeit zu garantieren, entwickelten wir einen Algorithmus mit polynomieller Laufzeit. Dieser ist inspiriert von der „Polynomial Time Difference of Convex Functions“-Methode (POTDC-Methode). Bezüglich der Summenrate des Systems untersuchen wir zuletzt, welche Bedingungen erfüllt sein müssen, um einen Gewinn durch gemeinsames Nutzen zu erhalten. Hiernach untersuchen wir die Maximierung der Summenrate eines Mehrpaar-TWR-Netzwerkes mit mehreren Einantennen-AF-Relais und Einantennen-Nutzern. Das daraus resultierende Problem der Summenraten-Maximierung, gebunden an eine bestimmte Gesamtsendeleistung aller Relais im Netzwerk, ist ähnlich dem des vorangegangenen Szenarios. Dementsprechend kann eine optimale Lösung für das eine Szenario auch für das jeweils andere Szenario genutzt werden. Weiterhin werden basierend auf dem Polynomialzeitalgorithmus global optimale Lösungen entwickelt. Diese Lösungen sind entweder an eine maximale Gesamtsendeleistung aller Relais oder an eine maximale Sendeleistung jedes einzelnen Relais gebunden. Zusätzlich entwickeln wir suboptimale Lösungen, die effizient in ihrer Laufzeit sind und eine Approximation der optimalen Lösung darstellen. Hiernach verlegen wir unser Augenmerk auf ein Mehrpaar-TWR-Netzwerk mit mehreren Mehrantennen-AF-Relais und mehreren Repeatern. Solch ein Szenario ist allgemeiner, da die vorherigen beiden Szenarien als spezielle Realisierungen dieses Szenarios aufgefasst werden können. Das Interferenz-Management in diesem Szenario ist herausfordernder aufgrund der vorhandenen Repeater. Interferenzneutralisierung (IN) stellt eine Lösung dar, um diese Art Interferenz zu handhaben. Im Zuge dessen werden notwendige und ausreichende Bedingungen zur Aufhebung der Interferenz hergeleitet. Weiterhin wird ein Framework entwickelt, dass verschiedene Systemnutzenfunktionen optimiert, wobei IN im jeweiligen Netzwerk vorhanden sein kann oder auch nicht. Dies ist unabhängig davon, ob die Relais einer maximalen Gesamtsendeleistung oder einer individuellen maximalen Sendeleistung unterliegen. Letztendlich entwickeln wir ein Übertragungsverfahren sowie ein Vorkodier- und Dekodierverfahren für Basisstationen (BS) in einem TWR-assistierten Mehrbenutzer-MIMO-Downlink-Kanal. Im Vergleich mit dem Mehrpaar-TWR-Netzwerk leidet dieses Szenario unter Interferenzen zwischen den Kanälen. Wir entwickeln drei suboptimale Algorithmen, welche auf Kanalinversion basieren. ProBaSeMO und „Zero-Forcing Dirty Paper Coding“ (ZFDPC), welche eine geringe Zeitkomplexität aufweisen, schaffen eine Balance zwischen Leistungsfähigkeit und Komplexität. Zusätzlich gibt es jeweils nur geringe Einbrüche in stark beanspruchten Kommunikationssystemen.Im zweiten Teil untersuchen wir Techniken zur SI-Unterdrückung, um den FD-Gewinn in einem Punkt-zu-Punkt-System auszunutzen. Zunächst entwickeln wir ein Übertragungsverfahren, dass auf SI Rücksicht nimmt und die SI-Unterdrückung gegen den Multiplexgewinn abwägt. Die besten Ergebnisse werden durch die perfekte Kenntnis des Kanals erzielt, was praktisch nicht genau der Fall ist. Aus diesem Grund werden Übertragungstechniken für den „Worst Case“ entwickelt, die den Kanalschätzfehlern Rechnung tragen. Diese Fehler werden deterministisch modelliert und durch Ellipsoide beschränkt. In praktischen Szenarien ist der HF-Schaltkreise nicht perfekt. Dies hat Einfluss auf die Verfahren zur SI-Unterdrückung und führt zu einer Restselbstinterferenz. Wir entwickeln effiziente Übertragungstechniken mittels Beamforming, welche auf dem Signal-zu-Verlust-und-Rausch-Verhältnis (signal to leakage plus noise ratio [SLNR]) aufbauen, um Unvollkommenheiten der HF-Schaltkreise auszugleichen. Zusätzlich können alle Designkonzepte auf FD-OWR-Systeme erweitert werden.To enable ultra-high data rate and ubiquitous coverage in future wireless networks, new physical layer techniques are desired. Relaying is a promising technique for future wireless networks since it can boost the coverage and can provide low cost wireless backhauling solutions, as compared to traditional wired backhauling solutions via fiber and copper. Traditional one-way relaying (OWR) techniques suffer from the spectral loss due to the half-duplex (HD) operation at the relay. On one hand, two-way relaying (TWR) allows the communication partners to transmit to and/or receive from the relay simultaneously and thus uses the spectrum more efficiently than OWR. Therefore, we study two-way relays and more specifically multi-pair/multi-user TWR systems with amplify-and-forward (AF) relays. These scenarios suffer from inter-pair or inter-user interference. To deal with the interference, advanced signal processing algorithms, in other words, spatial division multiple access (SDMA) techniques, are desired. On the other hand, if the relay is a full-duplex (FD) relay, the spectral loss due to a HD operation can also be compensated. However, in practice, a FD device is hard to realize due to the strong loop-back self-interference and the limited dynamic range at the transceiver. Thus, advanced self-interference suppression techniques should be developed. This thesis contributes to the two goals by developing optimal and/or efficient algebraic solutions for different scenarios subject to different utility functions of the system, e.g., sum rate maximization and transmit power minimization. In the first part of this thesis, we first study a multi-pair TWR network with a multi-antenna AF relay. This scenario can be also treated as the sharing of the relay and the spectrum among multiple operators assuming that different pairs of users belong to different operators. Existing approaches focus on interference suppression. We propose a projection based separation of multiple operators (ProBaSeMO) scheme, which can be easily extended when each user has multiple antennas or when different system design criteria are applied. To benchmark the ProBaSeMO scheme, we develop optimal relay transmit strategies to maximize the system sum rate, minimize the required transmit power at the relay, or maximize the minimum signal to interference plus noise ratio (SINR) of the users. Specifically for the sum rate maximization problem, gradient based methods are developed regardless whether each user has a single antenna or multiple antennas. To guarantee a worst-case polynomial time solution, we also develop a polynomial time algorithm which has been inspired by the polynomial time difference of convex functions (POTDC) method. Finally, we analyze the conditions for obtaining the sharing gain in terms of the sum rate. Then we study the sum rate maximization problem of a multi-pair TWR network with multiple single antenna AF relays and single antenna users. The resulting sum rate maximization problem, subject to a total transmit power constraint of the relays in the network, yields a similar problem structure as in the previous scenario. Therefore the optimal solution for one scenario can be used for the other. Moreover, a global optimal solution, which is based on the polyblock approach, and several suboptimal solutions, which are more computationally efficient and approximate the optimal solution, are developed when there is a total transmit power constraint of the relays in the network or each relay has its own transmit power constraint. We then shift our focus to a multi-pair TWR network with multiple multi-antenna AF relays and multiple dumb repeaters. This scenario is more general because the previous two scenarios can be seen as special realizations of this scenario. The interference management in this scenario is more challenging due to the existence of the repeaters. Interference neutralization (IN) is a solution for dealing with this kind of interference. Thereby, necessary and sufficient conditions for neutralizing the interference are derived. Moreover, a general framework to optimize different system utility functions in this network with or without IN is developed regardless whether the AF relays in the network have a total transmit power limit or individual transmit power limits. Finally, we develop the relay transmit strategy as well as base station (BS) precoding and decoding schemes for a TWR assisted multi-user MIMO (MU-MIMO) downlink channel. Compared to the multi-pair TWR network, this scenario suffers from the co-channel interference. We develop three suboptimal algorithms which are based on channel inversion, ProBaSeMO and zero-forcing dirty paper coding (ZFDPC), which has a low computational complexity, provides a balance between the performance and the complexity, and suffers only a little when the system is heavily loaded, respectively.In the second part of this thesis, we investigate self-interference (SI) suppression techniques to exploit the FD gain for a point-to-point MIMO system. We first develop SI aware transmit strategies, which provide a balance between the SI suppression and the multiplexing gain of the system. To get the best performance, perfect channel state information (CSI) is needed, which is imperfect in practice. Thus, worst case transmit strategies to combat the imperfect CSI are developed, where the CSI errors are modeled deterministically and bounded by ellipsoids. In real word applications, the RF chain is imperfect. This affects the performance of the SI suppression techniques and thus results in residual SI. We develop efficient transmit beamforming techniques, which are based on the signal to leakage plus noise ratio (SLNR) criterion, to deal with the imperfections in the RF chain. All the proposed design concepts can be extended to FD OWR systems

Multiuser Downlink Beamforming Techniques for Cognitive Radio Networks

Spectrum expansion and a significant network densification are key elements in meeting the ever increasing demands in data rates and traffic loads of future communication systems. In this context, cognitive radio (CR) techniques, which sense and opportunistically use spectrum resources, as well as beamforming methods, which increase spectral efficiency by exploiting spatial dimensions, are particularly promising. Thus, the scope of this thesis is to propose efficient downlink (DL) beamforming and power allocation schemes, in a CR framework. The methods developed here, can be further applied to various practical scenarios such as hierarchical multi-tier, heterogenous or dense networks. In this work, the particular CR underlay paradigm is considered, according to which, secondary users (SUs) opportunistically use the spectrum held by primary users (PUs), without disturbing the operation of the latter. Developing beamforming algorithms, in this scenario, requires that channel state information (CSI) from both SUs and PUs is required at the BS. Since in CR networks PUs have typically limited or no cooperation with the SUs, we particularly focus on designing beamforming schemes based on statistical CSI, which can be obtained with limited or no feedback. To further meet the energy efficiency requirements, the proposed beamforming designs aim to minimize the transmitted power at the BS, which serves SUs at their desired Quality-of-Service (QoS), in form of Signal-to-interference-plus-noise (SINR), while respecting the interference requirements of the primary network. In the first stage, this problem is considered under the assumption of perfect CSI of both SUs and PUs. The difficulty of this problem consists on one hand, in its non-convexity and, on the other hand, in the fact that the beamformers are coupled in all constraints. State-of-the-art approaches are based on convex approximations, given by semidefinite relaxation (SDR) methods, and suffer from large computational complexity per iteration, as well as the drawback that optimal beamformers cannot always be retrieved from the obtained solutions. The approach, proposed in this thesis, aims to overcome these limitations by exploiting the structure of the problem. We show that the original downlink problem can be equivalently represented in a so called ’virtual’ uplink domain (VUL), where the beamformers and powers are allocated, such that uplink SINR constraints of the SUs are satisfied, while both SUs and PUs transmit to the BS. The resulting VUL problem has a simpler structure than the original formulation, as the beamformers are decoupled in the SINR constraints. This allows us to develop algorithms, which solve the original problem, with significantly less computational complexity than the state-of-the-art methods. The rigurous analysis of the Lagrange duality, performed next, exposes scenarios, in which the equivalence between VUL and DL problems can be theroretically proven and shows the relation between the obtained powers in the VUL domain and the optimal Lagrange multipliers, corresponding to the original problem. We further use the duality results and the intuition of the VUL reformulation, in the extended problem of joint admission control and beamforming. The aim of this is to find a maximal set of SUs, which can be jointly served, as well as the corresponding beamforming and power allocation. Our approach uses Lagrange duality, to detect infeasible cases and the intuition of the VUL reformulation to decide upon the users, which have the largest contribution to the infeasibiity of the problem. With these elements, we construct a deflation based algorithm for the joint beamforming and admission control problem, which benefits from low complexity, yet close to optimal perfomance. To make the method also suitable for dense networks, with a large number of SUs and PUs, a cluster aided approach is further proposed and consists in grouping users, based on their long term spatial signatures. The information in the clusters serves as an initial indication of the SUs which cannot be simultaneously served and the PUs which pose similar interference constraints to the BS. Thus, the cluster information can be used to significantly reduce the dimension of the problem in scenarios with large number of SUs and PUs, and this fact is further validated by extensive simulations. In the second part of this thesis, the practical case of imperfect covariance based CSI, available at the transmitter, is considered. To account for the uncertainty in the channel knowledge, a worst case approach is taken, in which the SINR and the interference constraints are considered for all CSI mismatches in a predefined set One important factor, which influences the performance of the worst case beamforming approach is a proper choice of the the defined uncertainty set, to accurately model the possible uncertainties in the CSI. In this thesis, we show that recently derived Riemannian distances are better suited to measure the mismatches in the statistical CSI than the commonly used Frobenius norms, as they better capture the properties of the covariance matrices, than the latter. Therefore, we formulate a novel worst case robust beamforming problem, in which the uncertainty set is bounded based on these measures and for this, we derive a convex approximation, to which a solution can be efficiently found in polynomial time. Theoretical and numerical results confirm the significantly better performance of our proposed methods, as compared to the state-of-the-art methods, in which Frobenius norms are used to bound the mismatches. The consistently better results of the designs utilizing Riemannian distances also manifest in scenarios with large number of users, where admission control techniques must supplement the beamforming design with imperfect CSI. Both benchmark methods as well as low complexity techniques, developed in this thesis to solve this problem, show that designs based on Riemannian distance outperform their competitors, in both required transmit power as well as number of users, which can be simultaneously served

Recent Experiences in Multidisciplinary Analysis and Optimization, part 2

The papers presented at the NASA Symposium on Recent Experiences in Multidisciplinary Analysis and Optimization held at NASA Langley Research Center, Hampton, Virginia, April 24 to 26, 1984 are given. The purposes of the symposium were to exchange information about the status of the application of optimization and the associated analyses in industry or research laboratories to real life problems and to examine the directions of future developments

Communication-Efficient Algorithms For Distributed Optimization

This thesis is concerned with the design of distributed algorithms for solving optimization problems. We consider networks where each node has exclusive access to a cost function, and design algorithms that make all nodes cooperate to find the minimum of the sum of all the cost functions. Several problems in signal processing, control, and machine learning can be posed as such optimization problems. Given that communication is often the most energy-consuming operation in networks, it is important to design communication-efficient algorithms. The main contributions of this thesis are a classification scheme for distributed optimization and a set of corresponding communication-efficient algorithms. The class of optimization problems we consider is quite general, since each function may depend on arbitrary components of the optimization variable, and not necessarily on all of them. In doing so, we go beyond the common assumption in distributed optimization and create additional structure that can be used to reduce the number of communications. This structure is captured by our classification scheme, which identifies easier instances of the problem, for example the standard distributed optimization problem, where all functions depend on all the components of the variable. In our algorithms, no central node coordinates the network, all the communications occur between neighboring nodes, and the data associated with each node is processed locally. We show several applications including average consensus, support vector machines, network flows, and several distributed scenarios for compressed sensing. We also propose a new framework for distributed model predictive control. Through extensive numerical experiments, we show that our algorithms outperform prior distributed algorithms in terms of communication-efficiency, even some that were specifically designed for a particular application.Comment: Thesis defended on October 10, 2013. Dual PhD degree from Carnegie Mellon University, PA, and Instituto Superior T\'ecnico, Lisbon, Portuga

A vision-based optical character recognition system for real-time identification of tractors in a port container terminal

Automation has been seen as a promising solution to increase the productivity of modern sea port container terminals. The potential of increase in throughput, work efficiency and reduction of labor cost have lured stick holders to strive for the introduction of automation in the overall terminal operation. A specific container handling process that is readily amenable to automation is the deployment and control of gantry cranes in the container yard of a container terminal where typical operations of truck identification, loading and unloading containers, and job management are primarily performed manually in a typical terminal. To facilitate the overall automation of the gantry crane operation, we devised an approach for the real-time identification of tractors through the recognition of the corresponding number plates that are located on top of the tractor cabin. With this crucial piece of information, remote or automated yard operations can then be performed. A machine vision-based system is introduced whereby these number plates are read and identified in real-time while the tractors are operating in the terminal. In this paper, we present the design and implementation of the system and highlight the major difficulties encountered including the recognition of character information printed on the number plates due to poor image integrity. Working solutions are proposed to address these problems which are incorporated in the overall identification system.postprin

Job shop scheduling with artificial immune systems

The job shop scheduling is complex due to the dynamic environment. When the information of the jobs and machines are pre-defined and no unexpected events occur, the job shop is static. However, the real scheduling environment is always dynamic due to the constantly changing information and different uncertainties. This study discusses this complex job shop scheduling environment, and applies the AIS theory and switching strategy that changes the sequencing approach to the dispatching approach by taking into account the system status to solve this problem. AIS is a biological inspired computational paradigm that simulates the mechanisms of the biological immune system. Therefore, AIS presents appealing features of immune system that make AIS unique from other evolutionary intelligent algorithm, such as self-learning, long-lasting memory, cross reactive response, discrimination of self from non-self, fault tolerance, and strong adaptability to the environment. These features of AIS are successfully used in this study to solve the job shop scheduling problem. When the job shop environment is static, sequencing approach based on the clonal selection theory and immune network theory of AIS is applied. This approach achieves great performance, especially for small size problems in terms of computation time. The feature of long-lasting memory is demonstrated to be able to accelerate the convergence rate of the algorithm and reduce the computation time. When some unexpected events occasionally arrive at the job shop and disrupt the static environment, an extended deterministic dendritic cell algorithm (DCA) based on the DCA theory of AIS is proposed to arrange the rescheduling process to balance the efficiency and stability of the system. When the disturbances continuously occur, such as the continuous jobs arrival, the sequencing approach is changed to the dispatching approach that involves the priority dispatching rules (PDRs). The immune network theory of AIS is applied to propose an idiotypic network model of PDRs to arrange the application of various dispatching rules. The experiments show that the proposed network model presents strong adaptability to the dynamic job shop scheduling environment.postprin