An Overview on Application of Machine Learning Techniques in Optical Networks

Today's telecommunication networks have become sources of enormous amounts of widely heterogeneous data. This information can be retrieved from network traffic traces, network alarms, signal quality indicators, users' behavioral data, etc. Advanced mathematical tools are required to extract meaningful information from these data and take decisions pertaining to the proper functioning of the networks from the network-generated data. Among these mathematical tools, Machine Learning (ML) is regarded as one of the most promising methodological approaches to perform network-data analysis and enable automated network self-configuration and fault management. The adoption of ML techniques in the field of optical communication networks is motivated by the unprecedented growth of network complexity faced by optical networks in the last few years. Such complexity increase is due to the introduction of a huge number of adjustable and interdependent system parameters (e.g., routing configurations, modulation format, symbol rate, coding schemes, etc.) that are enabled by the usage of coherent transmission/reception technologies, advanced digital signal processing and compensation of nonlinear effects in optical fiber propagation. In this paper we provide an overview of the application of ML to optical communications and networking. We classify and survey relevant literature dealing with the topic, and we also provide an introductory tutorial on ML for researchers and practitioners interested in this field. Although a good number of research papers have recently appeared, the application of ML to optical networks is still in its infancy: to stimulate further work in this area, we conclude the paper proposing new possible research directions

Artificial intelligence (AI) methods in optical networks: A comprehensive survey

Producción CientíficaArtificial intelligence (AI) is an extensive scientific discipline which enables computer systems to solve problems by emulating complex biological processes such as learning, reasoning and self-correction. This paper presents a comprehensive review of the application of AI techniques for improving performance of optical communication systems and networks. The use of AI-based techniques is first studied in applications related to optical transmission, ranging from the characterization and operation of network components to performance monitoring, mitigation of nonlinearities, and quality of transmission estimation. Then, applications related to optical network control and management are also reviewed, including topics like optical network planning and operation in both transport and access networks. Finally, the paper also presents a summary of opportunities and challenges in optical networking where AI is expected to play a key role in the near future.Ministerio de Economía, Industria y Competitividad (Project EC2014-53071-C3-2-P, TEC2015-71932-REDT

Optical Networks and Interconnects

The rapid evolution of communication technologies such as 5G and beyond, rely on optical networks to support the challenging and ambitious requirements that include both capacity and reliability. This chapter begins by giving an overview of the evolution of optical access networks, focusing on Passive Optical Networks (PONs). The development of the different PON standards and requirements aiming at longer reach, higher client count and delivered bandwidth are presented. PON virtualization is also introduced as the flexibility enabler. Triggered by the increase of bandwidth supported by access and aggregation network segments, core networks have also evolved, as presented in the second part of the chapter. Scaling the physical infrastructure requires high investment and hence, operators are considering alternatives to optimize the use of the existing capacity. This chapter introduces different planning problems such as Routing and Spectrum Assignment problems, placement problems for regenerators and wavelength converters, and how to offer resilience to different failures. An overview of control and management is also provided. Moreover, motivated by the increasing importance of data storage and data processing, this chapter also addresses different aspects of optical data center interconnects. Data centers have become critical infrastructure to operate any service. They are also forced to take advantage of optical technology in order to keep up with the growing capacity demand and power consumption. This chapter gives an overview of different optical data center network architectures as well as some expected directions to improve the resource utilization and increase the network capacity

Enabling Technologies for Optical Data Center Networks: Spatial Division Multiplexing

With the continuously growing popularity of cloud services, the traffic volume inside the\ua0data\ua0centers is dramatically increasing. As a result, a scalable and efficient infrastructure\ua0for\ua0data\ua0center\ua0networks\ua0(DCNs) is required. The current\ua0optical\ua0DCNs using either individual fibers or fiber ribbons are costly, bulky, hard to manage, and not scalable.\ua0Spatial\ua0division\ua0multiplexing\ua0(SDM) based on multicore or multimode (few-mode) fibers is recognized as a promising technology to increase the\ua0spatial\ua0efficiency\ua0for\ua0optical\ua0DCNs, which opens a new way towards high capacity and scalability. This tutorial provides an overview of the components, transmission options, and interconnect architectures\ua0for\ua0SDM-based DCNs, as well as potential technical challenges and future directions. It also covers the co-existence of SDM and other\ua0multiplexing\ua0techniques, such as wavelength-division\ua0multiplexing\ua0and flexible spectrum\ua0multiplexing, in\ua0optical\ua0DCNs

Alocação de recursos em redes ópticas elásticas baseadas em multiplexação por divisão espacial

Orientador: Nelson Luis Saldanha da FonsecaDissertação (mestrado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: Tecnologias de redes ópticas baseadas em fibras mono-núcleo e mono-modo possuem limite de capacidade e não conseguem suprir a demanda crescente de largura de banda. Um forma de resolver esse problema se dá através do uso de multiplexação por divisão espacial (SDM - \textit{Space-Division Multiplexing}). A transmissão de dados em SDM ocorre através de múltiplos núcleos agrupados em um único filamento de fibra, ou utilizando múltiplos modos transversais suportados por um núcleo. A combinação da flexibilidade de redes ópticas elásticas (EON - \textit{Elastic Optical Networks}) e a alta capacidade do SDM é promissora para o futuro das redes ópticas. Na camada de enlace, quando uma nova solicitação para estabelecimento de conexão chega, é necessário fazer a reserva de recursos para realizar essa conexão. A determinação dos recursos a serem alocados é dada pela solução do problema de roteamento, alocação de núcleo e \textit{slots} (RCSA - \textit{Routing, Core and Spectrum Allocation}). Na alocação de recursos, algumas restrições devem ser respeitadas, tais como a contiguidade e continuidade dos \textit{slots} de frequência, e tolerância ao \textit{crosstalk} espacial. Estas restrições implicam em uma maior complexidade para a acomodação do tráfego das conexões. A virtualização de redes permite que redes virtuais compartilhem recursos físicos, simplificando o gerenciamento de recursos na camada óptica, oferecendo flexibilidade na alocação de recursos e segurança dos serviços. Um dos principais desafios da virtualização é configurar de forma eficiente as redes virtuais, que consiste na alocação de recursos físicos para acomodá-las. Esta tese propõe soluções para o problema do RCSA em redes SDM-EON. A primeira contribuição desta tese é um algoritmo que considera o equilíbrio entre eficiência energética e bloqueio de requisições. Propõe-se um algoritmo de agregação de tráfego em lote, capitalizando na flexibilidade temporal para satisfazer requisições com o objetivo de formar lotes de requisições, aumentando assim a probabilidade de serem atendidas as requisições em um outro momento. A segunda contribuição desta tese é direcionada para a solução do problema da fragmentação, que ocorre em cenários onde pequenos conjuntos de \textit{slots} disponíveis ficam espalhados no espectro, causando o bloqueio de novas requisição. Propõem-se um conjunto de algoritmos proativos e reativos. Os algoritmos proativos utilizam diferentes técnicas, tais como, múltiplos caminhos, priorização de núcleo e área, bem como métricas de avaliação da fragmentação na composição de caminhos. O algoritmo reativo utiliza aprendizagem de máquina para fazer um rearranjo espectral e aumentar a capacidade de prevenção da fragmentação no RCSA. A terceira contribuição desta tese é uma solução para aumentar a eficiência do compartilhamento de recursos em redes virtuais. Este problema consiste na configuração de enlaces e nós virtuais para caminhos e nós físicos, respectivamente. A solução proposta introduz uma arquitetura utilizando aprendizado de máquina, que age como um assistente no processo de configuração de redes virtuaisAbstract: Optical network technologies based on a single-core and single-mode fibers have a limited capacity and cannot provide enough resources to a constant increase of bandwidth demands. One approach to overcome this is the use of Space-Division Multiplexing (SDM) which relies on sending data through multiple cores embedded into a single strand of fiber or using multiple transverse modes supported by a core. The combination of the flexibility of Elastic Optical Networks (EONs) and the high capacity of SDM is a promising solution to cope with the bandwidth demands. At the network level, when a traffic request arrives, it needs to reserve network resources to establish it. One approach to accommodate traffic demand over optical networks is the Routing, Core and Spectrum Allocation (RCSA), in which end-to-end lightpaths are offered for each individual request. In these scenarios, during the allocation process, some constraints need to be respected, such as contiguity and continuity of slots (selected in the resource selection process), and spatial crosstalk. These constraints pose extra complexity to accommodate the requests for the lightpath establishment. As one of the possible solutions, network virtualization is capable of improving the efficiency of optical networks, by allowing virtual networks to share the resources of physical networks, simplifying the management of resource and providing flexibility in resource allocation. One of the main challenges of network virtualization is to configure a virtual network efficiently which comprises allocating physical resources to accommodate incoming virtual networks. This thesis proposes solutions to the RCSA problem and the virtual network configuration problem for SDM-EON networks. The first contribution of this thesis is an algorithm to promote an equilibrium between reduction of the network energy consumption and reduction of the blocking of requests. For this purpose, we introduce a traffic grooming algorithm using batches, which takes advantage of the deadline of each request to form batches, increasing the chances of the requests to be established at another time. The second contribution of this thesis is a set of algorithms using different techniques to handle the fragmentation problem, where a small portion of available slot sequences end up scattered in a fiber link, blocking future requests, called the fragmentation problem. For this purpose, we propose proactive and reactive algorithms. Proactive algorithms use different techniques, such as multipath routing, core, and area prioritization, and metrics to use in the route selection process. The reactive algorithm uses machine learning to rearrange the spectrum and tune the RCSA algorithm to prevent the fragmentation. The third contribution of this thesis proposes a solution to improve resource sharing in network virtualization. This problem consists in configuring virtual links and nodes to physical nodes and paths. For this purpose, we propose a learning assistant control loop to handle the virtual network configuration problemMestradoCiência da ComputaçãoMestra em Ciência da Computação131025/2017-1CNP

Enabling Technology in Optical Fiber Communications: From Device, System to Networking

This book explores the enabling technology in optical fiber communications. It focuses on the state-of-the-art advances from fundamental theories, devices, and subsystems to networking applications as well as future perspectives of optical fiber communications. The topics cover include integrated photonics, fiber optics, fiber and free-space optical communications, and optical networking

Design, monitoring and performance evaluation of high capacity optical networks

Premi Extraordinari de Doctorat, promoció 2018-2019. Àmbit de les TICInternet traffic is expected to keep increasing exponentially due to the emergence of a vast number of innovative online services and applications. Optical networks, which are the cornerstone of the underlying Internet infrastructure, have been continuously evolving to carry the ever-increasing traffic in a more flexible, cost-effective, and intelligent way. Having these three targets in mind, this PhD thesis focuses on two general areas for the performance improvement and the evolution of optical networks: i) introducing further cognition to the optical layer, and ii) introducing new networking solutions revolutionizing the optical transport infrastructure. In the first part, we present novel failure detection and identification solutions in the optical layer utilizing the optical spectrum traces captured by cost-effective coarse-granular Optical Spectrum Analyzers (OSA). We demonstrate the effectiveness of the developed solutions for detecting and identifying filter-related failures in the context of Spectrum-Switched Optical Networks (SSON), as well as transmitter-related laser failures in Filter-less Optical Networks (FON). In addition, at the subsystem level we propose an Autonomic Transmission Agent (ATA), which triggers local or remote transceiver reconfiguration by predicting Bit-Error-Rate (BER) degradation by monitoring State-of-Polarization (SOP) data obtained by coherent receivers. I have developed solutions to push further the performance of the currently deployed optical networks through reducing the margins and introducing intelligence to better manage their resources. However, it is expected that the spectral efficiency of the current standard Single-Mode Fiber (SMF) based optical network approaches the Shannon capacity limits in the near future, and therefore, a new paradigm is required to keep with the pace of the current huge traffic increase. In this regard, Space Division Multiplexing (SDM) is proposed as the ultimate solution to address the looming capacity crunch with a reduced cost-per-bit delivered to the end-users. I devote the second part of this thesis to investigate different flavors of SDM based optical networks with the aim of finding the best compromise for the realization of a spectrally and spatially flexible optical network. SDM-based optical networks can be deployed over various types of transmission media. Additionally, due to the extra dimension (i.e., space) introduced in SDM networks, optical switching nodes can support wavelength granularity, space granularity, or a combination of both. In this thesis, we evaluate the impact of various spectral and spatial switching granularities on the performance of SDM-based optical networks serving different profiles of traffic with the aim of understanding the impact of switching constraints on the overall network performance. In this regard, we consider two different generations of wavelength selective switches (WSS) to reflect the technology limitations on the performance of SDM networks. In addition, we present different designs of colorless direction-less, and Colorless Directionless Contention-less (CDC) Reconfigurable Optical Add/Drop Multiplexers (ROADM) realizing SDM switching schemes and compare their performance in terms of complexity and implementation cost. Furthermore, with the aim of revealing the benefits and drawbacks of SDM networks over different types of transmission media, we preset a QoT-aware network planning toolbox and perform comparative performance analysis among SDM network based on various types of transmission media. We also analyze the power consumption of Multiple-Input Multiple-Output (MIMO) Digital Signal Processing (DSP) units of transceivers operating over three different types of transmission media. The results obtained in the second part of the thesis provide a comprehensive outlook to different realizations of SDM-based optical networks and showcases the benefits and drawbacks of different SDM realizations.Se espera que el tráfico de Internet siga aumentando exponencialmente debido a la continua aparición de gran cantidad de aplicaciones innovadoras. Las redes ópticas, que son la piedra angular de la infraestructura de Internet, han evolucionado continuamente para transportar el tráfico cada vez mayor de una manera más flexible, rentable e inteligente. Teniendo en cuenta estos tres objetivos, esta tesis doctoral se centra en dos áreas cruciales para la mejora del rendimiento y la evolución de las redes ópticas: i) introducción de funcionalidades cognitivas en la capa óptica, y ii) introducción de nuevas estructuras de red que revolucionarán el transporte óptico. En la primera parte, se presentan soluciones novedosas de detección e identificación de fallos en la capa óptica que utilizan trazas de espectro óptico obtenidas mediante analizadores de espectros ópticos (OSA) de baja resolución (y por tanto de coste reducido). Se demuestra la efectividad de las soluciones desarrolladas para detectar e identificar fallos derivados del filtrado imperfecto en las redes ópticas de conmutación de espectro (SSON), así como fallos relacionados con el láser transmisor en redes ópticas sin filtro (FON). Además, a nivel de subsistema, se propone un Agente de Transmisión Autónomo (ATA), que activa la reconfiguración del transceptor local o remoto al predecir la degradación de la Tasa de Error por Bits (BER), monitorizando el Estado de Polarización (SOP) de la señal recibida en un receptor coherente. Se han desarrollado soluciones para incrementar el rendimiento de las redes ópticas mediante la reducción de los márgenes y la introducción de inteligencia en la administración de los recursos de la red. Sin embargo, se espera que la eficiencia espectral de las redes ópticas basadas en fibras monomodo (SMF) se acerque al límite de capacidad de Shannon en un futuro próximo, y por tanto, se requiere un nuevo paradigma que permita mantener el crecimiento necesario para soportar el futuro aumento del tráfico. En este sentido, se propone el Multiplexado por División Espacial (SDM) como la solución que permita la continua reducción del coste por bit transmitido ante ése esperado crecimiento del tráfico. En la segunda parte de esta tesis se investigan diferentes tipos de redes ópticas basadas en SDM con el objetivo de encontrar soluciones para la realización de redes ópticas espectral y espacialmente flexibles. Las redes ópticas basadas en SDM se pueden implementar utilizando diversos tipos de medios de transmisión. Además, debido a la dimensión adicional (el espacio) introducida en las redes SDM, los nodos de conmutación óptica pueden conmutar longitudes de onda, fibras o una combinación de ambas. Se evalúa el impacto de la conmutación espectral y espacial en el rendimiento de las redes SDM bajo diferentes perfiles de tráfico ofrecido, con el objetivo de comprender el impacto de las restricciones de conmutación en el rendimiento de la red. En este sentido, se consideran dos generaciones diferentes de conmutadores selectivos de longitud de onda (WSS) para reflejar las limitaciones de la tecnología en el rendimiento de las redes SDM. Además, se presentan diferentes diseños de ROADM, independientes de la longitud de onda, de la dirección, y sin contención (CDC) utilizados para la conmutación SDM, y se compara su rendimiento en términos de complejidad y coste. Además, con el objetivo de cuantificar los beneficios e inconvenientes de las redes SDM, se ha generado una herramienta de planificación de red que prevé la QoT usando diferentes tipos de fibras. También se analiza el consumo de energía de las unidades DSP de los transceptores MIMO operando en redes SDM con tres tipos diferentes de medios de transmisión. Los resultados obtenidos en esta segunda parte de la tesis proporcionan una perspectiva integral de las redes SDM y muestran los beneficios e inconvenientes de sus diferentes implementacionesAward-winningPostprint (published version

Optical Technologies and Control Methods for Scalable Data Centre Networks

Attributing to the increasing adoption of cloud services, video services and associated machine learning applications, the traffic demand inside data centers is increasing exponentially, which necessitates an innovated networking infrastructure with high scalability and cost-efficiency. As a promising candidate to provide high capacity, low latency, cost-effective and scalable interconnections, optical technologies have been introduced to data center networks (DCNs) for approximately a decade. To further improve the DCN performance to meet the increasing traffic demand by using photonic technologies, two current trends are a)increasing the bandwidth density of the transmission links and b) maximizing IT and network resources utilization through disaggregated topologies and architectures. Therefore, this PhD thesis focuses on introducing and applying advanced and efficient technologies in these two fields to DCNs to improve their performance. On the one hand, at the link level, since the traditional single-mode fiber (SMF) solutions based on wavelength division multiplexing (WDM) over C+L band may fall short in satisfying the capacity, front panel density, power consumption, and cost requirements of high-performance DCNs, a space division multiplexing (SDM) based DCN using homogeneous multi-core fibers (MCFs) is proposed.With the exploited bi-directional model and proposed spectrum allocation algorithms, the proposed DCN shows great benefits over the SMF solution in terms of network capacity and spatial efficiency. In the meanwhile, it is found that the inter-core crosstalk (IC-XT) between the adjacent cores inside the MCF is dynamic rather than static, therefore, the behaviour of the IC-XT is experimentally investigated under different transmission conditions. On the other hand, an optically disaggregated DCN is developed and to ensure the performance of it, different architectures, topologies, resource routing and allocation algorithms are proposed and compared. Compared to the traditional server-based DCN, the resource utilization, scalability and the cost-efficiency are significantly improved