A Survey on Data Plane Programming with P4: Fundamentals, Advances, and Applied Research

With traditional networking, users can configure control plane protocols to match the specific network configuration, but without the ability to fundamentally change the underlying algorithms. With SDN, the users may provide their own control plane, that can control network devices through their data plane APIs. Programmable data planes allow users to define their own data plane algorithms for network devices including appropriate data plane APIs which may be leveraged by user-defined SDN control. Thus, programmable data planes and SDN offer great flexibility for network customization, be it for specialized, commercial appliances, e.g., in 5G or data center networks, or for rapid prototyping in industrial and academic research. Programming protocol-independent packet processors (P4) has emerged as the currently most widespread abstraction, programming language, and concept for data plane programming. It is developed and standardized by an open community and it is supported by various software and hardware platforms. In this paper, we survey the literature from 2015 to 2020 on data plane programming with P4. Our survey covers 497 references of which 367 are scientific publications. We organize our work into two parts. In the first part, we give an overview of data plane programming models, the programming language, architectures, compilers, targets, and data plane APIs. We also consider research efforts to advance P4 technology. In the second part, we analyze a large body of literature considering P4-based applied research. We categorize 241 research papers into different application domains, summarize their contributions, and extract prototypes, target platforms, and source code availability.Comment: Submitted to IEEE Communications Surveys and Tutorials (COMS) on 2021-01-2

High Performance Silicon Photonic Interconnected Systems

Advances in data-driven applications, particularly artificial intelligence and deep learning, are driving the explosive growth of computation and communication in today’s data centers and high-performance computing (HPC) systems. Increasingly, system performance is not constrained by the compute speed at individual nodes, but by the data movement between them. This calls for innovative architectures, smart connectivity, and extreme bandwidth densities in interconnect designs. Silicon photonics technology leverages mature complementary metal-oxide-semiconductor (CMOS) manufacturing infrastructure and is promising for low cost, high-bandwidth, and reconfigurable interconnects. Flexible and high-performance photonic switched architectures are capable of improving the system performance. The work in this dissertation explores various photonic interconnected systems and the associated optical switching functionalities, hardware platforms, and novel architectures. It demonstrates the capabilities of silicon photonics to enable efficient deep learning training. We first present field programmable gate array (FPGA) based open-loop and closed-loop control for optical spectral-and-spatial switching of silicon photonic cascaded micro-ring resonator (MRR) switches. Our control achieves wavelength locking at the user-defined resonance of the MRR for optical unicast, multicast, and multiwavelength-select functionalities. Digital-to-analog converters (DACs) and analog-to-digital converters (ADCs) are necessary for the control of the switch. We experimentally demonstrate the optical switching functionalities using an FPGA-based switch controller through both traditional multi-bit DAC/ADC and novel single-wired DAC/ADC circuits. For system-level integration, interfaces to the switch controller in a network control plane are developed. The successful control and the switching functionalitiesachieved are essential for system-level architectural innovations as presented in the following sections. Next, this thesis presents two novel photonic switched architectures using the MRR-based switches. First, a photonic switched memory system architecture was designed to address memory challenges in deep learning. The reconfigurable photonic interconnects provide scalable solutions and enable efficient use of disaggregated memory resources for deep learning training. An experimental testbed was built with a processing system and two remote memory nodes using silicon photonic switch fabrics and system performance improvements were demonstrated. The collective results and existing high-bandwidth optical I/Os show the potential of integrating the photonic switched memory to state-of-the-art processing systems. Second, the scaling trends of deep learning models and distributed training workloads are challenging network capacities in today’s data centers and HPCs. A system architecture that leverages SiP switch-enabled server regrouping is proposed to tackle the challenges and accelerate distributed deep learning training. An experimental testbed with a SiP switch-enabled reconfigurable fat tree topology was built to evaluate the network performance of distributed ring all-reduce and parameter server workloads. We also present system-scale simulations. Server regrouping and bandwidth steering were performed on a large-scale tapered fat tree with 1024 compute nodes to show the benefits of using photonic switched architectures in systems at scale. Finally, this dissertation explores high-bandwidth photonic interconnect designs for disaggregated systems. We first introduce and discuss two disaggregated architectures leveraging extreme high bandwidth interconnects with optically interconnected computing resources. We present the concept of rack-scale graphics processing unit (GPU) disaggregation with optical circuit switches and electrical aggregator switches. The architecture can leverage the flexibility of high bandwidth optical switches to increase hardware utilization and reduce application runtimes. A testbed was built to demonstrate resource disaggregation and defragmentation. In addition, we also present an extreme high-bandwidth optical interconnect accelerated low-latency communication architecture for deep learning training. The disaggregated architecture utilizes comb laser sources and MRR-based cross-bar switching fabrics to enable an all-to-all high bandwidth communication with a constant latency cost for distributed deep learning training. We discuss emerging technologies in the silicon photonics platform, including light source, transceivers, and switch architectures, to accommodate extreme high bandwidth requirements in HPC and data center environments. A prototype hardware innovation - Optical Network Interface Cards (comprised of FPGA, photonic integrated circuits (PIC), electronic integrated circuits (EIC), interposer, and high-speed printed circuit board (PCB)) is presented to show the path toward fast lanes for expedited execution at 10 terabits. Taken together, the work in this dissertation demonstrates the capabilities of high-bandwidth silicon photonic interconnects and innovative architectural designs to accelerate deep learning training in optically connected data center and HPC systems

The Road to BOFUSS: The Basic OpenFlow User-space Software Switch

Software switches are pivotal in the Software-Defined Networking (SDN) paradigm, particularly in the early phases of development, deployment and testing. Currently, the most popular one is Open vSwitch (OVS), leveraged in many production-based environments. However, due to its kernel-based nature, OVS is typically complex to modify when additional features or adaptation is required. To this regard, a simpler user-space is key to perform these modifications. In this article, we present a rich overview of BOFUSS, the basic OpenFlow user-space software switch. BOFUSS has been widely used in the research community for diverse reasons, but it lacked a proper reference document. For this purpose, we describe the switch, its history, architecture, uses cases and evaluation, together with a survey of works that leverage this switch. The main goal is to provide a comprehensive overview of the switch and its characteristics. Although the original BOFUSS is not expected to surpass the high performance of OVS, it is a useful complementary artifact that provides some OpenFlow features missing in OVS and it can be easily modified for extended functionality. Moreover, enhancements provided by the BEBA project brought the performance from BOFUSS close to OVS. In any case, this paper sheds light to researchers looking for the trade-offs between performance and customization of BOFUSS.Comment: 24 pages, 7 figures; submitted to Telecommunications Systems journa

Otimização de distribuição de conteúdos multimédia utilizando software-defined networking

The general use of Internet access and user equipments, such as smartphones, tablets and personal computers, is creating a new wave of video content consumption. In the past two decades, the Television broadcasting industry went through several evolutions and changes, evolving from analog to digital distribution, standard definition to high definition TV-channels, form the IPTV method of distribution to the latest set of technologies in content distribution, OTT. The IPTV technology introduced features that changed the passive role of the client to an active one, revolutionizing the way users consume TV content. Thus, the clients’ habits started to shape the services offered, leading to an anywhere and anytime offer of video content. OTT video delivery is a reflection of those habits, meeting the users’ desire, introducing several benefits discussed in this work over the previous technologies. However, the OTT type of delivery poses several challenges in terms of scalability and threatens the Telecommunications Operators business model, because OTT companies use the Telcos infrastructure for free. Consequently, Telecommunications Operators must prepare their infrastructure for future demand while offering new services to stay competitive. This dissertation aims to contribute with insights on what infrastructure changes a Telecommunications Operator must perform with a proposed bandwidth forecasting model. The results obtained from the forecast model paved the way to the proposed video content delivery method, which aims to improve users’ perceived Quality-of-Experience while optimizing load balancing decisions. The overall results show an improvement of users’ experience using the proposed method.A generalização do acesso à Internet e equipamentos pessoais como smartphones, tablets e computadores pessoais, está a criar uma nova onda de consumo de conteúdos multimedia. Nas ultimas duas décadas, a indústria de transmissão de Televisão atravessou várias evoluções e alterações, evoluindo da distribuição analógica para a digital, de canais de Televisão de definição padrão para alta definição, do método de distribuição IPTV, até ao último conjunto de tecnologias na distribuição de conteúdos, OTT. A tecnologia IPTV introduziu novas funcionalidades que mudaram o papel passivo do cliente para um papel activo, revolucionando a forma como os utilizadores consumem conteúdos televisivos. Assim, os hábitos dos clientes começaram a moldar os serviços oferecidos, levando à oferta de consumo de conteúdos em qualquer lugar e em qualquer altura. A entrega de vídeo OTT é um reflexo destes hábitos, indo ao encontro dos desejos dos utilizadores, que introduz inúmeras vantagens sobre outras tecnologias discutidas neste trabalho. No entanto, a entrega de conteúdos OTT cria diversos problemas de escalabilidade e ameaça o modelo de negócio das Operadoras de Telecomunicações, porque os fornecedores de serviço OTT usam a infraestrutura das mesmas sem quaisquer custos. Consequentemente, os Operadores de Telecomunicações devem preparar a sua infraestrutura para o consumo futuro ao mesmo tempo que oferecem novos serviços para se manterem competitivos. Esta dissertação visa contribuir com conhecimento sobre quais alterações uma Operadora de Telecomunicações deve executar com o modelo de previsão de largura de banda proposto. Os resultados obtidos abriram caminho para o método de entrega de conteúdos multimedia proposto, que visa ao melhoramento da qualidade de experiência do utilizador ao mesmo tempo que se optimiza o processo de balanceamento de carga. No geral os testes confirmam uma melhoria na qualidade de experiência do utilizador usando o método proposto.Mestrado em Engenharia de Computadores e Telemátic

The road to BOFUSS: The basic OpenFlow userspace software switch

Software switches are pivotal in the Software-Defined Networking (SDN) paradigm, particularly in the early phases of development, deployment and testing. Currently, the most popular one is Open vSwitch (OVS), leveraged in many production-based environments. However, due to its kernel-based nature, OVS is typically complex to modify when additional features or adaptation is required. To this regard, a simpler user-space is key to perform these modifications. In this article, we present a rich overview of BOFUSS, the basic OpenFlow user-space software switch. BOFUSS has been widely used in the research community for diverse reasons, but it lacked a proper reference document. For this purpose, we describe the switch, its history, architecture, uses cases and evaluation, together with a survey of works that leverage this switch. The main goal is to provide a comprehensive overview of the switch and its characteristics. Although the original BOFUSS is not expected to surpass the high performance of OVS, it is a useful complementary artefact that provides some OpenFlow features missing in OVS and it can be easily modified for extended functionality. Moreover, enhancements provided by the BEBA project brought the performance from BOFUSS close to OVS. In any case, this paper sheds light to researchers looking for the trade-offs between performance and customization of BOFUSS

Resilient and Scalable Forwarding for Software-Defined Networks with P4-Programmable Switches

Traditional networking devices support only fixed features and limited configurability. Network softwarization leverages programmable software and hardware platforms to remove those limitations. In this context the concept of programmable data planes allows directly to program the packet processing pipeline of networking devices and create custom control plane algorithms. This flexibility enables the design of novel networking mechanisms where the status quo struggles to meet high demands of next-generation networks like 5G, Internet of Things, cloud computing, and industry 4.0. P4 is the most popular technology to implement programmable data planes. However, programmable data planes, and in particular, the P4 technology, emerged only recently. Thus, P4 support for some well-established networking concepts is still lacking and several issues remain unsolved due to the different characteristics of programmable data planes in comparison to traditional networking. The research of this thesis focuses on two open issues of programmable data planes. First, it develops resilient and efficient forwarding mechanisms for the P4 data plane as there are no satisfying state of the art best practices yet. Second, it enables BIER in high-performance P4 data planes. BIER is a novel, scalable, and efficient transport mechanism for IP multicast traffic which has only very limited support of high-performance forwarding platforms yet. The main results of this thesis are published as 8 peer-reviewed and one post-publication peer-reviewed publication. The results cover the development of suitable resilience mechanisms for P4 data planes, the development and implementation of resilient BIER forwarding in P4, and the extensive evaluations of all developed and implemented mechanisms. Furthermore, the results contain a comprehensive P4 literature study. Two more peer-reviewed papers contain additional content that is not directly related to the main results. They implement congestion avoidance mechanisms in P4 and develop a scheduling concept to find cost-optimized load schedules based on day-ahead forecasts

Design, monitoring and performance evaluation of high capacity optical networks

Premi Extraordinari de Doctorat, promoció 2018-2019. Àmbit de les TICInternet traffic is expected to keep increasing exponentially due to the emergence of a vast number of innovative online services and applications. Optical networks, which are the cornerstone of the underlying Internet infrastructure, have been continuously evolving to carry the ever-increasing traffic in a more flexible, cost-effective, and intelligent way. Having these three targets in mind, this PhD thesis focuses on two general areas for the performance improvement and the evolution of optical networks: i) introducing further cognition to the optical layer, and ii) introducing new networking solutions revolutionizing the optical transport infrastructure. In the first part, we present novel failure detection and identification solutions in the optical layer utilizing the optical spectrum traces captured by cost-effective coarse-granular Optical Spectrum Analyzers (OSA). We demonstrate the effectiveness of the developed solutions for detecting and identifying filter-related failures in the context of Spectrum-Switched Optical Networks (SSON), as well as transmitter-related laser failures in Filter-less Optical Networks (FON). In addition, at the subsystem level we propose an Autonomic Transmission Agent (ATA), which triggers local or remote transceiver reconfiguration by predicting Bit-Error-Rate (BER) degradation by monitoring State-of-Polarization (SOP) data obtained by coherent receivers. I have developed solutions to push further the performance of the currently deployed optical networks through reducing the margins and introducing intelligence to better manage their resources. However, it is expected that the spectral efficiency of the current standard Single-Mode Fiber (SMF) based optical network approaches the Shannon capacity limits in the near future, and therefore, a new paradigm is required to keep with the pace of the current huge traffic increase. In this regard, Space Division Multiplexing (SDM) is proposed as the ultimate solution to address the looming capacity crunch with a reduced cost-per-bit delivered to the end-users. I devote the second part of this thesis to investigate different flavors of SDM based optical networks with the aim of finding the best compromise for the realization of a spectrally and spatially flexible optical network. SDM-based optical networks can be deployed over various types of transmission media. Additionally, due to the extra dimension (i.e., space) introduced in SDM networks, optical switching nodes can support wavelength granularity, space granularity, or a combination of both. In this thesis, we evaluate the impact of various spectral and spatial switching granularities on the performance of SDM-based optical networks serving different profiles of traffic with the aim of understanding the impact of switching constraints on the overall network performance. In this regard, we consider two different generations of wavelength selective switches (WSS) to reflect the technology limitations on the performance of SDM networks. In addition, we present different designs of colorless direction-less, and Colorless Directionless Contention-less (CDC) Reconfigurable Optical Add/Drop Multiplexers (ROADM) realizing SDM switching schemes and compare their performance in terms of complexity and implementation cost. Furthermore, with the aim of revealing the benefits and drawbacks of SDM networks over different types of transmission media, we preset a QoT-aware network planning toolbox and perform comparative performance analysis among SDM network based on various types of transmission media. We also analyze the power consumption of Multiple-Input Multiple-Output (MIMO) Digital Signal Processing (DSP) units of transceivers operating over three different types of transmission media. The results obtained in the second part of the thesis provide a comprehensive outlook to different realizations of SDM-based optical networks and showcases the benefits and drawbacks of different SDM realizations.Se espera que el tráfico de Internet siga aumentando exponencialmente debido a la continua aparición de gran cantidad de aplicaciones innovadoras. Las redes ópticas, que son la piedra angular de la infraestructura de Internet, han evolucionado continuamente para transportar el tráfico cada vez mayor de una manera más flexible, rentable e inteligente. Teniendo en cuenta estos tres objetivos, esta tesis doctoral se centra en dos áreas cruciales para la mejora del rendimiento y la evolución de las redes ópticas: i) introducción de funcionalidades cognitivas en la capa óptica, y ii) introducción de nuevas estructuras de red que revolucionarán el transporte óptico. En la primera parte, se presentan soluciones novedosas de detección e identificación de fallos en la capa óptica que utilizan trazas de espectro óptico obtenidas mediante analizadores de espectros ópticos (OSA) de baja resolución (y por tanto de coste reducido). Se demuestra la efectividad de las soluciones desarrolladas para detectar e identificar fallos derivados del filtrado imperfecto en las redes ópticas de conmutación de espectro (SSON), así como fallos relacionados con el láser transmisor en redes ópticas sin filtro (FON). Además, a nivel de subsistema, se propone un Agente de Transmisión Autónomo (ATA), que activa la reconfiguración del transceptor local o remoto al predecir la degradación de la Tasa de Error por Bits (BER), monitorizando el Estado de Polarización (SOP) de la señal recibida en un receptor coherente. Se han desarrollado soluciones para incrementar el rendimiento de las redes ópticas mediante la reducción de los márgenes y la introducción de inteligencia en la administración de los recursos de la red. Sin embargo, se espera que la eficiencia espectral de las redes ópticas basadas en fibras monomodo (SMF) se acerque al límite de capacidad de Shannon en un futuro próximo, y por tanto, se requiere un nuevo paradigma que permita mantener el crecimiento necesario para soportar el futuro aumento del tráfico. En este sentido, se propone el Multiplexado por División Espacial (SDM) como la solución que permita la continua reducción del coste por bit transmitido ante ése esperado crecimiento del tráfico. En la segunda parte de esta tesis se investigan diferentes tipos de redes ópticas basadas en SDM con el objetivo de encontrar soluciones para la realización de redes ópticas espectral y espacialmente flexibles. Las redes ópticas basadas en SDM se pueden implementar utilizando diversos tipos de medios de transmisión. Además, debido a la dimensión adicional (el espacio) introducida en las redes SDM, los nodos de conmutación óptica pueden conmutar longitudes de onda, fibras o una combinación de ambas. Se evalúa el impacto de la conmutación espectral y espacial en el rendimiento de las redes SDM bajo diferentes perfiles de tráfico ofrecido, con el objetivo de comprender el impacto de las restricciones de conmutación en el rendimiento de la red. En este sentido, se consideran dos generaciones diferentes de conmutadores selectivos de longitud de onda (WSS) para reflejar las limitaciones de la tecnología en el rendimiento de las redes SDM. Además, se presentan diferentes diseños de ROADM, independientes de la longitud de onda, de la dirección, y sin contención (CDC) utilizados para la conmutación SDM, y se compara su rendimiento en términos de complejidad y coste. Además, con el objetivo de cuantificar los beneficios e inconvenientes de las redes SDM, se ha generado una herramienta de planificación de red que prevé la QoT usando diferentes tipos de fibras. También se analiza el consumo de energía de las unidades DSP de los transceptores MIMO operando en redes SDM con tres tipos diferentes de medios de transmisión. Los resultados obtenidos en esta segunda parte de la tesis proporcionan una perspectiva integral de las redes SDM y muestran los beneficios e inconvenientes de sus diferentes implementacionesAward-winningPostprint (published version