Collaborative learning in multi-domain optical networks

This paper presents a collaborative learning framework for multi-domain optical networks to enable cognitive end-to-end networking while guaranteeing the autonomy of each administrative domain

Performance studies of evolutionary transfer learning for end-to-end QoT estimation in multi-domain optical networks [Invited]

This paper proposes an evolutionary transfer learning approach (Evol-TL) for scalable quality-of-transmission (QoT) estimation in multi-domain elastic optical networks (MD-EONs). Evol-TL exploits a broker-based MD-EON architecture that enables cooperative learning between the broker plane (end-to-end) and domain-level (local) machine learning functions while securing the autonomy of each domain. We designed a genetic algorithm to optimize the neural network architectures and the sets of weights to be transferred between the source and destination tasks. We evaluated the performance of Evol-TL with three case studies considering the QoT estimation task for lightpaths with (i) different path lengths (in terms of the numbers of fiber links traversed), (ii) different modulation formats, and (iii) different device conditions (emulated by introducing different levels of wavelength-specific attenuation to the amplifiers). The results show that the proposed approach can reduce the average amount of required training data by up to 13× while achieving an estimation accuracy above 95%

Machine-Learning-Aided Bandwidth and Topology Reconfiguration for Optical Data Center Networks

We present an overview of the application of machine learning for traffic engineering and network optimization in optical data center networks. In particular, we discuss the application of supervised and unsupervised learning for bandwidth and topology reconfiguration

Multi-Cluster Reconfiguration with Traffic Prediction in Hyper-Flex-LION Architecture

We study the performance of Hyper-Flex-LION optical interconnect architecture under dynamic traffic with traffic-prediction-aided multi-cluster reconfiguration. The simulation results show a 17.2% latency improvement and 36.9% packet loss reduction as compared to a fixed topology

Machine-Learning-Aided Dynamic Reconfiguration in Optical DC/HPC Networks (Invited)

The high bandwidth and low latency requirements of modern computing applications with their dynamic and nonuniform traffic patterns impose severe challenges to current data center (DC) and high performance computing (HPC) networks. Therefore, we present a dynamic network reconfiguration mechanism that could satisfy the time-varying applications' demands in an optical DC/HPC network. We propose a direct and an indirect topology extraction methods based on a machine learning-Aided traffic prediction approach under multi-Application scenario. The traffic prediction for topology extraction and bandwidth reconfiguration (PredicTER) method could lead to frequent topology and bandwidth reconfiguration. In contrast, the indirect approach, namely traffic prediction with clustering for topology extraction and bandwidth reconfiguration (PrediCLUSTER), utilizes an unsupervised learning-based clustering model to first associate the predicted traffic to one of possible traffic clusters, and then extracts a common topology for the cluster. This restricts the reconfigured topology set to the number of traffic clusters. Our simulation results show that the time-Average of mean packet latencies (and total dropped packets) over 60 seconds of timevarying traffic under the PredicTER, PrediCLUSTER and a static topology are 37.7μs,41.2μs, and 50.2μs (and 37,967, 12,305, and 36,836), respectively. Overall, the PredicTER (and PrediCLUSTER) method(s) can improve the end-To-end packet latency by 24.9% (and 17.8%), and the packet loss rate by-3.1% (and 66.6%), as compared to the static flat Hyper-X-like topology

On Cooperative Fault Management in Multi-Domain Optical Networks Using Hybrid Learning

This paper presents a hybrid learning approach for cooperative fault management in multi-domain optical networks (MD-ONs). The proposed approach relies on a broker-based MD-ON architecture for coordination of inter-domain service provisioning. We first propose a self-supervised learning design for soft failure detection. The self-supervised learning design makes use of a clustering algorithm for extracting normal and abnormal patterns from optical performance monitoring data and a supervised learning-based classifier trained with the learned patterns for online detection. To facilitate high soft failure detection accuracy in the absence of sufficient abnormal data for training, the proposed design estimates model uncertainties during predictions and identifies instances associated with high uncertainties as also soft failures. Then, we extend the self-supervised learning design and present a federated learning framework for the broker plane and DMs to learn cooperatively while complying with the privacy constraints of each domain. Finally, a data-driven soft failure localization scheme that operates by analyzing the patterns of data is proposed as a complement to the existing approaches. Performance evaluations indicate that the self-supervised learning design can achieve soft failure detection accuracy of up to ∼ 97% with 0.01%-0.04% false alarm rate, while federated learning enables DMs to realize >90% soft failure detection rates in the cases of highly unbalanced data distribution (two of the three domains possess zero abnormal data for training)

Reconfigurable Optical Datacom Networks by Self-supervised Learning

This paper presents a self-supervised machine learning approach for cognitive reconfiguration in a Hyper-X-like flexible-bandwidth optical interconnect architecture. The proposed approach makes use of a clustering algorithm to learn the traffic patterns from historical traces. A heuristic algorithm is developed for optimizing the connectivity graph for each identified traffic pattern. Further, to mitigate the scalability issue induced by frequent clustering operations, we parameterize the learned traffic patterns by a deep neural network classifier. The classifier is trained offline by supervised learning to enable classification of traffic matrices during online operations, thereby facilitating cognitive reconfiguration decision making. Simulation results show that compared with a static all-to-all interconnection, the proposed approach can improve throughput by up to 1.76× while reducing end-to-end packet latency and flow completion time by up to 2.8× and 25×, respectively

When Task Scheduling Meets Flexible-bandwidth Optical Interconnects: A Cross-layer Resource Orchestration Design

We propose a cross-layer resource orchestration design for task scheduling in flexible-bandwidth optical data center networks. Results show the proposed design can achieve 8.2 ×, 1.9 × and 4.8 × reductions of request blocking probability, end-to-end delay and packet loss rate, compared with the baseline

Cooperative Learning for Disaggregated Delay Modeling in Multidomain Networks

Accurate delay estimation is one of the enablers of future network connectivity services, as it facilitates the application layer to anticipate network performance. If such connectivity services require isolation (slicing), such delay estimation should not be limited to a maximum value defined in the Service Level Agreement, but to a finer-grained description of the expected delay in the form of, e.g., a continuous function of the load. Obtaining accurate end-to-end (e2e) delay modeling is even more challenging in a multi-operator (Multi-AS) scenario, where the provisioning of e2e connectivity services is provided across heterogeneous multi-operator (Multi-AS or just domains) networks. In this work, we propose a collaborative environment, where each domain Software Defined Networking (SDN) controller models intra-domain delay components of inter-domain paths and share those models with a broker system providing the e2e connectivity services. The broker, in turn, models the delay of inter-domain links based on e2e monitoring and the received intra-domain models. Exhaustive simulation results show that composing e2e models as the summation of intra-domain network and inter-domain link delay models provides many benefits and increasing performance over the models obtained from e2e measurements

The Use of Surveillance Cameras for the Rapid Mapping of Lava Flows: An Application to Mount Etna Volcano

In order to improve the observation capability in one of the most active volcanic areas in the world, Mt. Etna, we developed a processing method to use the surveillance cameras for a quasi real-time mapping of syn-eruptive processes. Following an evaluation of the current performance of the Etna permanent ground NEtwork of Thermal and Visible Sensors (Etna_NETVIS), its possible implementation and optimization was investigated to determine the locations of additional observation sites to be rapidly set up during emergencies. A tool was then devised to process time series of ground-acquired images and extract a coherent multi-temporal dataset of georeferenced map. The processed datasets can be used to extract 2D features such as evolution maps of active lava flows. The tool was validated on ad-hoc test fields and then adopted to map the evolution of two recent lava flows. The achievable accuracy (about three times the original pixel size) and the short processing time makes the tool suitable for rapidly assessing lava flow evolutions, especially in the case of recurrent eruptions, such as those of the 2011–2015 Etna activity. The tool can be used both in standard monitoring activities and during emergency phases (eventually improving the present network with additional mobile stations) when it is mandatory to carry out a quasi-real-time mapping to support civil protection actions. The developed tool could be integrated in the control room of the Osservatorio Etneo, thus enabling the Etna_NETVIS for mapping purposes and not only for video surveillance.Published1925V. Sorveglianza vulcanica ed emergenzeJCR Journalope