Contribution à l'amélioration de l'efficacité des réseaux IP sur WDM en évaluant et en dépassant les limites du dimensionnement multicouche

The traffic passing through core networks grows by nearly 25% each year. To bring the costs under control, the different network layers of the network should work together to include more and more parameters during the network planning phase. This is called “multilayer network planning”. We study the multilayer network planning of static networks composed of two circuit switched layers (typically IP-over-WDM). We propose a semi-analytical model explaining the behavior of algorithms responsible for aggregation and routing in both layers. This theory allows comparing multilayer planning algorithms between them, but also explaining and enhancing their efficiency. We then describe the impact of the optical reach constraint in WDM networks on the results of a multilayer planning algorithm. Finally, we explain how these results apply to the design of future networks (dynamic and with heterogeneous optical layers)La quantité de données devant être transportée via les réseaux de cœur croit de près de 25% par an. Pour maîtriser les coûts, les différentes couches du réseau doivent mettre des informations en commun pour inclure de plus en plus de paramètres lors du dimensionnement du réseau. Cela s’appelle « dimensionnement multicouche ». Nous étudions le dimensionnement multicouche de réseaux statiques composés de deux couches utilisant la commutation en mode circuit (typiquement IP-sur-WDM). Nous proposons un modèle semi-analytique expliquant le comportement des algorithmes responsables de l’agrégation et du routage dans les deux couches. Ce cadre théorique permet de comparer les algorithmes de dimensionnement multicouche entre eux, mais aussi d’expliquer et d’améliorer leur efficience. Nous décrivons ensuite comment la contrainte de portée optique affecte les résultats d’un algorithme de dimensionnement multicouche. Enfin, nous expliquons comment ces résultats s'appliquent au dimensionnement des réseaux de nouvelle génération (dynamiques et hétérogènes en capacité optique

Design and provisioning of WDM networks for traffic grooming

Wavelength Division Multiplexing (WDM) is the most viable technique for utilizing the enormous amounts of bandwidth inherently available in optical fibers. However, the bandwidth offered by a single wavelength in WDM networks is on the order of tens of Gigabits per second, while most of the applications\u27 bandwidth requirements are still subwavelength. Therefore, cost-effective design and provisioning of WDM networks require that traffic from different sessions share bandwidth of a single wavelength by employing electronic multiplexing at higher layers. This is known as traffic grooming. Optical networks supporting traffic grooming are usually designed in a way such that the cost of the higher layer equipment used to support a given traffic matrix is reduced. In this thesis, we propose a number of optimal and heuristic solutions for the design and provisioning of optical networks for traffic grooming with an objective of network cost reduction. In doing so, we address several practical issues. Specifically, we address the design and provisioning of WDM networks on unidirectional and bidirectional rings for arbitrary unicast traffic grooming, and on mesh topologies for arbitrary multipoint traffic grooming. In multipoint traffic grooming, we address both multicast and many-to-one traffic grooming problems. We provide a unified frame work for optimal and approximate network dimensioning and channel provisioning for the generic multicast traffic grooming problem, as well as some variants of the problem. For many-to-one traffic grooming we propose optimal as well as heuristic solutions. Optimal formulations which are inherently non-linear are mapped to an optimal linear formulation. In the heuristic solutions, we employ different problem specific search strategies to explore the solution space. We provide a number of experimental results to show the efficacy of our proposed techniques for the traffic grooming problem in WDM networks

Alocação de recursos em redes ópticas elásticas baseadas em multiplexação por divisão espacial

Orientador: Nelson Luis Saldanha da FonsecaDissertação (mestrado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: Tecnologias de redes ópticas baseadas em fibras mono-núcleo e mono-modo possuem limite de capacidade e não conseguem suprir a demanda crescente de largura de banda. Um forma de resolver esse problema se dá através do uso de multiplexação por divisão espacial (SDM - \textit{Space-Division Multiplexing}). A transmissão de dados em SDM ocorre através de múltiplos núcleos agrupados em um único filamento de fibra, ou utilizando múltiplos modos transversais suportados por um núcleo. A combinação da flexibilidade de redes ópticas elásticas (EON - \textit{Elastic Optical Networks}) e a alta capacidade do SDM é promissora para o futuro das redes ópticas. Na camada de enlace, quando uma nova solicitação para estabelecimento de conexão chega, é necessário fazer a reserva de recursos para realizar essa conexão. A determinação dos recursos a serem alocados é dada pela solução do problema de roteamento, alocação de núcleo e \textit{slots} (RCSA - \textit{Routing, Core and Spectrum Allocation}). Na alocação de recursos, algumas restrições devem ser respeitadas, tais como a contiguidade e continuidade dos \textit{slots} de frequência, e tolerância ao \textit{crosstalk} espacial. Estas restrições implicam em uma maior complexidade para a acomodação do tráfego das conexões. A virtualização de redes permite que redes virtuais compartilhem recursos físicos, simplificando o gerenciamento de recursos na camada óptica, oferecendo flexibilidade na alocação de recursos e segurança dos serviços. Um dos principais desafios da virtualização é configurar de forma eficiente as redes virtuais, que consiste na alocação de recursos físicos para acomodá-las. Esta tese propõe soluções para o problema do RCSA em redes SDM-EON. A primeira contribuição desta tese é um algoritmo que considera o equilíbrio entre eficiência energética e bloqueio de requisições. Propõe-se um algoritmo de agregação de tráfego em lote, capitalizando na flexibilidade temporal para satisfazer requisições com o objetivo de formar lotes de requisições, aumentando assim a probabilidade de serem atendidas as requisições em um outro momento. A segunda contribuição desta tese é direcionada para a solução do problema da fragmentação, que ocorre em cenários onde pequenos conjuntos de \textit{slots} disponíveis ficam espalhados no espectro, causando o bloqueio de novas requisição. Propõem-se um conjunto de algoritmos proativos e reativos. Os algoritmos proativos utilizam diferentes técnicas, tais como, múltiplos caminhos, priorização de núcleo e área, bem como métricas de avaliação da fragmentação na composição de caminhos. O algoritmo reativo utiliza aprendizagem de máquina para fazer um rearranjo espectral e aumentar a capacidade de prevenção da fragmentação no RCSA. A terceira contribuição desta tese é uma solução para aumentar a eficiência do compartilhamento de recursos em redes virtuais. Este problema consiste na configuração de enlaces e nós virtuais para caminhos e nós físicos, respectivamente. A solução proposta introduz uma arquitetura utilizando aprendizado de máquina, que age como um assistente no processo de configuração de redes virtuaisAbstract: Optical network technologies based on a single-core and single-mode fibers have a limited capacity and cannot provide enough resources to a constant increase of bandwidth demands. One approach to overcome this is the use of Space-Division Multiplexing (SDM) which relies on sending data through multiple cores embedded into a single strand of fiber or using multiple transverse modes supported by a core. The combination of the flexibility of Elastic Optical Networks (EONs) and the high capacity of SDM is a promising solution to cope with the bandwidth demands. At the network level, when a traffic request arrives, it needs to reserve network resources to establish it. One approach to accommodate traffic demand over optical networks is the Routing, Core and Spectrum Allocation (RCSA), in which end-to-end lightpaths are offered for each individual request. In these scenarios, during the allocation process, some constraints need to be respected, such as contiguity and continuity of slots (selected in the resource selection process), and spatial crosstalk. These constraints pose extra complexity to accommodate the requests for the lightpath establishment. As one of the possible solutions, network virtualization is capable of improving the efficiency of optical networks, by allowing virtual networks to share the resources of physical networks, simplifying the management of resource and providing flexibility in resource allocation. One of the main challenges of network virtualization is to configure a virtual network efficiently which comprises allocating physical resources to accommodate incoming virtual networks. This thesis proposes solutions to the RCSA problem and the virtual network configuration problem for SDM-EON networks. The first contribution of this thesis is an algorithm to promote an equilibrium between reduction of the network energy consumption and reduction of the blocking of requests. For this purpose, we introduce a traffic grooming algorithm using batches, which takes advantage of the deadline of each request to form batches, increasing the chances of the requests to be established at another time. The second contribution of this thesis is a set of algorithms using different techniques to handle the fragmentation problem, where a small portion of available slot sequences end up scattered in a fiber link, blocking future requests, called the fragmentation problem. For this purpose, we propose proactive and reactive algorithms. Proactive algorithms use different techniques, such as multipath routing, core, and area prioritization, and metrics to use in the route selection process. The reactive algorithm uses machine learning to rearrange the spectrum and tune the RCSA algorithm to prevent the fragmentation. The third contribution of this thesis proposes a solution to improve resource sharing in network virtualization. This problem consists in configuring virtual links and nodes to physical nodes and paths. For this purpose, we propose a learning assistant control loop to handle the virtual network configuration problemMestradoCiência da ComputaçãoMestra em Ciência da Computação131025/2017-1CNP

Towards a cloud enabler : from an optical network resource provisioning system to a generalized architecture for dynamic infrastructure services provisioning

This work was developed during a period where most of the optical management and provisioning system where manual and proprietary. This work contributed to the evolution of the state of the art of optical networks with new architectures and advanced virtual infrastructure services. The evolution of optical networks, and internet globally, have been very promising during the last decade. The impact of mobile technology, grid, cloud computing, HDTV, augmented reality and big data, among many others, have driven the evolution of optical networks towards current service technologies, mostly based on SDN (Software Defined Networking) architectures and NFV(Network Functions Virtualisation). Moreover, the convergence of IP/Optical networks and IT services, and the evolution of the internet and optical infrastructures, have generated novel service orchestrators and open source frameworks. In fact, technology has evolved that fast that none could foresee how important Internet is for our current lives. Said in other words, technology was forced to evolve in a way that network architectures became much more transparent, dynamic and flexible to the end users (applications, user interfaces or simple APIs). This Thesis exposes the work done on defining new architectures for Service Oriented Networks and the contribution to the state of the art. The research work is divided into three topics. It describes the evolution from a Network Resource Provisioning System to an advanced Service Plane, and ends with a new architecture that virtualized the optical infrastructure in order to provide coordinated, on-demand and dynamic services between the application and the network infrastructure layer, becoming an enabler for the new generation of cloud network infrastructures. The work done on defining a Network Resource Provisioning System established the first bases for future work on network infrastructure virtualization. The UCLP (User Light Path Provisioning) technology was the first attempt for Customer Empowered Networks and Articulated Private Networks. It empowered the users and brought virtualization and partitioning functionalities into the optical data plane, with new interfaces for dynamic service provisioning. The work done within the development of a new Service Plane allowed the provisioning of on-demand connectivity services from the application, and in a multi-domain and multi-technology scenario based on a virtual network infrastructure composed of resources from different infrastructure providers. This Service Plane facilitated the deployment of applications consuming large amounts of data under deterministic conditions, so allowing the networks behave as a Grid-class resource. It became the first on-demand provisioning system that at lower levels allowed the creation of one virtual domain composed from resources of different providers. The last research topic presents an architecture that consolidated the work done in virtualisation while enhancing the capabilities to upper layers, so fully integrating the optical network infrastructure into the cloud environment, and so providing an architecture that enabled cloud services by integrating the request of optical network and IT infrastructure services together at the same level. It set up a new trend into the research community and evolved towards the technology we use today based on SDN and NFV. Summing up, the work presented is focused on the provisioning of virtual infrastructures from the architectural point of view of optical networks and IT infrastructures, together with the design and definition of novel service layers. It means, architectures that enabled the creation of virtual infrastructures composed of optical networks and IT resources, isolated and provisioned on-demand and in advance with infrastructure re-planning functionalities, and a new set of interfaces to open up those services to applications or third parties.Aquesta tesi es va desenvolupar durant un període on la majoria de sistemes de gestió de xarxa òptica eren manuals i basats en sistemes propietaris. En aquest sentit, la feina presentada va contribuir a l'evolució de l'estat de l'art de les xarxes òptiques tant a nivell d’arquitectures com de provisió d’infraestructures virtuals. L'evolució de les xarxes òptiques, i d'Internet a nivell mundial, han estat molt prometedores durant l'última dècada. L'impacte de la tecnologia mòbil, la computació al núvol, la televisió d'alta definició, la realitat augmentada i el big data, entre molts altres, han impulsat l'evolució cap a xarxes d’altes prestacions amb nous serveis basats en SDN (Software Defined Networking) i NFV (Funcions de xarxa La virtualització). D'altra banda, la convergència de xarxes òptiques i els serveis IT, junt amb l'evolució d'Internet i de les infraestructures òptiques, han generat nous orquestradors de serveis i frameworks basats en codi obert. La tecnologia ha evolucionat a una velocitat on ningú podria haver predit la importància que Internet està tenint en el nostre dia a dia. Dit en altres paraules, la tecnologia es va veure obligada a evolucionar d'una manera on les arquitectures de xarxa es fessin més transparent, dinàmiques i flexibles vers als usuaris finals (aplicacions, interfícies d'usuari o APIs simples). Aquesta Tesi presenta noves arquitectures de xarxa òptica orientades a serveis. El treball de recerca es divideix en tres temes. Es presenta un sistema de virtualització i aprovisionament de recursos de xarxa i la seva evolució a un pla de servei avançat, per acabar presentant el disseny d’una nova arquitectura capaç de virtualitzar la infraestructura òptica i IT i proporcionar serveis de forma coordinada, i sota demanda, entre l'aplicació i la capa d'infraestructura de xarxa òptica. Tot esdevenint un facilitador per a la nova generació d'infraestructures de xarxa en el núvol. El treball realitzat en la definició del sistema de virtualització de recursos va establir les primeres bases sobre la virtualització de la infraestructura de xarxa òptica en el marc de les “Customer Empowered Networks” i “Articulated Private Networks”. Amb l’objectiu de virtualitzar el pla de dades òptic, i oferir noves interfícies per a la provisió de serveis dinàmics de xarxa. En quant al pla de serveis presentat, aquest va facilitat la provisió de serveis de connectivitat sota demanda per part de l'aplicació, tant en entorns multi-domini, com en entorns amb múltiples tecnologies. Aquest pla de servei, anomenat Harmony, va facilitar el desplegament de noves aplicacions que consumien grans quantitats de dades en condicions deterministes. En aquest sentit, va permetre que les xarxes es comportessin com un recurs Grid, i per tant, va esdevenir el primer sistema d'aprovisionament sota demanda que permetia la creació de dominis virtuals de xarxa composts a partir de recursos de diferents proveïdors. Finalment, es presenta l’evolució d’un pla de servei cap una arquitectura global que consolida el treball realitzat a nivell de convergència d’infraestructures (òptica + IT) i millora les capacitats de les capes superiors. Aquesta arquitectura va facilitar la plena integració de la infraestructura de xarxa òptica a l'entorn del núvol. En aquest sentit, aquest resultats van evolucionar cap a les tendències actuals de SDN i NFV. En resum, el treball presentat es centra en la provisió d'infraestructures virtuals des del punt de vista d’arquitectures de xarxa òptiques i les infraestructures IT, juntament amb el disseny i definició de nous serveis de xarxa avançats, tal i com ho va ser el servei de re-planificació dinàmicaPostprint (published version

Investigation of the tolerance of wavelength-routed optical networks to traffic load variations.

This thesis focuses on the performance of circuit-switched wavelength-routed optical network with unpredictable traffic pattern variations. This characteristic of optical networks is termed traffic forecast tolerance. First, the increasing volume and heterogeneous nature of data and voice traffic is discussed. The challenges in designing robust optical networks to handle unpredictable traffic statistics are described. Other work relating to the same research issues are discussed. A general methodology to quantify the traffic forecast tolerance of optical networks is presented. A traffic model is proposed to simulate dynamic, non-uniform loads, and used to test wavelength-routed optical networks considering numerous network topologies. The number of wavelengths required and the effect of the routing and wavelength allocation algorithm are investigated. A new method of quantifying the network tolerance is proposed, based on the calculation of the increase in the standard deviation of the blocking probabilities with increasing traffic load non-uniformity. The performance of different networks are calculated and compared. The relationship between physical features of the network topology and traffic forecast tolerance is investigated. A large number of randomly connected networks with different sizes were assessed. It is shown that the average lightpath length and the number of wavelengths required for full interconnection of the nodes in static operation both exhibit a strong correlation with the network tolerance, regardless of the degree of load non-uniformity. Finally, the impact of wavelength conversion on network tolerance is investigated. Wavelength conversion significantly increases the robustness of optical networks to unpredictable traffic variations. In particular, two sparse wavelength conversion schemes are compared and discussed: distributed wavelength conversion and localized wavelength conversion. It is found that the distributed wavelength conversion scheme outperforms localized wavelength conversion scheme, both with uniform loading and in terms of the network tolerance. The results described in this thesis can be used for the analysis and design of reliable WDM optical networks that are robust to future traffic demand variations

Priority realloc : a threefold mechanism for route and resources allocation in EONs

Cotutela Universitat Politècnica de Catalunya i Escola Politécnica da Universidade de São PauloBackbone networks are responsible for long-haul data transport serving many clients with a large volume of data. Since long-haul data transport service must rely on a robust high capacity network the current technology broadly adopted by the industry is Wavelength Division Multiplexing (WDM). WDM networks enable one single fiber to operate with multiple high capacity channels, drastically increasing the fiber capacity. In WDM networks each channel is associated with an individual wavelength. Therefore a whole wavelength capacity is assigned to a connection, causing waste of bandwidth in case the connection bandwidth requirement is less than the channel total capacity. In the last half decade, Elastic Optical Networks (EON) have been proposed and developed based on the flexible use of the optical spectrum known as the flexigrid. EONs are adaptable to clients requirements and may enhance optical networks performance. For these reasons, research community and data transport providers have been demonstrating increasingly high interest in EONs which are likely to replace WDM as the universally adopted technology in backbone networks in the near future. EONs have two characteristics that may limit its efficient resources use. The spectrum fragmentation, inherent to the dynamic EON operation, decreases the network capacity to assign resources to connection requests increasing network blocking probability. The spectrum fragmentation also intensifies the denial of service to higher rate request inducing service unfairness. Due to the fact EONs were just recently developed and proposed, the aforementioned issues were not yet extensively studied and solutions are still being proposed. Furthermore, EONs do not yet provide specific features as differentiated service mechanisms. Differentiated service strategies are important in backbone networks to guarantee client's diverse requirements in case of a network failure or the natural congestion and resources contention that may occur at some periods of time in a network. Impelled by the foregoing facts, this thesis objective is three-fold. By means of developing and proposing a mechanism for routing and resources assignment in EONs, we intend to provide differentiated service while decreasing fragmentation level and increasing service fairness. The mechanism proposed and explained in this thesis was tested in an EON simulation environment and performance results indicated that it promotes beneficial performance enhancements when compared to benchmark algorithms.Redes backbone sao responsáveis pelo transporte de dados à longa distância que atendem a uma grande quantidade de clientes com um grande volume de dados. Como redes backbone devem basear-se em uma rede robusta e de alta capacidade, a tecnologia atual amplamente adotada pela indústria é Wavelength Division Multiplexing (WDM). Redes WDM permitem que uma única fibra opere com múltiplos canais de alta largura de banda, aumentando drasticamente a capacidade da fibra. Em redes WDM cada canal está associado a um comprimento de onda particular. Por conseguinte, toda capacidade do comprimento de onda é atribuída a uma única conexão, fazendo com que parte da largura de banda seja desperdiçada no caso em que a requisição de largura de banda da conexão seja menor do que a capacidade total do canal. A partir da metade da última década, as Redes Ópticas Elásticas (Elastic Optical Networks - EON) têm sido propostas e desenvolvidas com base no uso flexível do espectro óptico conhecido como flexigrid. EONs são adaptáveis às requisiçes por banda dos clientes e podem, portanto, melhorar o desempenho das redes ópticas. Por estas razões, EONs têm recebido cada vez mais interesse dos meios de pesquisa e provedores de serviço e provavelmente substituirão WDM como a tecnologia universalmente adotada pela indústria em redes backbone. EONs têm duas características que podem limitar a utilização eficiente de recursos. A fragmentação do espectro, inerente à operação dinâmica das EONs, pode diminuir a capacidade da rede em distribuir recursos ao atender às solicitações por conexões aumentando a probabilidade de bloqueio na rede. A fragmentação do espectro também intensifica a negação de serviço às solicitações por taxa de transmissão mais elevada, gerando injustiça no serviço prestado. Como EONs foram desenvolvidas recentemente, respostas às questões acima mencionadas ainda estão sob estudo e soluções continuam sendo propostas na literatura. Além disso, EONs ainda não fornecem funções específicas como um mecanismo que proveja diferenciação de serviço. Estratégias de diferenciação de serviço são importantes em redes backbone para garantir os diversos requisitos dos clientes em caso de uma falha na rede ou do congestionamento e disputa por recursos que podem ocorrer em alguns períodos em uma rede. Impulsionada pelos fatos anteriormente mencionados, esta tese possui três objetivos. Através do desenvolvimento e proposta de um mecanismo de roteamento e atribuição de recursos para EONs, temos a intenção de disponibilizar diferenciação de serviço, diminuir o nível de fragmentação de espectro e aumentar a justiça na distribuição de serviços. O mecanismo proposto nesta tese foi testado em simulações de EONs. Resultados indicaram que o mecanismo proposto promove benefícios através do aprimoramento da performance de uma rede EON quando comparado com algoritmos de referência.Les xarxes troncals son responsables per el transport de dades a llarga distància que serveixen a una gran quantitat de clients amb un gran volum de dades. Com les xarxes troncals han d'estar basades en una xarxa robusta i d'alta capacitat, la tecnologia actual àmpliament adoptada per la indústria és el Wavelength Division Multiplexing (WDM). Xarxes WDM permeten operar amb una sola fibra multicanal d'alt ample de banda, el que augmenta molt la capacitat de la fibra. A les xarxes WDM cada canal est a associat amb una longitud d'ona particular. En conseqüència, tota la capacitat del canal es assignada a una sola connexió, fent que part dels recurs siguin perduts en el cas en que l'ample de banda sol licitada sigui menys que la capacitat total del canal. A gairebé deu anys les xarxes òptiques elàstiques (Elastic Optical Networks -EON) son propostes i desenvolupades basades en el ús visible de l'espectre òptic conegut com Flexigrid. EONs són adaptables a les sol·licituds per ample de banda dels clients i per tant poden millorar el rendiment de les xarxes òptiques. Per aquestes raons, EONs han rebut cada vegada més interès en els mitjans d’investigació i de serveis i, probablement, han de reemplaçar el WDM com la tecnologia universalment adoptada en les xarxes troncals. EONs tenen dues característiques que poden limitar l'ús eficient dels recursos seus. La fragmentació de l'espectre inherent al funcionament dinàmic de les EONs, pot disminuir la capacitat de la xarxa en distribuir els recursos augmentant la probabilitat de bloqueig de connexions. La fragmentació de l'espectre també intensifica la denegació de les sol·licituds de servei per connexions amb una major ample de banda, el que genera injustícia en el servei ofert. Com les EONs s'han desenvolupat recentment, solucions als problemes anteriors encara estan en estudi i les solucions segueixen sent proposades en la literatura. D'altra banda, les EONs encara no proporcionen funcions especifiques com mecanisme de diferenciació de provisió de serveis. Estratègies de diferenciació de servei són importants en les xarxes troncals per garantir les diverses necessitats dels clients en cas d'una fallada de la xarxa o de la congestió i la competència pels recursos que es poden produir en alguns períodes. Impulsada pels fets abans esmentats, aquesta tesi te tres objectius. A través del desenvolupament i proposta d'un mecanisme d'enrutament i assignació de recursos per EONs, tenim la intenció d'oferir la diferenciació de serveis, disminuir el nivell de fragmentació de l'espectre i augmentar l'equitat en la distribució dels serveis. El mecanisme proposat en aquesta tesi ha estat provat en simulacions EONs. Els resultats van indicar que el mecanisme promou millores en el rendiment de la EON, en comparació amb els algoritmes de referència.Postprint (published version