Datacenter Traffic Control: Understanding Techniques and Trade-offs

Datacenters provide cost-effective and flexible access to scalable compute and storage resources necessary for today's cloud computing needs. A typical datacenter is made up of thousands of servers connected with a large network and usually managed by one operator. To provide quality access to the variety of applications and services hosted on datacenters and maximize performance, it deems necessary to use datacenter networks effectively and efficiently. Datacenter traffic is often a mix of several classes with different priorities and requirements. This includes user-generated interactive traffic, traffic with deadlines, and long-running traffic. To this end, custom transport protocols and traffic management techniques have been developed to improve datacenter network performance. In this tutorial paper, we review the general architecture of datacenter networks, various topologies proposed for them, their traffic properties, general traffic control challenges in datacenters and general traffic control objectives. The purpose of this paper is to bring out the important characteristics of traffic control in datacenters and not to survey all existing solutions (as it is virtually impossible due to massive body of existing research). We hope to provide readers with a wide range of options and factors while considering a variety of traffic control mechanisms. We discuss various characteristics of datacenter traffic control including management schemes, transmission control, traffic shaping, prioritization, load balancing, multipathing, and traffic scheduling. Next, we point to several open challenges as well as new and interesting networking paradigms. At the end of this paper, we briefly review inter-datacenter networks that connect geographically dispersed datacenters which have been receiving increasing attention recently and pose interesting and novel research problems.Comment: Accepted for Publication in IEEE Communications Surveys and Tutorial

Predictable Real-Time Wireless Networking For Sensing And Control

Towards the end goal of providing predictable real-time wireless networking for sensing and control, we have developed a real-time routing protocol MTA that predictably delivers data by their deadlines, and a scheduling protocol PRKS to ensure a certain link reliability based on the Physical-ratio-K (PRK) model, which is both realistic and amenable for distributed implementation, and a greedy scheduling algorithm to deliver as many packets as possible to the sink by a deadline in lossy multi-hop wireless sensor networks. Real-time routing is a basic element of closed-loop, real-time sensing and control, but it is challenging due to dynamic, uncertain link/path delays. The probabilistic nature of link/path delays makes the basic problem of computing the probabilistic distribution of path delays NP-hard, yet quantifying probabilistic path delays is a basic element of real-time routing and may well have to be executed by resource-constrained devices in a distributed manner; the highly-varying nature of link/path delays makes it necessary to adapt to in-situ delay conditions in real-time routing, but it has been observed that delay-based routing can lead to instability, estimation error, and low data delivery performance in general. To address these challenges, we propose the Multi-Timescale Estimation (MTE) method; by accurately estimating the mean and variance of per-packet transmission time and by adapting to fast-varying queueing in an accurate, agile manner, MTE enables accurate, agile, and efficient estimation of probabilistic path delay bounds in a distributed manner. Based on MTE, we propose the Multi-Timescale Adaptation (MTA) routing protocol; MTA integrates the stability of an ETX-based directed-acyclic-graph (DAG) with the agility of spatiotemporal data flow control within the DAG to ensure real-time data delivery in the presence of dynamics and uncertainties. We also address the challenges of implementing MTE and MTA in resource-constrained devices such as TelosB motes. We evaluate the performance of MTA using the NetEye and Indriya sensor network testbeds. We find that MTA significantly outperforms existing protocols, e.g., improving deadline success ratio by 89% and reducing transmission cost by a factor of 9.7. Predictable wireless communication is another basic enabler for networked sensing and control in many cyber-physical systems, yet co-channel interference remains a major source of uncertainty in wireless communication. Integrating the protocol model\u27s locality and the physical model\u27s high fidelity, the physical-ratio-K (PRK) interference model bridges the gap between the suitability for distributed implementation and the enabled scheduling performance, and it is expected to serve as a foundation for distributed, predictable interference control. To realize the potential of the PRK model and to address the challenges of distributed PRK-based scheduling, we design protocol PRKS. PRKS uses a control-theoretic approach to instantiating the PRK model according to in-situ network and environmental conditions, and, through purely local coordination, the distributed controllers converge to a state where the desired link reliability is guaranteed. PRKS uses local signal maps to address the challenges of anisotropic, asymmetric wireless communication and large interference range, and PRKS leverages the different timescales of PRK model adaptation and data transmission to decouple protocol signaling from data transmission. Through sensor network testbed-based measurement study, we observe that, unlike existing scheduling protocols where link reliability is unpredictable and the reliability requirement satisfaction ratio can be as low as 0%, PRKS enables predictably high link reliability (e.g., 95%) in different network and environmental conditions without a priori knowledge of these conditions, and, through local distributed coordination, PRKS achieves a channel spatial reuse very close to what is enabled by the state-of-the-art centralized scheduler while ensuring the required link reliability. Ensuring the required link reliability in PRKS also reduces communication delay and improves network throughput. We study the problem of scheduling packet transmissions to maximize the expected number of packets collected at the sink by a deadline in a multi-hop wireless sensor network with lossy links. Most existing work assumes error-free transmissions when interference constraints are complied, yet links can be unreliable due to external interference, shadow- ing, and fading in harsh environments in practice. We formulate the problem as a Markov decision process, yielding an optimal solution. However, the problem is computationally in- tractable due to the curse of dimensionality. Thus, we propose the efficient and greedy Best Link First Scheduling (BLF) protocol. We prove it is optimal for the single-hop case and provide an approach for distributed implementation. Extensive simulations show it greatly enhances real-time data delivery performance, increasing deadline catch ratio by up to 50%, compared with existing scheduling protocols in a wide range of network and traffic settings

Enhancing SDN WISE with Slicing Over TSCH

[EN] IWSNs (Industrial Wireless Sensor Networks) have become the next step in the evolution of WSN (Wireless Sensor Networks) due to the nature and demands of modern industry. With this type of network, flexible and scalable architectures can be created that simultaneously support traffic sources with different characteristics. Due to the great diversity of application scenarios, there is a need to implement additional capabilities that can guarantee an adequate level of reliability and that can adapt to the dynamic behavior of the applications in use. The use of SDNs (Software Defined Networks) extends the possibilities of control over the network and enables its deployment at an industrial level. The signaling traffic exchanged between nodes and controller is heavy and must occupy the same channel as the data traffic. This difficulty can be overcome with the segmentation of the traffic into flows, and correct scheduling at the MAC (Medium Access Control) level, known as slices. This article proposes the integration in the SDN controller of a traffic manager, a routing process in charge of assigning different routes according to the different flows, as well as the introduction of the Time Slotted Channel Hopping (TSCH) Scheduler. In addition, the TSCH (Time Slotted Channel Hopping) is incorporated in the SDN-WISE framework (Software Defined Networking solution for Wireless Sensor Networks), and this protocol has been modified to send the TSCH schedule. These elements are jointly responsible for scheduling and segmenting the traffic that will be sent to the nodes through a single packet from the controller and its performance has been evaluated through simulation and a testbed. The results obtained show how flexibility, adaptability, and determinism increase thanks to the joint use of the routing process and the TSCH Scheduler, which makes it possible to create a slicing by flows, which have different quality of service requirements. This in turn helps guarantee their QoS characteristics, increase the PDR (Packet Delivery Ratio) for the flow with the highest priority, maintain the DMR (Deadline Miss Ratio), and increase the network lifetime.This work has been supported by the MCyU (Spanish Ministry of Science and Universities) under the project ATLAS (PGC2018-094151-B-I00), which is partially funded by AEI, FEDER and EU and has been possible thanks to the collaboration of the Instituto Tecnologico de Informatica (ITI) of Valencia.Orozco-Santos, F.; Sempere Paya, VM.; Albero Albero, T.; Silvestre-Blanes, J. (2021). Enhancing SDN WISE with Slicing Over TSCH. Sensors. 21(4):1-29. https://doi.org/10.3390/s21041075S12921

Opportunistic scheduling algorithms in downlink centralized wireless networks.

Thesis (M.Sc.Eng.)-University of KwaZulu-Natal, 2005.As wireless spectrum efficiency is becoming increasingly important with the growing demands for wideband wireless service scheduling algorithm plays an important role in the design of advanced wireless networks. Opportunistic scheduling algorithms for wireless communication networks under different QoS constraints have gained popularity in recent years since they have potentials of achieving higher system performance. In this dissertation firstly we formulate the framework of opportunistic scheduling algorithms. Then we propose three new opportunistic scheduling schemes under different QoS criteria and situations (single channel or multiple channel). 1. Temporal fairness opportunistic scheduling algorithm in the short term. We replicate the temporal fairness opportunistic scheduling algorithm in the long term. From simulation results we find that this algorithm improves the system performance and complies with the temporal fairness constraint in the long term. However, the disadvantage of this algorithm is that it is unfair from the beginning of simulation to 10000 time slot on system resource (time slots) allocation - we say it is unfair in the short term. With such a scheme, it is possible that some users with bad channel conditions would starve for a long time (more than a few seconds) , which is undesirable to certain users (say, real-time users). So we propose the new scheme called temporal fairness opportunistic scheduling algorithm in the short term to satisfy users ' requirements of system resource in both short term and long term. Our simulation results show that the new scheme performs well with respect to both temporal fairness constraint and system performance improvement. 2. Delay-concerned opportunistic scheduling algorithm. While most work has been done on opportunistic scheduling algorithm under fairness constraints on user level, we consider users' packet delay in opportunistic scheduling. Firstly we examine the packet delay performance under the long term temporal fairness opportunistic scheduling (TFOL) algorithm. We also simulate the earliest deadline-first (EDF) scheduling algorithm in the wireless environment. We find that the disadvantage of opportunistic scheduling algorithm is that it is unfair in packet delay distribution because it results in a bias for users with good channel conditions in packet delay to improve system performance. Under EDF algorithm, packet delay of users with different channel conditions is almost the same but the problem is that it is worse than the opportunistic scheduling algorithm. So we propose another new scheme which considers both users' channel conditions and packet delay. Simulation results show that the new scheme works well with respect to both system performance improvement and the balance of packet delay distribution. 3. Utilitarian fairness scheduling algorithm in multiple wireless channel networks. Existing studies have so far focused on the design of scheduling algorithm in the single wireless communication network under the fairness constraint. A common assumption of existing designs is that only a single user can access the channel at a given time slot. However, spread spectrum techniques are increasingly being deployed to allow multiple data users to transmit simultaneously on a relatively small number of separate high-rate channels. Not much work has been done on the scheduling algorithm in the multiple wireless channel networks. Furthermore in wire-line network, when a certain amount of resource is assigned to a user, it guarantees that the user gets some amount of performance, but in wireless network this point is different because channel conditions are different among users. Hence, in wireless channel the user's performance does not directly depend on its allocation of system resource. Finally the opportunistic scheduling mechanism for wireless communication networks is gaining popularity because it utilizes the "multi-user diversity" to maximize the system performance. So, considering these three points in the fourth section, we propose utilitarian fairness scheduling algorithm in multiple wireless channel networks. Utilitarian fairness is to guarantee that every user can get its performance requirement which is pre-defined. The proposed criterion fits in with wireless networks. We also use the opportunistic scheduling mechanism to maximize system performance under the utilitarian fairness constraint. Simulation results show that the new scheme works well in both utilitarian fairness and utilitarian efficiency of system resource in the multiple wireless channel situation

Real-Time Wireless Sensor-Actuator Networks for Cyber-Physical Systems

A cyber-physical system (CPS) employs tight integration of, and coordination between computational, networking, and physical elements. Wireless sensor-actuator networks provide a new communication technology for a broad range of CPS applications such as process control, smart manufacturing, and data center management. Sensing and control in these systems need to meet stringent real-time performance requirements on communication latency in challenging environments. There have been limited results on real-time scheduling theory for wireless sensor-actuator networks. Real-time transmission scheduling and analysis for wireless sensor-actuator networks requires new methodologies to deal with unique characteristics of wireless communication. Furthermore, the performance of a wireless control involves intricate interactions between real-time communication and control. This thesis research tackles these challenges and make a series of contributions to the theory and system for wireless CPS. (1) We establish a new real-time scheduling theory for wireless sensor-actuator networks. (2) We develop a scheduling-control co-design approach for holistic optimization of control performance in a wireless control system. (3) We design and implement a wireless sensor-actuator network for CPS in data center power management. (4) We expand our research to develop scheduling algorithms and analyses for real-time parallel computing to support computation-intensive CPS

Towards Real-time Wireless Sensor Networks

Wireless sensor networks are poised to change the way computer systems interact with the physical world. We plan on entrusting sensor systems to collect medical data from patients, monitor the safety of our infrastructure, and control manufacturing processes in our factories. To date, the focus of the sensor network community has been on developing best-effort services. This approach is insufficient for many applications since it does not enable developers to determine if a system\u27s requirements in terms of communication latency, bandwidth utilization, reliability, or energy consumption are met. The focus of this thesis is to develop real-time network support for such critical applications. The first part of the thesis focuses on developing a power management solution for the radio subsystem which addresses both the problem of idle-listening and power control. In contrast to traditional power management solutions which focus solely on reducing energy consumption, the distinguishing feature of our approach is that it achieves both energy efficiency and real-time communication. A solution to the idle-listening problem is proposed in Energy Efficient Sleep Scheduling based on Application Semantics: ESSAT). The novelty of ESSAT lies in that it takes advantage of the common features of data collection applications to determine when to turn on and off a node\u27s radio without affecting real-time performance. A solution to the power control problem is proposed in Real-time Power Aware-Routing: RPAR). RPAR tunes the transmission power for each packet based on its deadline such that energy is saved without missing packet deadlines. The main theoretical contribution of this thesis is the development of novel transmission scheduling techniques optimized for data collection applications. This work bridges the gap between wireless sensor networks and real-time scheduling theory, which have traditionally been applied to processor scheduling. The proposed approach has significant advantages over existing design methodologies:: 1) it provides predictable performance allowing for the performance of a system to be estimated upon its deployment,: 2) it is possible to detect and handle overload conditions through simple rate control mechanisms, and: 3) it easily accommodates workload changes. I developed this framework under a realistic interference model by coordinating the activities at the MAC, link, and routing layers. The last component of this thesis focuses on the development of a real-time patient monitoring system for general hospital units. The system is designed to facilitate the detection of clinical deterioration, which is a key factor in saving lives and reducing healthcare costs. Since patients in general hospital wards are often ambulatory, a key challenge is to achieve high reliability even in the presence of mobility. To support patient mobility, I developed the Dynamic Relay Association Protocol -- a simple and effective mechanism for dynamically discovering the right relays for forwarding patient data -- and a Radio Mapping Tool -- a practical tool for ensuring network coverage in 802.15.4 networks. We show that it is feasible to use low-power and low-cost wireless sensor networks for clinical monitoring through an in-depth clinical study. The study was performed in a step-down cardiac care unit at Barnes-Jewish Hospital. This is the first long-term study of such a patient monitoring system

Enhancement of The IEEE 802.15.4 Standard By Energy Efficient Cluster Scheduling

The IEEE 802.15.4 network is gaining popularity due to its wide range of application in Industries and day to day life. Energy Conservation in IEEE 802.15.4 nodes is always a concern for the designers as the life time of a network depends mainly on minimizing the energy consumption in the nodes. In ZigBee cluster-tree network, the existing literature does not provide combined solution for co-channel interference and power efficient scheduling. In addition, the technique that prevents network collision has not been provided. Delay and reliability issues are not addressed in the QoS-aware routing. Congestion is one of the major challenges in IEEE 802.15.4 Network. This network also has issues in admitting real time flows. The aim of the present research is to overcome the issues mentioned above by designing Energy Efficient Cluster Scheduling and Interference Mitigation, QoS Aware Inter-Cluster Routing Protocol and Adaptive Data Rate Control for Clustered Architecture for IEEE 802.15.4 Networks. To overcome the issue of Energy efficiency and network collision energy efficient cluster scheduling and interference mitigation for IEEE 802.15.4 Network is proposed. It uses a time division cluster scheduling technique that offers energy efficiency in the cluster-tree network. In addition, an interference mitigation technique is demonstrated which detects and mitigates the channel interference based on packet-error detection and repeated channel-handoff command transmission. For the issues of delay and reliability in cluster network, QoS aware intercluster routing protocol for IEEE 802.15.4 Networks is proposed. It consists of some modules like reliability module, packet classifier, hello protocol module, routing service module. Using the Packet classifier, the packets are classified into the data and hello packets. The data packets are classified based on the priority. Neighbour table is constructed to maintain the information of neighbour nodes reliabilities by Hello protocol module. Moreover, routing table is built using the routing service module. The delay in the route is controlled by delay metrics, which is a sum of queuing delay and transmission delay. For the issues of congestion and admit real-time flows an Adaptive data rate control for clustered architecture in IEEE 802.15.4 Networks is proposed. A network device is designed to regulate its data rate adaptively using the feedback message i.e. Congestion Notification Field (CNF) in beacon frame received from the receiver side. The network device controls or changes its data rate based on CNF value. Along with this scalability is considered by modifying encoding parameters using Particle Swarm Optimization (PSO) to balance the target output rate for supporting high data rate. Simulation results show that the proposed techniques significantly reduce the energy consumption by 17% and the network collision, enhance the performance, mitigate the effect of congestion, and admit real-time flows