8,281 research outputs found
Converging an Overlay Network to a Gradient Topology
In this paper, we investigate the topology convergence problem for the
gossip-based Gradient overlay network. In an overlay network where each node
has a local utility value, a Gradient overlay network is characterized by the
properties that each node has a set of neighbors with the same utility value (a
similar view) and a set of neighbors containing higher utility values (gradient
neighbor set), such that paths of increasing utilities emerge in the network
topology. The Gradient overlay network is built using gossiping and a
preference function that samples from nodes using a uniform random peer
sampling service. We analyze it using tools from matrix analysis, and we prove
both the necessary and sufficient conditions for convergence to a complete
gradient structure, as well as estimating the convergence time and providing
bounds on worst-case convergence time. Finally, we show in simulations the
potential of the Gradient overlay, by building a more efficient live-streaming
peer-to-peer (P2P) system than one built using uniform random peer sampling.Comment: Submitted to 50th IEEE Conference on Decision and Control (CDC 2011
Small-world networks, distributed hash tables and the e-resource discovery problem
Resource discovery is one of the most important underpinning problems behind producing a scalable,
robust and efficient global infrastructure for e-Science. A number of approaches to the resource discovery
and management problem have been made in various computational grid environments and prototypes
over the last decade. Computational resources and services in modern grid and cloud environments can be
modelled as an overlay network superposed on the physical network structure of the Internet and World
Wide Web. We discuss some of the main approaches to resource discovery in the context of the general
properties of such an overlay network. We present some performance data and predicted properties based
on algorithmic approaches such as distributed hash table resource discovery and management. We describe
a prototype system and use its model to explore some of the known key graph aspects of the global
resource overlay network - including small-world and scale-free properties
End-to-end QoE optimization through overlay network deployment
In this paper an overlay network for end-to-end QoE management is presented. The goal of this infrastructure is QoE optimization by routing around failures in the IP network and optimizing the bandwidth usage on the last mile to the client. The overlay network consists of components that are located both in the core and at the edge of the network. A number of overlay servers perform end-to-end QoS monitoring and maintain an overlay topology, allowing them to route around link failures and congestion. Overlay access components situated at the edge of the network are responsible for determining whether packets are sent to the overlay network, while proxy components manage the bandwidth on the last mile. This paper gives a detailed overview of the end-to-end architecture together with representative experimental results which comprehensively demonstrate the overlay network's ability to optimize the QoE
Avatar: A Time- and Space-Efficient Self-Stabilizing Overlay Network
Overlay networks present an interesting challenge for fault-tolerant
computing. Many overlay networks operate in dynamic environments (e.g. the
Internet), where faults are frequent and widespread, and the number of
processes in a system may be quite large. Recently, self-stabilizing overlay
networks have been presented as a method for managing this complexity.
\emph{Self-stabilizing overlay networks} promise that, starting from any
weakly-connected configuration, a correct overlay network will eventually be
built. To date, this guarantee has come at a cost: nodes may either have high
degree during the algorithm's execution, or the algorithm may take a long time
to reach a legal configuration. In this paper, we present the first
self-stabilizing overlay network algorithm that does not incur this penalty.
Specifically, we (i) present a new locally-checkable overlay network based upon
a binary search tree, and (ii) provide a randomized algorithm for
self-stabilization that terminates in an expected polylogarithmic number of
rounds \emph{and} increases a node's degree by only a polylogarithmic factor in
expectation
Evaluating Connection Resilience for the Overlay Network Kademlia
Kademlia is a decentralized overlay network, up to now mainly used for highly
scalable file sharing applications. Due to its distributed nature, it is free
from single points of failure. Communication can happen over redundant network
paths, which makes information distribution with Kademlia resilient against
failing nodes and attacks. This makes it applicable to more scenarios than
Internet file sharing. In this paper, we simulate Kademlia networks with
varying parameters and analyze the number of node-disjoint paths in the
network, and thereby the network connectivity. A high network connectivity is
required for communication and system-wide adaptation even when some nodes or
communication channels fail or get compromised by an attacker. With our
results, we show the influence of these parameters on the connectivity and,
therefore, the resilience against failing nodes and communication channels.Comment: 12 pages, 14 figures, accepted to ICDCS2017. arXiv admin note:
substantial text overlap with arXiv:1605.0800
Two dimensional array based overlay network for balancing load of peer-to-peer live video streaming
The live video data is streaming usually in a tree-based overlay network or in a mesh-based overlay network. In case of departure of a peer with additional upload bandwidth, the overlay network becomes very vulnerable to churn. In this paper, a two dimensional array-based overlay network is proposed for streaming the live video stream data. As there is always a peer or a live video streaming server to upload the live video stream data, so the overlay network is very stable and very robust to churn. Peers are placed according to their upload and download bandwidth, which enhances the balance of load and performance. The overlay network utilizes the additional upload bandwidth of peers to minimize chunk delivery delay and to maximize balance of load. The procedure, which is used for distributing the additional upload bandwidth of the peers, distributes the additional upload bandwidth to the heterogeneous strength peers in a fair treat distribution approach and to the homogeneous strength peers in a uniform distribution approach. The proposed overlay network has been simulated by Qualnet from Scalable Network Technologies and results are presented in this paper
A Dual Digraph Approach for Leaderless Atomic Broadcast (Extended Version)
Many distributed systems work on a common shared state; in such systems,
distributed agreement is necessary for consistency. With an increasing number
of servers, these systems become more susceptible to single-server failures,
increasing the relevance of fault-tolerance. Atomic broadcast enables
fault-tolerant distributed agreement, yet it is costly to solve. Most practical
algorithms entail linear work per broadcast message. AllConcur -- a leaderless
approach -- reduces the work, by connecting the servers via a sparse resilient
overlay network; yet, this resiliency entails redundancy, limiting the
reduction of work. In this paper, we propose AllConcur+, an atomic broadcast
algorithm that lifts this limitation: During intervals with no failures, it
achieves minimal work by using a redundancy-free overlay network. When failures
do occur, it automatically recovers by switching to a resilient overlay
network. In our performance evaluation of non-failure scenarios, AllConcur+
achieves comparable throughput to AllGather -- a non-fault-tolerant distributed
agreement algorithm -- and outperforms AllConcur, LCR and Libpaxos both in
terms of throughput and latency. Furthermore, our evaluation of failure
scenarios shows that AllConcur+'s expected performance is robust with regard to
occasional failures. Thus, for realistic use cases, leveraging redundancy-free
distributed agreement during intervals with no failures improves performance
significantly.Comment: Overview: 24 pages, 6 sections, 3 appendices, 8 figures, 3 tables.
Modifications from previous version: extended the evaluation of AllConcur+
with a simulation of a multiple datacenters deploymen
Self-Stabilizing Supervised Publish-Subscribe Systems
In this paper we present two major results: First, we introduce the first
self-stabilizing version of a supervised overlay network by presenting a
self-stabilizing supervised skip ring. Secondly, we show how to use the
self-stabilizing supervised skip ring to construct an efficient
self-stabilizing publish-subscribe system. That is, in addition to stabilizing
the overlay network, every subscriber of a topic will eventually know all of
the publications that have been issued so far for that topic. The communication
work needed to processes a subscribe or unsubscribe operation is just a
constant in a legitimate state, and the communication work of checking whether
the system is still in a legitimate state is just a constant on expectation for
the supervisor as well as any process in the system
The Forest Overlay Network
Forest is an overlay network designed for large real-time distributed systems. In particular, we’re interested in virtual worlds that provide high-quality interaction over a constantly changing pattern of communication. Forest is suitable for applications in which many entities send data to a large set of constantly changing entities. By using tree-structured channels, we can create logically isolated private networks which support both unicast and multicast routing. In this paper, we will discuss the core components of Forest and measure the performance of the control elements of the network. We will also provide examples of control sequences and the roles played by control elements in those sequences to help maintain fast, reliable data delivery
Two dimensional array based overlay network for reducing delay of peer-to-peer live video streaming
Live video streaming is very useful for many
events. For example, it can be very useful to make an
announcement in an area, which is effected by natural disaster.
So it is also very important to provide the live video stream
without any time delay if possible. The live video data is
streaming usually in a tree-based overlay network or in a
mesh-based overlay network. In case of departure of a peer
with additional upload bandwidth, the overlay network
becomes very vulnerable to churn. In this paper, a two
dimensional array-based overlay network is proposed for
streaming the live video stream data. As there is always a peer
or a live video streaming server to upload the live video stream
data, so the overlay network is very stable and very robust to
churn. Peers are placed according to their upload and
download bandwidth, which enhances the balance of load and
performance. The overlay network utilizes the additional
upload bandwidth of peers to minimize chunk delivery delay
and to maximize balance of load. The procedure, which is used
for distributing the additional upload bandwidth of the peers,
distributes the additional upload bandwidth to the
heterogeneous strength peers in a fair treat distribution
approach and to the homogeneous strength peers in a uniform
distribution approach. The proposed overlay network has been
simulated by QualNet from Scalable Network Technologies
and results are presented in this paper. Both maximum delay
and average delay has decreased compared to Fast-Mesh
overlay network. The percentage change in both of maximum
and average delay time are below 30%, even though the
number of nodes increases 10 times
- …