Progressive Analytics: A Computation Paradigm for Exploratory Data Analysis

Exploring data requires a fast feedback loop from the analyst to the system, with a latency below about 10 seconds because of human cognitive limitations. When data becomes large or analysis becomes complex, sequential computations can no longer be completed in a few seconds and data exploration is severely hampered. This article describes a novel computation paradigm called Progressive Computation for Data Analysis or more concisely Progressive Analytics, that brings at the programming language level a low-latency guarantee by performing computations in a progressive fashion. Moving this progressive computation at the language level relieves the programmer of exploratory data analysis systems from implementing the whole analytics pipeline in a progressive way from scratch, streamlining the implementation of scalable exploratory data analysis systems. This article describes the new paradigm through a prototype implementation called ProgressiVis, and explains the requirements it implies through examples.Comment: 10 page

TCP adaptation to EDS

The TCP/IP stack has been mainly designed for elastic traffic (file transfers). It is nowadays recognized that it is not able to efficiently support traffic patterns with completely differing requirements (e.g. applications with delay requirements). Service differentiation at the flow agregate level (DiffServ) is a promising way to implement some form of IP QoS because it is robust and scalable. The EDS (Equivalent Differentiated Services) PHB is a DiffServ per Hop Behavior based on both loss rate and delay proportional differentiation. This article, presents a network layer implementing the EDS service differentiation and a marking strategy for TCP. This strategy leads to a diminution of the number of timeouts and the standard deviation of the individual throughput of multiple connections

End-to-end delay constrained protocol over the EDS service differentiation

The TCP/IP stack has been mainly designed for elastic traffic (file transfers). It is nowadays recognized that it is not able to efficiently support traffic patterns with completely differing requirements (e.g. applications with delay requirements). Service differentiation at the flow agregate level (DiffServ) is a promising way to implement some form of IP QoS because it is robust and scalable. The EDS PHB is a Diffserv PHB based on both loss rate and delay proportional differentiation. In this article, we start from a network layer implementing the EDS service differentiation and present a specific transport protocol which aims at providing an end-to-end delay guarantee to applications with delay requirements

Grid flow control: Prototype of a grid gateway based on Network Processors

Due to network bandwidth growth, grid computing has been envisionned. As grids are aggregation of computer clusters based on high performance local networks and interconnected by very high speed core networks, access links to core networks remain bottleneck locations. In order to optimize grid computing overall performance, we propose to organize data transfers from one cluster to an other. This organization must allow ressource schedulers to schedule data transferts in addition of tasks. Based on a grid network resource reservation model this paper presents the design f a grid gateway, located at the LAN/WAN interface. To implement this approach, we have develop a prototype based on Network Processors IntelIXP2400 which is able to control flows at 1gigabits/s. We discuss the main design choices and experimental results

Implementation of proportional loss rate differentiation in EDS using Proportional Loss Rate and RED

The TCP/IP stack has been mainly designed for elastic traffic (file transfers). It is nowadays recognized that it is not able to efficiently support traffic patterns with completely differing requirements (e.g. applications with delay requirements). Service differentiation at the flow agregate level (DiffServ) is a promising way to implement some form of IP QoS because it is robust and scalable. The EDS PHB is a Diffserv PHB based on both loss rate and delay proportional differentiation. In this report, we present and compare two implementations of the loss rate differenciation in EDS. One is based on the PLR tail-drop like system, the second uses a RED like dropping mechanism

Spécification du service actif QoSINUS

Ce document présente QoSINUS, un système de gestion de la qualité de service dans les réseaux DiffServ. Le système se propose de choisir à tout instant la classe de service DiffServ correspondant le mieux à une requête applicative, en fonction des performances mesurées des classes DiffServ dans le réseau

Analysis and evaluation of a XEN based virtual router

Virtualization techniques are applied to improve features like isolation, security, mobility and dynamic reconfiguration in distributed systems. To introduce these advantages into the network where they are highly required, an interesting approach is to virtualize the internet routers themselves. This technique could enable several virtual networks of different types, owners and protocols to coexist inside one physical network. In this study, we propose a model of a virtual router we have implemented with XEN and we evaluate its properties. We show that the performance is close to the performance of non virtualized software routers, but causes an important processing overhead and unfairness in the share of the resources. We study the impact of the virtual machine scheduler parameters on the network performance and we show that the module which is responsible of forwarding the packets between the virtual machines and the physical interfaces is the critical point of network communications

Reliable and interactive protocol for short messages over the EDS service differentiation

The TCP/IP stack has been mainly designed for elastic traffic (file transfers). It is nowadays recognized that it is not able to efficiently support traffic patterns with completely differing requirements (e.g. applications with delay requirements). Service differentiation at the flow agregate level (DiffServ) is a promising way to implement some form of IP QoS because it is robust and scalable. The EDS PHB is a Diffserv PHB based on both loss rate and delay proportional differentiation. In this article, we start from a network layer implementing the EDS service differentiation and present a specific transport protocol that realizes the reliable and interactive transfer of short messages