Skip to main content
Article thumbnail
Location of Repository

FastCARS: Fast, Correlation-Aware Sampling for Network Data Mining

By 

Abstract

Abstract—Technology trends are making it more and more difficult to observe and record the large amount of data generated by high speed links. Traffic sampling techniques provide a simple alternative that reduces the volume of data collected. Unfortunately, existing sampling techniques largely hide any temporal relationship in the recorded data. Our proposed method, “FastCARS ” naturally captures statistics for packets that are 1, 2 or more steps away. It has the following properties: (a) provides accurate measurements of a full trace’s statistics, (b) is simple and can be easily implemented, (c) captures correlations between successive packets, as well as packets that are further apart, (d) generalizes previously proposed sampling methods and includes them as special cases, and (e) is scalable and flexible to account for prior knowledge about the characteristics of traces. We also propose several new tools for network data mining that use the information provided by FastCARS. The experimental results on multiple, real-world datasets (233Mb in total), show that the proposed FastCARS sampling method and these new data mining tools are effective. With these tools, we show that the independence assumption of packet arrival is not correct, and that packet trains may not be the only cause of dependence among arrivals. Index Terms—Traffic analysis, sampling I

Year: 2009
OAI identifier: oai:CiteSeerX.psu:10.1.1.135.8839
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://www.informedia.cs.cmu.e... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.