Article thumbnail

Retaining data from streams of social platforms with minimal regret

By Nguyen Thanh Tam, Matthias Weidlich, Duong Chi Thang, Hongzhi Yin and Nguyen Quoc Viet Hung


Today's social platforms, such as Twitter and Facebook, continuously generate massive volumes of data. The resulting data streams exceed any reasonable limit for permanent storage, especially since data is often redundant, overlapping, sparse, and generally of low value. This calls for means to retain solely a small fraction of the data in an online manner. In this paper, we propose techniques to effectively decide which data to retain, such that the induced loss of information, the regret of neglecting certain data, is minimized. These techniques enable not only efficient processing of massive streaming data, but are also adaptive and address the dynamic nature of social media. Experiments on large-scale real-world datasets illustrate the feasibility of our approach in terms of both, runtime and information quality

Topics: 1702 Artificial Intelligence
Publisher: 'International Joint Conferences on Artificial Intelligence'
Year: 2017
DOI identifier: 10.24963/ijcai.2017/397
OAI identifier:
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • (external link)

  • To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.

    Suggested articles