Location of Repository

VSEncoding: Efficient Coding and Fast Decoding of Integer Lists via Dynamic Programming

By Fabrizio Silvestri and Rossano Venturini

Abstract

Encoding lists of integers efficiently is important for many applications in different fields. Adjacency lists of large graphs are usually encoded to save space and to improve decoding speed. Inverted indexes of Information Retrieval systems keep the lists of postings compressed in order to exploit the memory hierarchy. Secondary indexes of DBMSs are stored similarly to inverted indexes in IR systems. In this paper we propose Vector of Splits Encoding (VSEncoding), a novel class of encoders that work by optimally partitioning a list of integers into blocks which are efficiently compressed by using simple encoders. In previous works heuristics were applied during the partitioning step. Instead, we find the optimal solution by using a dynamic programming approach. Experiments show that our class of encoders outperform all the existing methods in literature by more than 10 % (with the exception of Binary Interpolative Coding with which they, roughly, tie) still retaining a very fast decompression algorithm

Year: 2010
OAI identifier: oai:CiteSeerX.psu:10.1.1.188.3182
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://hpc.isti.cnr.it/%7Eross... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.