Skip to main content
Article thumbnail
Location of Repository

The Single Pixel GPS: Learning Big Data Signals from Tiny Coresets

By Dan Feldman, Cynthia Sung and Daniela Rus

Abstract

We present algorithms for simplifying and clustering patterns from sensors such as GPS, LiDAR, and other devices that can produce high-dimensional signals. The algorithms are suitable for handling very large (e.g. terabytes) streaming data and can be run in parallel on networks or clouds. Applications include compression, denoising, activity recognition, road matching, and map generation. We encode these problems as (k, m)-segment mean problems. Formally, we provide (1 + ε)-approximations to the k-segment and (k, m)-segment mean of a d-dimensional discretetime signal. The k-segment mean is a k-piecewise linear function that minimizes the regression distance to the signal. The (k, m)-segment mean has an additional constraint that the projection of the k segments on R d consists of only m ≤ k segments. Existing algorithms for these problems take O(kn 2) and n O(mk) time respectively and O(kn 2) space, where n is the length of the signal. Our main tool is a new coreset for discrete-time signals. The coreset is a smart compression of the input signal that allows computation of a (1 + ε)-approximation to the k-segment or (k, m)-segment mean in O(n log n) time for arbitrary constants ε, k, and m. We use coresets to obtain a parallel algorithm that scans the signal in one pass, using space and update time per point that is polynomial in log n. We provide empirical evaluations of the quality of our coreset and experimental results that show how our coreset boosts both inefficient optimal algorithms and existing heuristics. We demonstrate our results for extracting signals from GPS traces. However, the results are more general and applicable to other types of sensors

Year: 2013
OAI identifier: oai:CiteSeerX.psu:10.1.1.353.5266
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://people.csail.mit.edu/da... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.