Geospatial big data analysis in a computer cluster environment for earth observation applications

Εθνικό Μετσόβιο Πολυτεχνείο--Μεταπτυχιακή Εργασία. Διεπιστημονικό-Διατμηματικό Πρόγραμμα Μεταπτυχιακών Σπουδών (Δ.Π.Μ.Σ.) “Γεωπληροφορική

Productivity frameworks in big data image processing computations - Creating photographic mosaics with Hadoop and Scalding

AbstractIn the last decade, Hadoop has become a de-facto standard framework for big data processing in the industry. Although Hadoop today is primarily applied to textual data, it can be also used to process binary data including images. A number of frameworks have been developed to increase productivity of developing Hadoop based solutions. This paper demonstrates how such a framework (Scalding) can be used to create a concise and efficient solution to a big data image-processing problem of creating photographic mosaics and compares it to a Hadoop API based implementation