Article thumbnail

Testing Data Transformations in MapReduce Programs

By Jesús Morán, Claudio De La Riva and Javier Tuya

Abstract

MapReduce is a parallel data processing paradigm oriented to process large volumes of information in data-intensive applications, such as Big Data environments. A characteristic of these applications is that they can have different data sources and data formats. For these reasons, the inputs could contain some poor quality data that could produce a failure if the program functionality does not handle properly the variety of input data. The output of these programs is obtained from a number of input transformations that represent the program logic. This paper proposes the testing technique called MRFlow that is based on data flow test criteria and oriented to transformations analysis between the input and the output in order to detect defects in MapReduce programs. MRFlow is applied over some MapReduce programs and detects several defects

Topics: Data Flow Testing, MapReduce programs
Year: 2016
OAI identifier: oai:CiteSeerX.psu:10.1.1.736.2626
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://giis.uniovi.es/testing/... (external link)
  • http://giis.uniovi.es/testing/... (external link)
  • http://citeseerx.ist.psu.edu/v... (external link)

  • To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.

    Suggested articles