Location of Repository

Fax: (217

By Abhishek Verma, Xavier Llorà, David E. Goldberg and Roy H. CampbellAbhishek Verma, Xavier Llorà, David E. Goldberg and Roy H. Campbell

Abstract

Genetic algorithms(GAs) are increasingly being applied to large scale problems. The traditional MPI-based parallel GAs require detailed knowledge about machine architecture. On the other hand, MapReduce is a powerful abstraction proposed by Google for making scalable and fault tolerant applications. In this paper, we show how genetic algorithms can be modeled into the MapReduce model. We describe the algorithm design and implementation of simple and compact GAs on Hadoop, an open source implementation of MapReduce. Our experiments demonstrate the convergence and scalability up to 10 5 and 10 8 variable problems respectively. Adding more resources would enable us to solve even larger problems without any changes in the algorithms and implementation since we do not introduce any performance bottlenecks.

Year: 2009
OAI identifier: oai:CiteSeerX.psu:10.1.1.173.2387
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://verma7.com/wp/wp-conten... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.