PDAD: Parallel Data Analysis Diff

• Acronym: PDAD (who's your parallel daddy)
• SVN: ​https://svn-batch.grid.pub.ro/svn/PP2009/proiecte/PDAD
• Original repository that shows the project's evolution, on GoogleCode: ​http://code.google.com/p/pdad/
  • SVN project members: svn checkout ​https://pdad.googlecode.com/svn/trunk/ pdad --username google_username
  • SVN non-members: svn checkout ​http://pdad.googlecode.com/svn/trunk/ pdad-read-only

• Team members: Cristina Basescu - cristina.basescu, Claudiu-Dan Gheorghe - claudiu.gheorghe
• Project description: compare data analysis performed using (a) ​Hadoop's MapReduce (b) ​Hadoop's Pig (c) ​MPI
• ​Presentation

Contents

• Introduction
  • Motivation
  • Goals
  • Hadoop Framework
  • MPI
• Applications
  • MapReduce
  • Pig
  • MPI
• Performance Analysis
  • Testing Infrastructure
  • Parameters
  • Results
• Conclusions

HowTo setup a Hadoop cluster