Changes between Version 2 and Version 3 of PDAD_Performance
- Timestamp:
- Jan 14, 2010, 12:19:39 PM (14 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
PDAD_Performance
v2 v3 7 7 8 8 9 We have used a maximum of four computers from ED202, running Ubuntu 8.04, Hadoop 0.20.1, Pig 0.5.0 and mpich2. As the main idea of a distributed system is to use commodity hardware, we did not consider the nodes' hardware structure as relevant.9 As the main idea of a distributed system is to use commodity hardware, we have used a maximum of four computers from ED202, running Ubuntu 8.04, Hadoop 0.20.1, Pig 0.5.0. They were interconnected using a Gigabit switch, so as to obtain the maximum from infrastructure's point of view. 10 10 11 11 12 The first test scenario uses two nodes. For the Hadoop Framework, one of them is master, having in the same time master attributions (namenode - keeps the structure of the file system, jobTracker - keeps track of the jobs' execution), taskTracker - keeps track of the tasks 12 The first test scenario uses two nodes. For the Hadoop Framework, one of them is master, having in the same time master attributions (namenode - keeps the structure of the file system, jobTracker - keeps track of the jobs' execution), taskTracker - keeps track of the tasks... 13 14 // TODO Claudiu 13 15 14 16