Changes between Version 1 and Version 2 of HowToSetupHadoopCluster

Timestamp:

Jan 18, 2010, 10:05:18 PM (14 years ago)

Author:

claudiu.gheorghe

Comment:

--

HowToSetupHadoopCluster

@@ -3 +3 @@
 '''Step 2'''. After that, you can step further by following [http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster) the guide for dual-node setup]. [[BR]]
 '''Step 3'''. For extending the cluster and add the N-th slave to the cluster, you must do the following: 
-    '''Step 3.1''' Follow step 1 on the slave machine. [[BR]]
-    '''Step 3.2''' Set the hostname of the machine to a suggestive string, let's say ''slave-N''. [[BR]]
-    '''Step 3.3''' Add an entry to the master's /etc/hosts file like 
+    '''Step 3.1''' Follow step 1 on the ''slave-N'' machine. [[BR]]
+    '''Step 3.2''' Copy all the contents of the <HADOOP_DIR>/conf/ directory from a working slave configuration.[[BR]]
+    '''Step 3.3''' Set the hostname of the machine to a suggestive string, let's say ''slave-N''. [[BR]]
+    '''Step 3.4''' Add an entry to the master's /etc/hosts file like 
 {{{
 ...
@@ -11 +12 @@
 ...
 }}} 
-     where 10.10.10.10 is the ip of the slave-N machine. [[BR]]
-    '''Step 3.4''' Add the same entry added in master's /etc/hosts file to each other slave's /etc/hosts, so that every slave can resolve the name ''slave-N''.[[BR]]
-    '''Step 3.5''' Put the master's ssh public keys to ''slave-N''`s ~/.ssh directory, and check that
+     where 10.10.10.10 is the ip of the ''slave-N'' machine. [[BR]]
+    '''Step 3.5''' Add the same entry added in master's /etc/hosts file to each other slave's /etc/hosts, so that every slave can resolve the name ''slave-N''.[[BR]]
+    '''Step 3.6''' Put the master's ssh public keys to ''slave-N''`s ~/.ssh directory, and check that
 {{{
 #ssh slave-N
 }}}
     works without asking a passwsord. [[BR]]
-    '''Step 3.6''' Add a line with ''slave-N'' in the master's <HADOOP_DIR>/conf/slaves file.
+    '''Step 3.7''' Add a line with ''slave-N'' in the master's <HADOOP_DIR>/conf/slaves file.
 
 Make sure you install on each machine a Linux distribution that easily permits changing the computer's hostname. We have used Ubuntu 8.04 and Ubuntu 9.10 and it worked fine. We also tried with Fedora 10, but we didn't succeeded.