Professional Documents
Culture Documents
www.skillpeed.com Page 1
Step 3: Extract the file in a location on your machine
Now your VMware would look like the image given below. Click on edit virtual machine setting
www.skillpeed.com Page 2
Step 6: Increase your VMware memory min (6 GB), then click ok.
www.skillpeed.com Page 3
Now click on play virtual machine
www.skillpeed.com Page 4
Step 7: Click on Terminal
www.skillpeed.com Page 5
Step 8: Install Java and add the repository as shown in screenshot below:
www.skillpeed.com Page 6
Step 10: Now update your system
It will take some minutes to complete. After completion the screen will look below:
www.skillpeed.com Page 7
www.skillpeed.com Page 8
Step 11: Now invoke the Java-7-installer as shown below:
www.skillpeed.com Page 9
Step 12: Click on Yes
www.skillpeed.com Page 10
Step 13: Java installation will continue for some time. Once it is complete, the screen
would look like the following:
www.skillpeed.com Page 11
Step 15: Now install openssh server
www.skillpeed.com Page 12
Step 17: Just press enter for password, dont enter any password by yourself. Once done it
will look like below:
www.skillpeed.com Page 13
Step 19: Test ssh acces
www.skillpeed.com Page 14
Step 21: Add the lines shown in screenshot below:
# IPv6 disabled
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1
Step 23: Once you restart the machine test if IPv6 is disabled, your output should be as
shown in the screenshot below:
www.skillpeed.com Page 15
Step 24: Now we are ready for Hadoop Installation
http://supergsego.com/apache/hadoop/common/hadoop-2.6.0/
www.skillpeed.com Page 16
Step 26: You would see Hadoop folder as follows
www.skillpeed.com Page 17
# -- HADOOP ENVIRONMENT VARIABLES START -- #
export JAVA_HOME=/usr/lib/jvm/java-7-oracle
export HADOOP_HOME=/home/user/hadoop-2.6.0
export PATH=$PATH:$HADOOP_HOME/bin
export PATH=$PATH:$HADOOP_HOME/sbin
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export YARN_HOME=$HADOOP_HOME
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"
Step 29: You should now close the terminal and open a new terminal to check Hadoop
and Java homes as shown below: Write command
echo $JAVA_HOME
echo $HADOOP_INSTALL
www.skillpeed.com Page 18
Step 31: Add the highlighted lines as shown below:
export JAVA_HOME=/usr/lib/jvm/java-7-oracle
Step 32:Open edit core-site.xml and add the highlighted lines as shown below:
www.skillpeed.com Page 19
Step 33: Edit core-site.xml as followed and add the highlighted lines as shown below:
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
www.skillpeed.com Page 20
Step 34: Open yarn-sit.xml
Step 35: Edit yarn-site.xml as follows and add the highlighted lines as shown below:
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
www.skillpeed.com Page 21
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>
www.skillpeed.com Page 22
Step 36: Open mapred-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
www.skillpeed.com Page 23
</configuration>
Step 38: For hdfs - Create two directories for Hadoop storage
www.skillpeed.com Page 24
Step 40: Add the highlighted lines as shown below:
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/home/user/hadoop_tmp/hdfs/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
www.skillpeed.com Page 25
<value>file:/home/user/hadoop_tmp/hdfs/datanode</value>
</property>
</configuration>
www.skillpeed.com Page 26
Step 43: You can confirm the services by running jps command as shown below:
Link :- localhost:50070
www.skillpeed.com Page 27
Link :- http://localhost:50070/dfshealth.jsp
www.skillpeed.com Page 28