Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Save to My Library
Look up keyword
Like this
1Activity
0 of .
Results for:
No results containing your search query
P. 1
Hadoop Cluster Setup

Hadoop Cluster Setup

Ratings: (0)|Views: 13 |Likes:
Published by bispsolutions

More info:

Published by: bispsolutions on Apr 24, 2013
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as DOC, PDF, TXT or read online from Scribd
See more
See less

06/18/2013

pdf

text

original

 
Configuring Hadoop Cluster on multiplemachine
Agenda
Modify your hosts fileSSH from master to all slavesSSH to all slaves to masterEdit masters fileEdit slaves fileModify hadoop-env.sh fileModify core-site.xml fileModify hdfs-site.xml fileModify mapred-site.xml fileFormatting of name nodeStart Hadoop clusterStop Hadoop cluster
Modify your hosts file
Hosts file contains mapping of ip to hostnameEdit your hosts file by typing the below command inyour terminal
 
sudo vi /etc/hosts
Add entries for master & slaves
Repeat the same step on all master/slaves machines
.
 
Master needs to communicate with each slavemachine
 There should be passwordless ssh from mastermachine to slave machineFollow the 3 commands to set passwordless ssh from master to slaveusername@
master
:~> ssh-keygen -t rsausername@
master
:~> ssh username@
slave1
mkdir -p .sshusername@
master
:~> cat .ssh/id_rsa.pub | ssh username@
slave1
'cat>> .ssh/authorized_keys'Repeat the same steps for each slave machine.
Each slave needs to communicate with mastermachine
 There should be passwordless ssh from each slavemachine to master machineFollow the 3 commands to set passwordless ssh fromslave to masterusername@
slave1
:~> ssh-keygen -t rsausername@
slave1
:~> ssh username@
master
mkdir -p .sshusername@
slave1
:~> cat .ssh/id_rsa.pub | ssh username@
master
'cat>> .ssh/authorized_keys'Repeat the same steps on each slave machine

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->