Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Save to My Library
Look up keyword
Like this
6Activity
0 of .
Results for:
No results containing your search query
P. 1
雲端運算測試

雲端運算測試

Ratings: (0)|Views: 2,752|Likes:
Published by verating

More info:

Published by: verating on Nov 13, 2009
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

02/28/2011

pdf

text

original

CentOS-\u96f2\u7aef\u904b\u7b97\u5be6\u4f5c-\u5efa\u7f6e\u4e09\u6735\u96f2200 9
Edit by Vera
\u98011
CentOS-\u96f2\u7aef\u904b\u7b97\u5be6\u4f5c-\u5efa\u7f6e\u4e09\u6735\u96f2
CentOS5.3:\u5b89\u88dd hadoop
1\u5b89\u88dd jdk
1.1\u5b89\u88dd sun\u7684 java
1.1.1 # wget http://xxx/jdk-6u17-linux-i586-rpm.bin
1.1.2# sh jdk-6u17-linux-i586-rpm.bin (\u4f9d\u5e8f\u8f38\u5165 q,yes)
1.2\u67e5\u67e5\u770b\u88dd\u4e86\u90a3\u4e9b java,\u767c\u73fe\u6709\u5169\u500b\u7248\u672c
1.2.1 # rpm -qa | grep java

xmlrpc-javadoc-2.0.1-3jpp.1
sun-javadb-docs-10.4.2-1.1
sun-javadb-core-10.4.2-1.1
java-1.4.2-gcj-compat-1.4.2.0-40jpp.115
java-1.4.2-gcj-compat-devel-1.4.2.0-40jpp.115
java-1.4.2-gcj-compat-src-1.4.2.0-40jpp.115
sun-javadb-client-10.4.2-1.1
gcc-java-4.1.2-44.el5
java-1.4.2-gcj-compat-javadoc-1.4.2.0-40jpp.115
sun-javadb-demo-10.4.2-1.1
sun-javadb-common-10.4.2-1.1
bsh-javadoc-1.3.0-9jpp.1
sun-javadb-javadoc-10.4.2-1.1

1.3\u67e5\u8a62\u76ee\u524d\u57f7\u884c\u7684 java
1.3.1 # alternatives --config java
\u67091 \u7a0b\u5f0f\u63d0\u4f9b'java'\u3002
\u9078\u64c7
\u6307\u4ee4
-----------------------------------------------
*+ 1
/usr/lib/jvm/jre-1.4.2-gcj/bin/java
1.4\u76ee\u524d\u57f7\u884c\u7684 java\u7248\u672c
1.4.1 # java\u2013version
java version "1.4.2"
gij (GNU libgcj) version 4.1.2 20080704 (Red Hat 4.1.2-44)
CentOS-\u96f2\u7aef\u904b\u7b97\u5be6\u4f5c-\u5efa\u7f6e\u4e09\u6735\u96f2200 9
Edit by Vera
\u98012

Copyright (C) 2006 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is
NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.

1.5\u628a\u65b0\u88dd\u7684 sun java\u63db\u6210\u9810\u8a2d\u7684\u57f7\u884c java
1.5.1 # alternatives --install /usr/bin/java java
/usr/java/jdk1.6.0_17/bin/java 2
1.5.2 # alternatives --config java
\u67092 \u7a0b\u5f0f\u63d0\u4f9b'java'\u3002
\u9078\u64c7
\u6307\u4ee4
-----------------------------------------------
*+ 1
/usr/lib/jvm/jre-1.4.2-gcj/bin/java
2
/usr/java/jdk1.6.0_17/bin/java
\u8acb\u8f38\u5165\u4ee5\u4fdd\u7559\u76ee\u524d\u7684\u9078\u64c7[+]\uff0c\u6216\u8f38\u5165\u9078\u64c7\u865f\u78bc:2
1.5.3 # java\u2013version

java version "1.6.0_17"
Java(TM) SE Runtime Environment (build 1.6.0_17-b04)
Java HotSpot(TM) Client VM (build 14.3-b01, mixed mode, sharing)

2\u78ba\u8a8d\u6709\u5b89\u88dd rsync\u5957\u4ef6
2.1 # rpm -qa | grep rsync
rsync-2.6.8-3.1
3\u66f4\u6539 hostname
#hostname h176
\u6216#vi /etc/sysconfig/network \u6539HOSTNAME=h176
\u8981\u8a18\u5f97\u53bb/etc/hosts \u5167\u628a\u76f8\u95dc\u7684master \u548cslaves \u90fd\u8a2d\u5b9a\u4e0a\u53bb
4\u5b89\u88dd hadoop (\u8acb\u5148\u5efa\u7acb hadooper.hadooper\u7684\u4f7f\u7528\u8005\u53ca\u7fa4\u7d44)
4.1 #wget http://xxx / hadoop-0.20.1.tar.gz
4.2 #tar xvfz hadoop-0.20.1.tar.gz
4.3 #mv hadoop-0.20.1 /opt/hadoop
4.4 #chown -R hadooper.hadooper /opt/hadoop
5\u4fee\u6539 hadoop\u8a2d\u5b9a\u6a94 (/opt/hadoop/conf)
5.1$vi conf/hadoop-env.sh (\u4fee\u6539\u74b0\u5883\u8a2d\u5b9a\u6a94)
\u6700\u91cd\u8981\u662f\u4ee5\u4e0b\u7b2c\u4e00\u884c,\u4e00\u5b9a\u8981\u52a0.\u5176\u4ed6\u7684\u96a8\u610f.
export JAVA_HOME=/usr/java/jdk1.6.0_17
export HADOOP_HOME=/opt/hadoop
CentOS-\u96f2\u7aef\u904b\u7b97\u5be6\u4f5c-\u5efa\u7f6e\u4e09\u6735\u96f2200 9
Edit by Vera
\u98013

export HADOOP_CONF_DIR=/opt/hadoop/conf
export HADOOP_LOG_DIR=/tmp/hadoop/logs
export HADOOP_PID_DIR=/tmp/hadoop/pids

5.2 $vi conf/core-site.xml(\u52a0\u5165< propert y >\u5340\u9593\u7684\u5167\u5bb9)
<configuration>

<property>
<name>fs.default.name</name>
<value>hdfs://h176:9000</value>

</property>
</configuration>
5.3 $vi conf/hdfs-site.xml(\u52a0\u5165< propert y >\u5340\u9593\u7684\u5167\u5bb9)
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
5.4 $vi conf/mapred-site.xml(\u52a0\u5165< p rope rt y >\u5340\u9593\u7684\u5167\u5bb9)
<configuration>

<property>
<name>mapred.job.tracker</name>
<value>h176:9001</value>

</property>
</configuration>
5.5 $vi conf/salves(h17 6\u81ea\u5df1\u4e5f\u7576 datanode ,h2 26\u70ba s lav e )
h176
h226
5.6 $vi conf/masters (h176\u7576 master)
h176
6\u4ee5 hadooper\u4f7f\u7528\u8005\u5efa\u7acb ssh,\u4e26\u8b93\u5169\u53f0 pc\u4e92\u76f8\u8a8d\u8b49

$cd /home/hadooper
$ssh-keygen -t dsa
$cat id_dsa.pub >> authorized_keys
$ssh hadooper@h176- -->\u6e2c\u8a66\u662f\u5426\u80fd\u7121\u5bc6\u78bc\u767b\u5165\u672c\u6a5f

\u5982\u679c\u6e2c\u8a66\u4e0d\u6210\u529f,\u4ecd\u7136\u8981\u5bc6\u78bc,\u8acb\u8a2d\u5b9aauthorized_keys \u6a94\u6848\u6b0a\u9650\u70ba600(\u6b64\u6a94\u9664
\u4e86owner \u4e0d\u53ef\u6709\u5beb\u5165\u7684\u6b0a\u9650)
$scp id_dsa.pub hadooper@h226:~/--->\u5c07 ke y\u9001\u5230 h22 6\u7684 hado ope r\u5bb6\u76ee\u9304\u4e0a

Activity (6)

You've already reviewed this. Edit your review.
1 hundred reads
1 thousand reads
Garth Zhong liked this
賴點點 liked this
賞鴨 liked this
賞鴨 liked this

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->