You are on page 1of 1

Drive

link:https://drive.google.com/drive/folders/1bQ5a0EdlEFXR68A8ZSdb8WtP5QAsqYpF?
usp=drive_link

Delete all hadoop and java files if already exist and use the above jdk and hadoop.

Extract bigdata tar file in c drive.

Install java jdk 13.

set environment variables:


HADOOP_HOME:C:\BigData\hadoop-3.2.2
SPARK_HOME:C:\BigData\spark-3.1.2-bin-hadoop3.2
JAVA_HOME:C:\Program Files\Java\jdk-11.0.13

path: C:\BigData\hadoop-3.2.2\bin
C:\BigData\hadoop-3.2.2\sbin
C:\BigData\spark-3.1.2-bin-hadoop3.2\binhdfs
C:\BigData\spark-3.1.2-bin-hadoop3.2\sbin

goto C:\BigData\hadoop-3.2.2\etc\hadoop\hadoop-env.cmd
edit this file with notepad++ scrolldown and change (set HADOOP_IDENT_STRING=
%USERNAME%)

run spark-shell in cmd.

Open another cmd as Administrator


Type hdfs namenode -format
Type start-dfs
check using jps

Type start-yarn
check using jps

Go to browser and check whether the localhost is running on port 9870 and 8088

You might also like