REWA ENGINEERING COLLEGE, REWA

BIG DATA PRACTICAL FILE

(SUBJECT CODE: CS-702 D)

SUBMITTED FOR PARTIAL FULFILLMENT OF THE REQUIREMENT FOR THE AWARD OF THE

DEGREE OF

BACHELOR OF ENGINEERING

IN

COMPUTER SCIENCE ENGINEERING

DEPARTMENT OF COMPUTER SCIENCE ENGINEERING

REWA ENGINEERING COLLEGE, REWA, (M. P.)

SESSION JUNE- DEC (2022)

Submitted by: Submitted to:

Amish Mishra Mr. Sanjay Verma
Enrolment no. 0301CS191014 Comp Science Engg. Dept.
 COMPUTER SCIENCE ENGINNERING DEPT.
Big Data Practical File (CS-702) LAB,VII-SEM (2022-22)

Student Name – Amish Mishra Roll no. -0301CS191014 Date:

Practical-1

Objective: - Installation of VMware to setup the Cloudera application for Hadoop

environment and its ecosystem.

Step 1: Download VMware then open the setup and install it.
Step 2: Download the “Cloudera Setup File” from and extract that zipped file on your hard drive.

Step 3: Start VMPlayer and click open a Virtual Machine. Browse the extracted folder and click
power on this virtual machine. It will open in a couple of minutes
Once it opens it will show the following welcome page.

Step 4: Check the Hadoop Cluster. Check if all nodes are running by entering the command “sudo
jps”.
 COMPUTER SCIENCE ENGINNERING DEPT.
Big Data Practical File (CS-702) LAB,VII-SEM (2022-22)

Student Name – Amish Mishra Roll no. -0301CS191014 Date:

Practical-2

Objective: - Using command lines of HDFS perform the below tasks:

 Create a directory named “Amish” in HDFS.

 Transfer a sample text file from your local file system to HDFS directory.
 List the files in HDFS directory
 Change the permission on the file to read, write, and execute.
 Remove the text file from HDFS directory.

A: Create a directory named “Amish” in HDFS.

We can create a directory in our HDFS server by using the command “hdfs dfs -mkdir”.
Then we can check our created directory by using the command “hdfs dfs -ls”.
B: Transfer a sample text file form our local file system to HDFS directory.
Then check the file.
Firstly we will create a sample text file by using touch command.
We will use “touch sample.txt” to create sample text in our local file system.

Then we will check our created file by using the “ls” command.
Then we will put our file from local to HDFS by using the command:
“hdfs dfs –put sample.txt /user/cloudera/Amish”
We can check it by using the command:
“hdfs dfs –ls /user/cloudera/Amish”

C: Change the permission on the file to read, write, and execute.

Firstly we will check our file by using the command:
“hdfs dfs –ls /user/cloudera/Amish”
Then we will change the permission by using the command:
“hdfs dfs -chmod 777 /user/cloudera/Amish/sample.txt”

D`: Remove the text file from HDFS directory

We can delete the file by using the command:
“hdfs dfs –rm /user/cloudera/Amish/sample.txt”