Big Data Analytics Practicals

Name: Azam Salim Bombaywale

Seat No. 20298
Slip No: 8
1. Demontrate the use of following Hadoop commands
1. –cp
Output:
[hdfs@hadoop ~]$ hdfs dfs -ls /
Found 4 items
drwxr-xr-x   - hdfs supergroup          0 2022-02-25 05:01 /example
drwxr-xr-x   - hdfs supergroup          0 2022-02-25 05:00 /sample
drwxr-xr-x   - hdfs supergroup          0 2022-02-24 04:53 /temp
drwxr-xr-x   - hdfs supergroup          0 2022-02-24 04:59 /user
[hdfs@hadoop ~]$ hdfs dfs -ls /user
Found 2 items
-rw-r--r--   1 hdfs supergroup          0 2022-02-24 04:55 /user/Jaid
-rw-r--r--   1 hdfs supergroup         60 2022-02-24 04:59 /user/msc
[hdfs@hadoop ~]$ hadoop fs -cp /user/msc /temp
[hdfs@hadoop ~]$ hdfs dfs -ls /temp
Found 1 items
-rw-r--r--   1 hdfs supergroup         60 2022-02-25 05:03 /temp/msc

2. –chown
Output:
[hdfs@hadoop ~]$ hdfs dfs -ls /
Found 4 items
drwxr-xr-x   - hdfs supergroup          0 2022-02-25 05:01 /example
drwxr-xr-x   - hdfs supergroup          0 2022-02-25 05:00 /sample
drwxr-xr-x   - hdfs supergroup          0 2022-02-24 04:53 /temp
drwxr-xr-x   - hdfs supergroup          0 2022-02-24 04:59 /user
[hdfs@hadoop ~]$ hadoop fs –chown newhdfs /temp
[hdfs@hadoop ~]$ hdfs dfs -ls /
Found 4 items
drwxr-xr-x   - hdfs supergroup          0 2022-02-25 05:01 /example
drwxr-xr-x   - hdfs supergroup          0 2022-02-25 05:00 /sample
drwxr-xr-x   - newhdfs supergroup          0 2022-02-24 04:53 /temp
drwxr-xr-x   - hdfs supergroup          0 2022-02-24 04:59 /user
3.setrep
 Output:
ubuntu@ip-172-31-40-205:~$ hadoop fs -ls /
Found 6 items
drwxrwxrwx   - Faizan faizan              0 2022-02-25 06:10 /Faizan
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 06:17 /Saad
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 06:22 /afnan
-rw-r--r--   1 ubuntu supergroup         16 2022-02-25 06:18 /test1.txt
drwxr-xr-x   - Faizan supergroup          0 2022-02-25 06:19 /user
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 04:45 /usr
ubuntu@ip-172-31-40-205:~$ hadoop fs -setrep 2 /user
Replication 2 set: hdfs://localhost:9000/user/afnan
Replication 2 set: hdfs://localhost:9000/user/khalid
ubuntu@ip-172-31-40-205:~$
4.–ls

Output:
ubuntu@ip-172-31-40-205:~$ hadoop fs -ls /
Found 6 items
drwxrwxrwx   - Faizan faizan              0 2022-02-25 06:10 /Faizan
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 06:17 /Saad
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 06:22 /afnan
-rw-r--r--   1 ubuntu supergroup         16 2022-02-25 06:18 /test1.txt
drwxr-xr-x   - Faizan supergroup          0 2022-02-25 06:19 /user
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 04:45 /usr
5.-mv

Output:
ubuntu@ip-172-31-40-205:~$ hadoop fs -ls /
Found 5 items
drwxrwxrwx   - Faizan faizan              0 2022-02-25 06:10 /Faizan
drwxr-xr-x   - Saad   supergroup          0 2022-02-25 06:29 /Saad
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 06:22 /afnan
drwxr-xr-x   - Faizan supergroup          0 2022-02-25 06:33 /user
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 04:45 /usr
ubuntu@ip-172-31-40-205:~$ hadoop fs -mv /afnan /usr
ubuntu@ip-172-31-40-205:~$ hadoop fs -ls /usr
Found 2 items
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 06:22 /usr/afnan
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 04:45 /usr/local
ubuntu@ip-172-31-40-205:~$

2.Display last 10 lines of any file log

Output:
ubuntu@ip-172-31-40-205:~$ hadoop fs -ls /user
Found 6 items
-rw-r--r--   2 ubuntu supergroup         16 2022-02-25 06:19 /user/afnan
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 05:40 /user/hadoop
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 04:52 /user/huzaif
-rw-r--r--   2 ubuntu supergroup         26 2022-02-25 05:06 /user/khalid
-rw-r--r--   1 ubuntu supergroup         16 2022-02-25 06:18 /user/test1.txt
drwxr-xr-x   - ubuntu supergroup          0 2022-02-25 06:38 /user/ubuntu
ubuntu@ip-172-31-40-205:~$ hadoop fs -tail /user/test1.txt
Hello Testing 1
ubuntu@ip-172-31-40-205:~$