SCHOOL OF GRADUATING STUDIES

COLLEGE OF COMPUTING AND INFORMATICS

DEPARTMENT OF COMPUTER SCIENCE
M.SC. Program in computer science
Course: selected topics in computer science
Hadoop Configuration Report:Assingment

Prepared By:
Name ID
1. Nuredin Abdumalik PGP/1056/14

Mar, 2022

Haramaya University, Ethiopia

Submitted to Abebe Belay (PhD)

 System Setup (VirtualBox, Java, Hadoop)

A) VirtualBox Installation –

Download and Installation of Oracle VirtualBox 5.1.18 for Windows10

NOTE: Used all of the default settings

Application successfully installed!

B) Download and installation of Ubuntu Desktop 16.04.2

 Issue: How access files from local laptop with virtual server?
Resolution: Create shared folder on the VirtualBox and mount the drive on the Linux instance.
Note: To share files between Host & Guest – see last entry in this exchange:

http://unix.stackexchange.com/questions/16199/how-to-transfer-files-from-windows-to-ubuntu-onvirtualbox

Steps to share files:

1. Before starting your Guest

2. Go to VirtualBox Manager
3. Select your interested Guest
4. Go to Guest Settings
5. In Guest Settings, scroll the left side-menu, and go to Shared Folders
6. In Shared Folders, add your interested folder in the Host machine
7. After adding your Host folder path, you will see an updated Folders List in Shared Folders. Remember your
newly folder Name shown in this list. Say it is HOST_SHARE
8. Click OK and save your changes.
9. Start your Guest machine
10. In Guest machine, create a new folder, e.g. GUEST SHARE
11. In Guest terminal, type

sudo mount -t vboxsf HOST_SHARE GUEST_SHARE

12. You shall find your stuff in this GUEST_SHARE folder.

B) Installing Hadoop

1) Copying Hadoop download from local to server & extract the Hadoop files:
 Export the new Hadoop path to the .bashrc file

2) Java Setup:
Remove open JDK versions of Java:

Verify current version of Java installed:

Installed the needed Java files/folders::

Update .bashrc file with JAVA information

Run ‘source ~/.bashrc’ command for changes to take affec t

 Verify JAVA_HOME setting after update:

3) SSH Setup
Install SSH package:

SSH to the localhost

Generate RSA key, add key to new folder, and then update the permissions on the
folder:

4) Hadoop Setup
Go to location of Hadoop configuration files:

Update several configuration files:

Update bashrc file to contain the updated path for Hadoop & ‘source’ the file so the
changes take effect:

Format the Namenode:

 Navigate back to Hadoop folder, start the dfs, then verify processes running with ‘jps’
command:

SUCCESS!!

Create directory for MapReduce use:

Test HDFS is working:

Results after -put command:

Test MapReduce:
Check Hadoop commands available:

Check processes running after starting YARN: