HADOOP ADMINISTRATION Introduction to Hadoop

Big Data Characteristics - Velocity, Volume & Variety Structured and Unstructured Data Limitations of traditional large-scale systems How a distributed way of computing is superior (Scaling and Cost) Introduction to Hadoop and its eco-system

Hands on: Installation of Multiple nodes for clusters (Virtual Machines)

HDFS and Cluster overview
HDFS Overview and Architecture Types of Nodes (Name Node, Checkpoint Node, Backup Node) Configuration files and important parameters Data Replication Data Flow (Read & Write) Interfaces to HDFS (HTTP, CLI and Java API) Hadoop Archives

Hands on: HDFS Commands (for Data I/O)

MapReduce Anatomy & Data flow
Evolution and overview of MapReduce Data flow using Word Count Running a MapReduce Program from a JAR archive Monitoring a MapReduce Job Run MapReduce Job Tracker Web UI

Hands On: Running MR programs

MapReduce Schedulers
What is a Scheduler? A Detailed treatment of Capacity Scheduler A Detailed treatment of Fair Scheduler

Hands On: Installing/configuring of Oozie

Advanced Hadoop Cluster Architecture
Hadoop Rack Awareness Hadoop Configuration Management Environment Settings Configuration of the specifics of HDFS and MapReduce YARN - A Detailed Overview YARN Configuration Security in Hadoop

Hands on: Installation and configuration of Single/Multi node clusters on Virtual Machines
Hadoop Cluster Maintenance
Hadoop Directory Structure Safe Mode Hadoop Balancer File System Checker Commissioning & De-Commissioning Nodes Periodic Administration Tasks Name Node HA

Hands On: Monitoring of Hadoop with Nagios or Ganglia

Pig Dataflow Language
What is Pig? Pig Console - Grunt Pig Data Model

Input and Output

Hive Data Warehouse framework

Hive in the Hadoop Ecosystem Java vs. Hive: The Word Count Algorithm Hive Architecture

Hands On: Installing/configuring of Pig and Running Pig Scripts Hands On: Installing/configuring of Hive and Running Hive Queries Hands On: Installing/configuring of HBase with Zookeeper