Scribd Logo
Upload

Welcome to Scribd!

  • Big Data and Hadoop Essentials

    Uploaded by

    rinki
    10 views33 pages
    The document discusses big data concepts and Hadoop essentials. It provides an overview of big data challenges and how Hadoop addresses them through its core components: HDFS for storage, MapReduce for processing, and YARN for resource management. The document also outlines the history of Apache Hadoop and describes its ecosystem of related projects and distributions from different vendors that offer Hadoop as a hosted solution.

    Original Description:

    big data and hadoop basics

    Original Title

    Big Data and Hadoop Essentials.pptx

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses big data concepts and Hadoop essentials. It provides an overview of big data challenges and how Hadoop addresses them through its core components: HDFS for storage, MapReduce for processing, and YARN for resource management. The document also outlines the history of Apache Hadoop and describes its ecosystem of related projects and distributions from different vendors that offer Hadoop as a hosted solution.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    10 views33 pages

    Big Data and Hadoop Essentials

    Uploaded by

    rinki
    The document discusses big data concepts and Hadoop essentials. It provides an overview of big data challenges and how Hadoop addresses them through its core components: HDFS for storage, MapReduce for processing, and YARN for resource management. The document also outlines the history of Apache Hadoop and describes its ecosystem of related projects and distributions from different vendors that offer Hadoop as a hosted solution.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 33

    Big Data and Hadoop Essentials

    Harsha Vachhani
    July 23, 2017
    Google Developer Group
    Women Techmakers
    Event
    Table of Contents
    Big Data Concept, Origin, Usecase

    Big Data challenges, traditional solutions, Comparison between RDBMS

    and Hadoop

    Hadoop - Introduction, Origin

    Hadoop Architecture - HDFS and Mapreduce

    Hadoop Ecosystem

    Hadoop Distributions

    2
    3
    3 Vs of Big Data

    4
    5
    6
    7
    8
    9
    10
    History of Apache Hadoop

    11
    Core Hadoop Framework

    12
    Why we need a file system

    13
    14
    15
    16
    17
    18
    Mapreduce

    19
    Mapreduce

    20
    Mapreduce

    21
    22
    MapReduce Example

    23
    24
    YARN
    Key Benefits of Hadoop
    2.0 YARN Component-

    It offers improved
    cluster utilization
    Highly scalable
    Beyond Java
    Novel programming
    models and services
    Agility

    25
    Hadoop Cluster

    26
    Hadoop Ecosystem

    27
    28
    29
    30
    31
    Hadoop Distribution - Vendors and
    Hosting

    32
    Thank You

    33

    You might also like