PAGE No.

DATE

Ohot Biq Dbta

Any Data. udhuch Can h chpiateunad by gvis

CenLde ter ba a Biq Doto alpe TBM1
3's e Biq Dato

Neun
Nauo
Velautu

NuomL
Scal e Oata
2S qnillien2500,000000,000,o0.oon)btas e dota aL
LSoatud each doy

Mautu
nt mb adato-
ShrurtAd dato RDRMS OataboAA (Oade &MuSG L)_
Sernu-Srutd dota- CS XMLJSON
Unakkiutod data iAudLVIdoImaae tmlo

Ve acut
Speod o Dota
00 Un php) e0 tacobak
600 MULan o eota en IuDttoa

SBllanSeoa chas en Geea

 PAGE No.
DATE

h y Riq Dota

Te peasg huge amaunt e daBa ühich raditRnal Sustm

a lnat capaala apociiin

Ste
Te procLAs hge amunt el dato uDe nead o
SHe Jt
AAL oUA AradtismSustams Capablu f6 Ste Sh
ma1ut amet al data ?
raddiaal sustam a NOTt te-shas Suh huge
Omeunt o data

KoData Sstom Kequument,

Ste AL I Aradtienal SLstem Capohlue steL Sudh
mallu amaint e Data 2
adiienal sushm al NOTit e ste such uae
ameunt ef doto

Prec9 roc2 hiaoe amGut dota in a elueat

DD and tmalu
manna
addiecal susfam al Nol Capabl fe bondla
Scauo SCals_eniilu e acchmedota arouOLq requiomeA
Tmdiheon ssum baNU SeLy
Lentoten,
Ste ma1gur
ameunt el Data
SCal ea3 o
meu mand dota arsos
Ste fecoD
T Scal
 PAGE No.

DATE

luOe uda Lus te buuld a Susto

Meneuth Dgtributod

enelthic
h peuDERL Sugtam wdh let e regeis

Outibuted-
u Smaulh Sustm (om teqehaa

Mensluthic
=A Sinau peeuL SexurA
Haad te add 1eieu s olt (eto umut
ReseULS

tel
Xeen
Preces30

RAM 8 GB Haad Dak I T6 CPU auad CeL

LMermeuu) (SteRaae (Cemptu).

NenslthiL Scalabla 2
Ng

2 re30u 8 2Xpeusinanu
MeAuthuArchitecau
Veatia Scaluung
CNet tru Scolua)
 PAGE No.

DATE

Dbrubuthd
Nede

6 Neda clusto
Many SmalL and chiap Cemput cema teqethar
e a t s a& a Sinqlu e t t
C& Dstaubutid Sustaan Scalohle ?
.Yeb
Diathibuted sustam a hneaala Seabla
2Xesou A=2X Speed

Dutrbutd Archtetu
siAntal Scalina
uo Scalunq)

Mernskthi O arbutad

That y whu Q aGed bq doto Sustam

bages en Dgrbutboo aidhteduA
 PAGENo.

DATE 7/

LObat Hadea

Hadep a lamaLOeak te Selure Biadoto

preblem).

Haddep Evelutien

n 2003, Gaeala reloaid a pape descaub heo

SkAL laae dotaset Thus pape Das callad a4
GES (Graeal Fl Sustam)
n2004, Gaeal releakad a pape te dasaubi had
epiGco 8 la3qe dataieb Thy ope u03 callud as
MapRedur
In 2006 1aheg *oek ha2 popes and mplumeaded
t
Shu mplomentaben e GES da) naned ag HOFS
Hadeep DLsmbut.d Fl Suslem)
ha mplumentatibr MapReduuca a2 namid ag_
Mapkedui (nchangedj

Hadaep L0
HOFS ditibutnd steage.
Mapkadaui La diabibuthd stoaqe
n 200 a d cap Cam unden Apachi SetDa
Tndatten and becem epen SSuLL

2513, Apachi relloosod HadAsp 2.0 te pr9ud mo

pen emanre enhanumenta
 PAGENo.
DATE

2003 2004 2006 2009 2013

fah8e Hadpep
undo
Hadb®p 2:0
GFS MR Amplumentaten Aparhu relrad

Hadoeo 1.0 Hodeep 2O

MapReduc MapReduuse XARN

HOFS HOFS

Obat g YARN 2
Yek Anethea Resou
NeaetiaeaA
Mauny reps.agibl faa Reseui manaqerment
J H

HadaEp Co ompenont3

HOFS MR ARN

Pirbtod DIstrdbud
StetoqeF mon0qema
 PAGE No.
DATE

HasBGp FELLstom.
Hbas
Sqeop
AR MR Afacha
SpakK
Hadeep
Susk9
tadeep C9L

Dato alhous tAa

buult ea ep eApach Had eep
meLdina data oul and analusia

A Sauptunq aqumee data manpulatiar Lan& m

unruct data nte shrudtunud mak

Saasp
A Cemmandli iodtalace applicaban tansing
data betuoeo selatecal dotabaAå and Had eep

Hbaa
Celumn-0Riennd NOSAL databoS hat runs en +op
HDES

A O9ukas shedulaa utemtemangq

- Aparhu iHadoepis
 PAGE No.

DATE
/

Opoak
A dufubuted aensalpuapeie un-memslu (emputi-enquy

rediutien te Spaik
A Spoak d a qenAa pup98 U0-memSYOrp
enqun
InHadaop_Clugtu
HOFS MapPeduc YARN
1
Stoiag Cempuur ReeuL
Enqin apRManaaer

HOFS apReduc YARN

HDFS SPARKk YARN

Cemput enon

A
plio andplau Camputa tna
Pluo t wth any Sa:0ge suem
Lecal Steuae/ HOFS Amanen S3
Pug uE Oh o Resur Manageh
YARN/MESoS/ KOBERNETES
 PAGE No.

DATE

Spak Cluatn

Cemput SPARK

SteRage Lecol/HDFS/ Aman en $3

Keseuu ARN/MESOS/ KuBERNETES

anagEN

Clent Taduty end.

CempudL SPARK

Steiog HOFS

YARN
ManaQA

poak wdttin in Scala

HLeNCA SPoik _ieiallu Suppets Tava,Scalathan
D
and R