Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Save to My Library
Look up keyword
Like this
2Activity
0 of .
Results for:
No results containing your search query
P. 1
70 Everest-PGCon RT

70 Everest-PGCon RT

Ratings: (0)|Views: 230 |Likes:
Published by warwithin

More info:

Published by: warwithin on May 30, 2008
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

05/09/2014

pdf

text

original

 
Everest
Scaling to Petabytes
 
Yahoo!May 2008
 
2
Everest Architecture
ClientsQueryServerStorageServer
Massively Parallel (Tens of PB)
 –Commodity Clusters –Multi-tier scalability –Distributed Columnar Storage
Smart
 –Optimized compression –Parallel Vector Query Processing –Query and Storage optimizations –Query Expression and Columnar caching
Leverage PostgreSQL
 –Tools and Connectivity (ODBC) –extensibility –UDF & UDAF framework
Inexpensive
 –COTS
PostgreSQL LibEverest Extensions
Distributed QP
PostgreSQL Server Node Storage Manager 
VolumeVolume
 
Volume
PERL/Ruby.DBI
ADO.NETODBC
SegmentManager Scripts /Apps
PQLib
PgAdmin
SegmentationPlatform
Logical StorageManager StorageProvider StorageProxyAsynchronous CommunicationsTransServer QP
SharedMemory
Trans ProxyMgmt ProxyLSM Proxy
MgmtServicesStorageCacheStorageProvider StorageProxyAsynchronous CommunicationsStorageCache
ChunkStorage
Volume Storage Manager 
VolumeMetadataStorage Services
 
3
Performance and Scale
Data sizeEverest(min)Vendor A(min)Vendor B(min)90 TB
(600 B rows)
17741432530 TB
(200 B rows)
609591HW Cost(1 PB)250 12001200
Proven Petabytes scale in production
 –Approaching 2 PB, projected to grow > 30 PB by 2009 –Largest table: 3.5 Trillion rows (time partitioned)
10x Price-Performance relative to commercial systems
Performance comparison
010020030040050030 TB90 TB
Data size
   R   e   s   p   o   n   s   e   T   i   m   e   (   m   i   n   )
Vendor AVendor BEverest

Activity (2)

You've already reviewed this. Edit your review.
1 thousand reads
1 hundred reads

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->