You are on page 1of 45

Introduction to Google Cloud Platform

Abdelrahman Omran | @Omranic | me@omranic.com


Code of Conduct
Be excellent to each other. Speak up if you see or hear something.
Treat everyone with respect. Participate while Harassment is not tolerated, and you are empowered
acknowledging that everyone deserves to be here — and to politely engage when you or others are
each of us has the right to enjoy our experience without fear disrespected. The person making you feel
of harassment, discrimination, or condescension, whether uncomfortable may not be aware of what they are
blatant or via micro-aggressions. Jokes shouldn’t demean doing, and politely bringing their behavior to their
others. Consider what you are saying and how it would feel attention is encouraged.
if it were said to or about you.

In case you see or hear something or feel


Practice saying "Yes and" to each other. uncomfortable, reach out to dev-mena@google.com

It’s a theatre improv technique to build on each other’s


ideas. We all benefit when we create together.
Abdelrahman Omran
Software Architect | @Omranic | me@omranic.com
A bit of history, about me!
Recent Career Expertise
A proficient multi-skilled Software Architect with more than Certified by Google as an expert in four major
12+ years of experience in software industry. Worked with technologies, web, cloud, assistant, identity. I’m
many national and international companies, recently – passionate and experienced in the following fields –

→ Technology Innovation & Entrepreneurship Center (TIEC) → Web Technologies

→ United Nations Development Program - UNDP → Google Cloud Platform

→ Midade co. → Backend Development

→ Intel Inc. → Software Architecture

→ Rinvex → Google Assistant

→ Google Identity
A bit of history, about me!
People Impacted Speeches & Trainings
→ 2015 – 6 sessions / 920+ attendees → Egypt → United States of America

→ 2016 – 12 session / 1380+ attendees → Emirates → Saudi Arabia

→ 2017 – 23 session / 4395+ attendees → Bahrain → Lebanon

→ 2018 – 28 session / 18,943+ direct reach (August '18) → Poland → Jordan

→ Tunisia → Qatar
Plus+
I’m Open source addicted! In My Team
→ 70+ open source projects → We’re passionate about quality and efficiency

→ Active open source contributor → My MOTTO is Value . Reach .Impact

→ 100k+ actively maintained lines of code

→ Hundreds of thousands lines of code written

→ 5500+ github contributions to open-source projects


Public Presentations
Recent Public Presentations
→ State of the WEB '18 (goo.gl/2Ag6My)

→ Using Dialogflow to build actions for Google Assistant '18 (goo.gl/BDvX7s)

→ Building Conversational Experiences for Google Assistant '18 (goo.gl/BDvX7s)

→ Make the most out of a conference - MENAIO Summit '18 (goo.gl/XKx6MW)

→ All for one & one for all - MENAIO Summit '18 (goo.gl/KZWabk)

→ Google Cloud Platform Study Jam - March'18 (goo.gl/aC75ck)

→ The Web Platform - State of the Union '17 (goo.gl/5q3h4d)

→ Progressive Web Apps keynote '17 (goo.gl/P604rU)

→ Building for Google Assistant ‘17 (goo.gl/p4MnkR)


Cloud Models
GCP Services
Google Cloud Platform Services

Compute Big Data Identity & Security

Compute App Container Cloud Cloud Cloud Cloud Resource Cloud Security Key
Engine Engine Engine BigQuery Cloud IAM
Dataflow Dataproc Dataprep Manager Scanner Management
Service

Cloud Container- Cloud Cloud Data Data Loss Identity-Aware Security Key
GPU Genomics BeyondCorp
Functions Optimized OS Datalab Pub/Sub Studio Prevention API Proxy Enforcement
BETA BETA

Internet of Things Machine Learning Storage & Databases


BETA

Cloud IoT Cloud Machine Cloud Cloud Cloud Video Cloud Cloud Cloud Data
Core Learning Vision API Speech API Intelligence Storage Bigtable Datastore Transfer
API Appliance
Private
BETA

Cloud Natural Cloud Cloud Advanced Cloud Persistent


Cloud SQL
Language API Translation Jobs API Solutions Lab Spanner Disk
API ALPHA
The Products logos contained in this icon library may be used freely and without permission to accurately reference Google's technology and tools, for instance in books or architecture diagrams. 11
Google Cloud Platform Services

Management Tools Networking

Error Virtual Cloud Load Cloud Cloud Cloud Cloud


Stackdriver Monitoring Logging Trace
Reporting Private Cloud Balancing CDN External IP Firewall Rules Router
Addresses

Cloud Cloud Cloud Cloud Cloud Cloud Cloud Cloud Partner


Debugger Cloud DNS Cloud VPN
Deployment Endpoints Console Shell Interconnect Network Routes Interconnect
Manager

Developer Tools

Cloud Mobile Cloud Cloud


App Billing API APIs

Cloud Cloud Source Cloud Cloud Tools Container


Cloud SDK
Deployment Repositories Tools for for IntelliJ Builder
Open Source
Manager Android Studio

Kubenetes TensorFlow Cloud Cloud Container Google Plug-in Cloud Test


Tools for Tools for Registry for Eclipse Lab
PowerShell Visual Studio

The Products logos contained in this icon library may be used freely and without permission to accurately reference Google's technology and tools, for instance in books or architecture diagrams. 12
GCP Compute
Compute Engine
IaaS
Compute, Storage & Network
Run VMs on Google Infrastructure
Billing, 1st minute then per second
Up to 96 cores and 624 GB memory
Predefined & Custom machine types
Sustained and committed usage discount
App Engine
PaaS
Free quota
Auto scaling
Lego-like services
Massively scalable
You, your app and Google
Java, Python, PHP, Go, .Net, Node.js, custom
Services Powered by App Engine

● Khan Academy
○ Non for profit educational organisation
○ 10 million unique users / month, 300+ million lessons, 5000+
videos

● Snapchat
○ Photo and video messaging app
○ 100 million active users / day, 8,796 photos shared / second, 7
billion video views / day

● Rovio
○ Mobile / Web games
○ 140+ million downloads, 13+ million users / month
Typical Web App Architecture
Operating System

n g
ni
s
ation

Tu
i c

on
Ap p l

f
ig
Indexes

ur
a
tio
ns
Maintenance

Are you willing to do all the hard work?!


If no, then follow me in the next step..

ity
bil
Secu Sh

ala
rity P ard
atch

Sc
es ing
Har
s den
Fa ilure Replication ing
dw are
Har
Typical Web App Architecture

Ca r e
n ’ t
Do
With Google App Engine
And if you had high traffic..
We’ve got your back! App Engine lets you go big from 1st day!
Container Engine
Infrastructure as Code
Docker Support
Fully Managed Kubernetes Clusters
Highly Scalable
Private Container Registry
BETA

Cloud Function
Serverless Model
Integrated with: PubSub, Datastore, etc.
Mobile Ready: Execute from Firebase
Support for Node.js
Pay only for function execution
Use Cases

● Mobile Backend
● APIs, Microservices
● IoT
● HTTP Hooks
● ETL
GCP Storage
Cloud Storage
IaaS
Multi-petabytes Object storage
Globally replicated
Highly available and reliable
Flexible security models
Cloud SQL
Relational MySQL database
Fully managed
Highly available
Auto backup
MySQL + PostgresQL
Cloud Datastore
NoSQL like solution
Fully managed
Highly available and scalable
Flexible access
Autoscaled
BigQuery
Columnar Database
Big Data Warehouse
SQL like queries
Analyse terabytes of data
Streaming data
Batch processing
Cloud Spanner
Relational Database
Horizontally scalable
High performance & availability
Automatic replication
Fully managed
Cloud Bigtable
Massively scalable NoSQL
Low latency, High throughput
Good for both operational + analytical
Seamless cluster resizing
Fully managed
Building your own solution is like LEGO
GCP Data Processing
Big Data & Challenges
● Big data is data that is so large and complex that it becomes difficult to
process using traditional tools.
● Widely characterised in terms of three dimensions (3Vs):
○ Volume: massive datasets (terabytes, petabytes,...)
○ Variety: different kinds of data (structured, semi-structured and unstructured).
○ Velocity: the rate at which the data is generated from batch to real time.
● Traditional OLTP and data warehouse (ETL, data marts and star schemas)
only deals with structured data
● Web logs, social media, device logs, Cisco netflow collector, etc. Nothing
done all data is archived or deleted
● Schema on Write is not suitable for such data
● Opportunities lost (Insights, etc.)
Big Data on GCP Zero-ops, serverless Big Data architecture

Cloud Dataproc. Managed


Cloud Pub/Sub (robust publish/subscribe
Spark Hadoop clusters messaging system) - Injest

Cloud Dataflow (realtime data pipeline, batch


+ stream) - Process

BigQuery/Bigtable (HBase compatible) -


Store/Analyze

Cloud Datalab - Analyze


IoT Core
Architecture: General > Real Time Stream Processing - Internet of Things

Constrained Standard
Devices Devices Storage
Non-TCP HTTPS
Cloud
e.g. BLE
Storage

Cloud
Datastore
Ingest Pipelines Application &
Cloud Presentation
Cloud Cloud Bigtable
Pub/Sub Dataflow App
Engine
Cloud IoT Analytics
Core Monitoring Container
Cloud Engine
Gateway
Dataflow
Compute
Logging
BigQuery Engine

Cloud
Dataproc

Cloud
Datalab
GCP Data Processing
Kubernetes
TensorFlow
Getting Started
What we’ve covered
GCP Compute
GCP Storage
GCP IoT Core
Kubernetes
TensorFlow
GCP Data Processing
Where to Get Started
https://cloud.google.com/getting-started/
https://codelabs.developers.google.com/?cat=Cloud
Something Free
● https://cloud.google.com/free/
● Free Trial: $300 and 12 months
● Free Tier extends beyond 12
months too (Always Free)
Thank You!
Abdelrahman Omran | @Omranic | me@omranic.com

You might also like