You are on page 1of 206

A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 1:
Course Introduction
Hello! Instructor Introduction A Guide To Cloud

www.AGuideToCloud.com
Susanth Sutheesh

Blog: AGuideToCloud.com
@AGuideToCloud
A Guide To Cloud

www.AGuideToCloud.com
Skills Weights
DP-900 Describe core data concepts 15-20%

Skills Describe how to work with relational data on Azure 25-30%


Describe how to work with non-relational data on Azure 25-30%
Measured
Describe an analytics workload on Azure 25-30%
Course agenda A Guide To Cloud

Module Lessons
Module 1: • Explore core data concepts
Explore core data concepts • Explore roles and responsibilities in the world of data
• Describe concepts of relational data

www.AGuideToCloud.com
• Explore concepts of non-relational data
• Explore concepts of data analytics

Module 2: • Explore relational data offerings in Azure


Explore relational data in Azure • Explore provisioning and deploying relational database offerings in Azure
• Query relational data in Azure

Module 3: • Explore non-relational data offerings in Azure


Explore non-relational data in Azure • Explore provisioning and deploying non-relational data services in Azure
• Manage non-relational data stores in Azure

Module 4: • Examine components of a modern data warehouse


Explore modern data warehouse • Explore data ingestion in Azure
analytics • Explore data storage and processing in Azure
• Get started building with Power BI
Exam Basics A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 2:
Explore core data concepts
A Guide To Cloud

Explore core data concepts

www.AGuideToCloud.com
Explore roles and responsibilities in the world of data

Agenda Describe concepts of relational data

Explore concepts of non-relational data

Explore concepts of data analytics


A Guide To Cloud

Identify how data is defined and stored

www.AGuideToCloud.com
Identify characteristics of relational and non-relational data
Learning
objectives Describe and differentiate data workloads

Describe and differentiate batch and streaming data


What is data? A Guide To Cloud

Collection of facts, numbers, descriptions, objects , stored in a structured, semi-structured,


unstructured way

Structured Semi-structured Unstructured

www.AGuideToCloud.com
Table
A Guide To Cloud

www.AGuideToCloud.com
Structured Data
Key-value Stores and Graph databases A Guide To Cloud

www.AGuideToCloud.com
Transactional vs analytical data stores A Guide To Cloud

Online Transactional Processing (OLTP) Online Analytical Processing (OLAP)

Customer

www.AGuideToCloud.com
CustomerID CustomerName CustomerPhone

Orders
OrderID CustomerID OrderDate
Transactional workloads A Guide To Cloud

Customer Account

CustomerID CustomerName CustomerPhone CustomerID Balance

www.AGuideToCloud.com
5558 500
1000
6023 2000
1500

Orders Transfers
OrderID CustomerID OrderDate TransactionID FromAccount ToAccount Transaction Amount OrderDate TransactionDescription
982801 6023 5558 500 DD/MM/YY Transfer 500 from
account 6023 to
account

BEGIN TRANSACTION
UPDATE Account
SET Balance = Balance -500
WHERE CustomerID=6023;
UPDATE Account
SET Balance = Balance +500
WHERE CustomerID=5558;
INSERT INTO Transfers (Fromaccount, ToAccount, TransactionAmount,TransactionDescription)
VALUES (6023,5558,500,’Transfer 500 from account 6023 to account 5558)
COMMIT TRANSACTIONTransaction
Analytical System A Guide To Cloud

www.AGuideToCloud.com
Analytical system A Guide To Cloud

www.AGuideToCloud.com
On-premises data
SQL Server, Oracle, Data ingestion Data storage Data processing Data visualization
fileshares, SAP

Cloud data
Azure, AWS, GCP

SaaS data
Salesforce, Dynamics
Batch data/streaming data A Guide To Cloud

www.AGuideToCloud.com
Batch vs. Streaming data A Guide To Cloud

Data Scope

www.AGuideToCloud.com
Data Size

Performance

Analysis
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 3:
Roles and responsibilities in the world of data
A Guide To Cloud

Explore data job roles

www.AGuideToCloud.com
Lesson
Explore common tasks and tools for data job roles
objectives
Roles in data A Guide To Cloud

www.AGuideToCloud.com
Database Administrator Data Engineer Data Analyst

Database Management Data Pipelines and processes Provides insights into the
data
Implements Data Security Data Ingestion storage
Visual Reporting
Backups Prepare data for Analytics
Modeling Data for Analysis
User Access Prepare data for analytical
processing Combines data for
Monitors performance
visualization
and analysis
Common tools – Database administrator A Guide To Cloud

Azure Data Studio SQL Server Azure Portal/CLI

www.AGuideToCloud.com
Management Studio

Graphical interface for managing Graphical interface for managing Tools for management and
on-premises and cloud-based on-premises and cloud-based provisioning of Azure
data services data services Data Services
Runs on Windows, macOS, Linux Runs on Windows Manual and automation of
scripts using Azure Resource
Comprehensive Database
Manager or Command Line
Administration tool
Interface scripting
What is Data Studio? A Guide To Cloud

www.AGuideToCloud.com
What is SQL Server Management Studio? A Guide To Cloud

www.AGuideToCloud.com
Azure portal to manage Azure SQL Database A Guide To Cloud

www.AGuideToCloud.com
Common tools – Data engineering A Guide To Cloud

Azure Synapse Studio SQL Server Azure Portal/CLI

www.AGuideToCloud.com
Management Studio

Azure Portal integrated to manage Graphical interface for managing Tools for management and
Azure Synapse on-premises and cloud-based data provisioning of Azure resources
services
Data Ingestion (Azure Data Manual and automation of scripts
Factory) Runs on Windows using Azure Resource Manager or
Command Line Interface scripting
Management of Azure Synapse Comprehensive Database
assets (SQL Pools/Spark Pool) Administration tool
Common tools – Data analyst A Guide To Cloud

Power BI Desktop Power BI Portal/ Power BI Report Builder

www.AGuideToCloud.com
Power BI Service

Data Visualization tool Authoring and management of Data Visualization tool for paginated
Power BI reports reports
Model and Visualize Data
Authoring of Power BI dashboards Model and Visualize paginated
Management of Azure Synapse
reports
assets (SQL Pools/Spark Pool) Share Reports/Datasets
Data Visualization Tools A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 4:
Describe concepts of relational data
A Guide To Cloud

Explore the characteristics of relational data

www.AGuideToCloud.com
Lesson
Define tables, indexes, and views
objectives

Explore relational data workload offerings in Azure


Tables A Guide To Cloud

Customers
CustomerID CustomerName CustomerPhone
Data is stored in a table

www.AGuideToCloud.com
100 Muisto Linna XXX-XXX-XXXX
101 Noam Maoz XXX-XXX-XXXX
Table consists of rows and columns
102 Vanja Matkovic XXX-XXX-XXXX
103 Qamar Mounir XXX-XXX-XXXX
104 Zhenis Omar XXX-XXX-XXXX All rows have same # of columns
105 Claude Paulet XXX-XXX-XXXX
106 Alex Pettersen XXX-XXX-XXXX
Each column is defined by a datatype
107 Francis Ribeiro XXX-XXX-XXXX
A Guide To Cloud

www.AGuideToCloud.com
Tables cont..
A Guide To Cloud

www.AGuideToCloud.com
Tables cont..
Normalization A Guide To Cloud

Customers Orders
CustomerID CustomerName CustomerPhone OrderID CustomerName CustomerPhone

www.AGuideToCloud.com
100 Muisto Linna XXX-XXX-XXXX AD100 Noam Maoz XXX-XXX-XXXX
101 Noam Maoz XXX-XXX-XXXX AD101 Noam Maoz XXX-XXX-XXXX
102 Vanja Matkovic XXX-XXX-XXXX AD102 Noam Maoz XXX-XXX-XXXX
103 Qamar Mounir XXX-XXX-XXXX AX103 Qamar Mounir XXX-XXX-XXXX
104 Zhenis Omar XXX-XXX-XXXX AS104 Qamar Mounir XXX-XXX-XXXX
105 Claude Paulet XXX-XXX-XXXX AR105 Claude Paulet XXX-XXX-XXXX
106 Alex Pettersen XXX-XXX-XXXX MK106 Muisto Linna XXX-XXX-XXXX

Data is normalized to:


Reduce storage Avoid data duplication Improve data quality
Relations A Guide To Cloud

Customers Orders
CustomerID CustomerName CustomerPhone OrderID CustomerID SalesPersonID
100 Muisto Linna XXX-XXX-XXXX AD100 101 200

www.AGuideToCloud.com
101 Noam Maoz XXX-XXX-XXXX AD101 101 200
102 Vanja Matkovic XXX-XXX-XXXX AD102 101 200
103 Qamar Mounir XXX-XXX-XXXX AX103 103 201
104 Zhenis Omar XXX-XXX-XXXX AS104 103 201
105 Claude Paulet XXX-XXX-XXXX AR105 105 200
106 Alex Pettersen XXX-XXX-XXXX MK106 105 201

In a normalized database schema:


Primary Keys and Foreign keys are used to No data duplication exists (other than key values Data is retrieved by joining tables together
define relationships in 3rd Normal Form (3NF) in a query
Indexes A Guide To Cloud

Customers IDX-CustomerRegion
CustomerID CustomerName CustomerPhone CustomerID Region

www.AGuideToCloud.com
100 Muisto Linna XXX-XXX-XXXX 100 France
101 Noam Maoz XXX-XXX-XXXX 101 Brazil
102 Vanja Matkovic XXX-XXX-XXXX 102 Croatia
103 Qamar Mounir XXX-XXX-XXXX 103 Jordan
104 Zhenis Omar XXX-XXX-XXXX 104 Spain
105 Claude Paulet XXX-XXX-XXXX 105 France
106 Alex Pettersen XXX-XXX-XXXX 106 USA

An index:
Reduces the amount of data pages that need to Data is retrieved by joining tables together
Optimizes search queries for faster data retrieval
be read to retrieve the data in a SQL Statement in a query
View A Guide To Cloud

Customers Orders Create the definition of a view:


CREATE VIEW
CustomerID CustomerName CustomerPhone OrderID CustomerID SalesPersonID vw_customerorders AS

www.AGuideToCloud.com
SELECT Customers.CustomerID,
100 Muisto Linna XXX-XXX-XXXX AD100 101 200 Customers.CustomerName,

101 Noam Maoz XXX-XXX-XXXX AD101 101 200 Orders.OrderID FROM Customers
JOIN Orders on

102 Vanja Matkovic XXX-XXX-XXXX AD102 101 200 Customers.CustomerID =


Orders.CustomerID
AX103 103 201
103 Qamar Mounir XXX-XXX-XXXX Retrieve the orders placed by
AS104 103 201 customer 102 using the view:
104 Zhenis Omar XXX-XXX-XXXX
AR105 105 200 SELECT CustomerName, OrderID
from vw_customerorders WHERE
105 Claude Paulet XXX-XXX-XXXX MK106 105 201 CustomerID=102

106 Alex Pettersen XXX-XXX-XXXX DB205 100 205

A view is a virtual table based on the result set of query:


Views are created to simplify the query Combine relational data into a single pane view
IaaS, PaaS A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 5:
Explore concepts of non-relational data
A Guide To Cloud

Explore the characteristics of non-relational data

www.AGuideToCloud.com
Lesson
Define types of non-relational data
objectives

Describe NoSQL, and the types of non-relational databases


A Guide To Cloud
Explore characteristics of non-relational data
Entities
## Customer 1 ID: 1

www.AGuideToCloud.com
Name: Mark Hanson
Telephone: [ Home: 1-999-9999999, Business: 1-888-8888888, Cell: 1-777- 7777777 ]
Address: [ Home: 121 Main Street, Some City, NY, 10110,
Business: 87 Big Building, Some City, NY, 10111 ]
## Customer 2 ID: 2
Title: Mr
Name: Jeff Hay
Telephone: [ Home: 0044-1999-333333, Mobile: 0044-17545-444444 ]
Address: [ UK: 86 High Street, Some Town, A County, GL8888, UK,
US: 777 7th Street, Another City, CA, 90111 ]

Non-relational collections can have:

Multiple entities in the same collection or Have a different, Are often defined by labeling each field with the
container with different fields non-tabular schema name it represents
A Guide To Cloud
Explore characteristics of non-relational data

www.AGuideToCloud.com
A Guide To Cloud
Identify non-relational database use cases

IoT and Telematics:

www.AGuideToCloud.com
Retail and Marketing:

Gaming

Web and Mobile


Types of non-relational data A Guide To Cloud

What is semi-structured data?


Data structure is defined within the actual data by fields.

www.AGuideToCloud.com
JSON AVRO ORC Parquet
What is unstructured data? A Guide To Cloud

Does not naturally contain fields:

www.AGuideToCloud.com
Often used to extract data form and categorize or identify “structures”

Frequently used in combination with Machine Learning or Cognitive


Services capabilities to “extract data” by using:
What is NoSQL? A Guide To Cloud

Loose term, to describe non-relational

www.AGuideToCloud.com
Column
Key-value Document Graph
family
stores based Databases
databases
What is a graph database? A Guide To Cloud

www.AGuideToCloud.com
Stores entities centric around relationships

Enable applications to perform queries


traversing a network of nodes and
edges
What applications require a graph database? A Guide To Cloud

Business requirements:

www.AGuideToCloud.com
OLTP apps with highly correlated data
Easy updates to single or many objects
Flexible data modelling
Data requirements that evolve
Hierarchical data structures
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 6:
Explore concepts of data analytics
A Guide To Cloud

Learn about data ingestion and processing

www.AGuideToCloud.com
Lesson
Explore data visualization
objectives

Explore data analytics


What is data ingestion? A Guide To Cloud

www.AGuideToCloud.com
Data Data Data
Critical ingestion processing exploration
device data

Queries
Financial
transactions

Raw data Cleaned and


transformed data
Visualizations

Point-of-Sale data
What is data processing? A Guide To Cloud

www.AGuideToCloud.com
Data
processing
Functions Cognitive Services

Raw
Data

Databricks Other tools


Cleaned and
transformed data
What is ETL? A Guide To Cloud

Transform

www.AGuideToCloud.com
Basic filtering and
transformations
Extract Load

Discard sensitive data


What is ELT? A Guide To Cloud

Load Transform

www.AGuideToCloud.com
Complex
processing
Extract
Explore data visualization A Guide To Cloud

Power BI: A collection of software, services, apps, and connectors

www.AGuideToCloud.com
Power BI
A Guide To Cloud
Explore data analytics

www.AGuideToCloud.com
Descriptive Diagnostic Predictive Prescriptive Cognitive
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 7:
Module 1 Knowledge check
A Guide To Cloud

Q1: How is data in a relational table organized?

www.AGuideToCloud.com
DP-900
Module 01 ❑ Rows and Columns

Review Q&A ❑ Header and Footer

❑ Pages and Paragraphs


A Guide To Cloud

Q2: Which of the following is an example of

www.AGuideToCloud.com
unstructured data?
DP-900
Module 01
Review Q&A ❑ An Employee table with columns Employee ID, Employee
Name, and Employee Designation

❑ Audio and Video files

❑ A table within SQL Server database


A Guide To Cloud

Q3: What of the following is an example of a

www.AGuideToCloud.com
streaming dataset?
DP-900
Module 01
Review Q&A ❑ Data from sensor feeds

❑ Sales data for the past month

❑ List of employees working for a company


A Guide To Cloud

Q4: Which one of the following tasks is a role of a

www.AGuideToCloud.com
database administrator?
DP-900
Module 01
Review Q&A ❑ Backing up and restoring databases

❑ Creating dashboards and reports

❑ Identifying data quality issues


A Guide To Cloud

Q5: Which of the following tools is a visualization

www.AGuideToCloud.com
and reporting tool?
DP-900
Module 01
Review Q&A ❑ SQL Server Management Studio

❑ Power BI

❑ SQL
A Guide To Cloud

Q6: Which one of the following roles is not a

www.AGuideToCloud.com
data job role?
DP-900
Module 01
Review Q&A ❑ Systems Administrator

❑ Data Analyst

❑ Database Administrator
A Guide To Cloud

Q7: Which one of the following statements is a

www.AGuideToCloud.com
characteristic of a relational database?
DP-900
Module 01
Review Q&A ❑ All data must be stored as character strings

❑ A row in a table represents a single entity

❑ Different rows in the same table can contain different


columns
A Guide To Cloud

Q8: What is an index?

www.AGuideToCloud.com
DP-900
Module 01 ❑ A structure that enables you to locate rows in a table
Review Q&A quickly, using an indexed value

❑ A virtual table based on the result set of a query

❑ A structure comprising rows and columns that you use


for storing data
A Guide To Cloud

Q9: Which one of the following statements is a


benefit of using a PaaS service, instead of an

www.AGuideToCloud.com
on-premises system, to run your database
DP-900 management systems?
Module 01
Review Q&A
❑ Increased day-to-day management costs

❑ Increased scalability

❑ Increased functionality
A Guide To Cloud

Q10: Which of the following services should


you use to implement a non-relational
database?

www.AGuideToCloud.com
DP-900
Module 01
Review Q&A
❑ Azure Cosmos DB

❑ Azure SQL Database

❑ The Gremlin API


A Guide To Cloud

Q11: Which of the following is a characteristic


of non-relational databases?

www.AGuideToCloud.com
DP-900
Module 01
❑ Non-relational databases contain tables with flat fixed-column records
Review Q&A
❑ Non-relational databases require you to use data normalization techniques to
reduce data duplication

❑ Non-relational databases are either schema free or have relaxed schemas


A Guide To Cloud

Q12: You are building a system that monitors the temperature throughout
a set of office blocks, and sets the air conditioning in each room in each
block to maintain a pleasant ambient temperature. Your system has to

www.AGuideToCloud.com
manage the air conditioning in several thousand buildings spread across
the country or region, and each building typically contains at least 100 air-
DP-900 conditioned rooms. What type of NoSQL data store is most appropriate for
capturing the temperature data to enable it to be processed quickly?
Module 01
Review Q&A
❑ A key-value store

❑ A column family database

❑ Write the temperatures to a blob in Azure Blob storage


A Guide To Cloud

Q13: What is data ingestion?

www.AGuideToCloud.com
DP-900
❑ The process of transforming raw data into models containing
Module 01
meaningful information
Review Q&A
❑ Analyzing data for anomalies

❑ Capturing raw data streaming from various sources and storing it


A Guide To Cloud

Q14: Which one of the following visuals


displays the major contributors to a selected
result or value?

www.AGuideToCloud.com
DP-900
Module 01
❑ Key influencers
Review Q&A
❑ Column and bar chart

❑ Matrix chart
A Guide To Cloud

Q15: Which type of analytics helps answer


questions about what has happened in the
past?

www.AGuideToCloud.com
DP-900
Module 01
❑ Descriptive analytics
Review Q&A
❑ Prescriptive analytics

❑ Predictive analytics
A Guide To Cloud

Explore relational data offerings in Azure

www.AGuideToCloud.com
Explore provisioning and deploying relational database
Agenda offerings in Azure

Query relational data in Azure


A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 8:
Explore relational data offerings in Azure
A Guide To Cloud

Explore relational data offerings in Azure

www.AGuideToCloud.com
Lesson Explore provisioning and deploying of relational
objectives database offerings in Azure

Query relational data in Azure


What are Azure Data Services? A Guide To Cloud

www.AGuideToCloud.com
SQL Server on Azure Virtual Azure SQL Managed Instance Azure SQL Database
Machines Best for modernizing existing apps Best for building new apps
Best for re-hosting and apps requiring Offers high compatibility with SQL in the cloud
OS-level access and control Server and native VNET support Pre-provisioned or serverless compute
Automated manageability features and Hyperscale storage to meet
and OS-level access demanding workload requirements

Infrastructure as a Platform as a Service


Service
SQL Server on Azure Virtual Machines A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

Azure SQL Single Database

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
Azure SQL Elastic Pool
Azure SQL Managed Instance A Guide To Cloud

www.AGuideToCloud.com
SQL Server on Azure virtual machines A Guide To Cloud

Customer challenge: Key features: Azure differentiators:


▪ SQL Server and OS server ▪ Free Extended Security Updates

www.AGuideToCloud.com
I want to migrate to the cloud as
access for SQL Server 2008/R2
fast as possible but maintain
operating system control and ▪ Expansive SQL and OS ▪ Automated Backups and Security
Updates
complete SQL Server versions
functionality ▪ Point in Time Restore with Azure
▪ Windows, Linux, Containers Backup
▪ File stream, DTC, and Simple ▪ Accelerated storage performance
Solution: Recovery model with Azure Blob Caching
Get the combined performance, ▪ SSAS, SSRS, and SSIS ▪ 435 percent overall return on an
security, and analytics of SQL Azure IaaS investment over
Server, backed by the flexibility, five years1
security, and hybrid connectivity
of Azure
A Guide To Cloud
SQL Server on Azure VM Deployment choices
Deployment Marketplace pre-installed SQL Server on Windows or Linux | Install your own SQL Server | Lift and Shift with Azure Migrate (Azure Site
Choices Recovery)

www.AGuideToCloud.com
Resource
Unlock Licensing and Edition Flexibility | Automated Backups and Security Updates | Manage VMs through Azure SQL in portal
Provider

Sizes and Memory or Storage optimized sizes for best performance Tempdb on local SSD
Storage Data and log on Premium Storage Managed Disks Ultra disks for extremely low latency needs
Performance Azure Blob Read Caching for data disks

Networking Virtual Networks to integrate with on-premises


and Security Advanced Data Security services (Preview)

Azure VM built-in HA Failover Cluster Instance with Azure Premium File Share
Azure Storage built-in DR Always On Availability Groups with Cloud Witness
HADR Azure Backup and Automated backups to Hybrid Availability Group Secondary replicas
Azure Blob Storage HADR on RedHat Linux with Pacemaker and fencing
File-Snapshot Backups
IaaS vs PaaS A Guide To Cloud

Business continuity Scale

www.AGuideToCloud.com
High availability Advanced security

Automated backups Version-less

Long term backup retention Built-in monitoring

Geo-replication Built-in intelligence


Azure SQL DB A Guide To Cloud

Customer challenge: Key features: Azure differentiators:

www.AGuideToCloud.com
I want to build modern apps,
potentially multi-tenanted, with the ▪ Single database or elastic ▪ Industry highest availability
highest uptime and predictable pool SLA of 99.995%
performance ▪ Hyperscale storage (100TB+) ▪ Industry only business
continuity SLA with 5 second
▪ Serverless compute
RPO and 30 second RTO
Solution: ▪ Fully managed service
▪ Price-performance leader for
Azure SQL Database is a highly ▪ Private link support mission-critical workloads
scalable cloud database service ▪ High availability with AZ while costing up to 86 percent
with built-in high availability and isolation less than AWS RDS
machine learning (GigaOm)
Azure SQL DB service tiers A Guide To Cloud

General purpose Business critical Hyperscale*

www.AGuideToCloud.com
Most business workloads Workloads that require low latency, fast Most business workloads
recovery, and a readable secondary with highly scalable storage and
read-scale requirements

Remote storage Local storage Local + remote storage


IOPS IOPS++ IOPS+
$ $$$ $$
Serverless* In-memory Unlimited storage

P P S S R P R R R R
*Not in managed instance
Azure SQL DB managed instance A Guide To Cloud

Customer challenge: Key features: Azure differentiators:


I want to migrate to the cloud,

www.AGuideToCloud.com
remove management overhead, ▪ Single instance or
▪ Near zero downtime
but I need instance-scoped instance pool
migration using log shipping
features (Service Broker, SQL Server ▪ SQL Server surface area
Agent, CLR…) ▪ Fully managed business
(vast majority)
continuity with failover groups
▪ Native virtual network
▪ Projected return on
Solution: support
investment of 212 percent
Managed instance combines ▪ Fully managed service over three years1
leading security features with SQL
▪ On-premise identities enabled ▪ The best of SQL Server with
Server compatibility and business
with Azure AD and AD the benefits of a managed
model designed for on-premises
Connect service
customers
Managed Instance service tiers A Guide To Cloud

General purpose Business critical

www.AGuideToCloud.com
Most business workloads Workloads that require low latency, fast recovery, and a
readable secondary

vCore model
Independent scalability

Remote storage Local storage


IOPS IOPS++
$ $$$
In-memory

P P S S R
Azure SQL Managed Instance or DB A Guide To Cloud

www.AGuideToCloud.com
Azure SQL Managed Instance Azure SQL Database

Single instance: Instance pool: Single database: Elastic pool:


SQL Server surface area Pre-provision compute Hyperscale storage Resource sharing between
(vast majority) resources for migration (up to 100TB) multiple databases to price
Native virtual network Enables cost-efficient Serverless compute optimize
support migration Fully managed service Simplified performance
Fully managed service Ability to host smaller management for multiple
instances (2Vcore) databases
Currently in public preview Fully managed service
PostgreSQL, MariaDB, MySQL A Guide To Cloud

www.AGuideToCloud.com
PostgreSQL is the MySQL is a leading open MariaDB is a
most popular and source relational database community-developed fork
wanted database for for LAMP stack apps of MySQL with strong focus
modern apps on the user community
A Guide To Cloud

Benefits of Azure Database for MySQL, PostgreSQL,


MariaDB

www.AGuideToCloud.com
Fully managed community database:
Take advantage of a fully managed service while still using the tools and languages you’re familiar with

Built-in high availability for lowest TCO:


Ensure your data is always available without the need for additional costs

Intelligent performance and scale:


Improve performance with built-in intelligence and up to 16TB storage and 20K IOPs

Industry-leading security and compliance:


Protect your data with enhanced security features including Advanced Threat Protection

Integration with the Azure ecosystem:


Build apps faster with Azure services and safeguard your innovation with Azure IP Advantage
Azure Database for PostgreSQL A Guide To Cloud

www.AGuideToCloud.com
Azure builds upon the core benefits
of PostgreSQL and Open Source

Azure Database for PostgreSQL is


fully-managed, community PostgreSQL
A Guide To Cloud

The benefits of Azure Database for PostgreSQL


Build or migrate your workloads with confidence and optimized for value

www.AGuideToCloud.com
Fully managed and secure Intelligent performance Flexible and open High performance
Focus on your apps while Azure optimization Stay productive with your scale-out with Hyperscale
manages resource-intensive Improve performance and favorite Postgres extensions and Break free from the limits of
tasks, supports a large variety of reduce cost with customized leverage Microsoft’s single-node Postgres and scale
Postgres versions and provides recommendations contributions to the Postgres out across 100s of nodes
best-in industry indemnification community
coverage

Single Server

Hyperscale
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 9:
Deploying relational database offerings in Azure
A Guide To Cloud

Provision relational data services

www.AGuideToCloud.com
Configure relational data services

Lesson
objectives Explore basic connectivity issues

Explore data security


Demo: What is provisioning? A Guide To Cloud

This video summarizes the process that Azure


performs when you provision a service

www.AGuideToCloud.com
Configure relational data services A Guide To Cloud

Network Additional Review


Basics Tags (DB)

www.AGuideToCloud.com
connectivity settings & create
Subscription Public vs Private access Data source (DB) Terms and Privacy
Resource group VNet/Firewall rules Server Collation (MI)
Managed Instance/ Connection type (MI) Database Collation (DB)
Server name Time zone (MI)
Database Name (DB) Opt-in for Advanced
Admin Login data security (DB)
Password
Region
Opt-in for pools (DB)
Compute + storage
Connectivity and Firewalls A Guide To Cloud

WEST US

mysqldbsrv.database.windows.net
GW GW
westus1-a.control.database.windows.net

www.AGuideToCloud.com
23.99.34.75
104.42.238.205,1433

GW GW
proxy
GW
(1) redirect-find-db

GW GW

104.42.238.205

(2) redirect-query ..westus1-a.worker.database.windows.net


13.123.237.158, [11000 -11999]
Network Security – SQL Database A Guide To Cloud

VMVNET-EUS VNET Peering


Allow access to No access to Internet
US EAST
Azure services SQLDBVNET-EUS

www.AGuideToCloud.com
US EAST

127.33.201.5
10.0.0.3
Firewall Rules
VMVNET-WUS
174.17.218.16
10.0.0.2 10.0.0.5
US WEST
mysqldbsrv.database.
windows.net
Virtual Private Endpoint westus1-a.control.
mysqldbsrv.privatelink.
database.windows.net
Network Rules 10.0.0.1
102.14.157.9
104.42.238.205
10.0.0.5

Private Link
On-premises
Vnet2Vnet P2S, S2S VPN Express Route
Authentication and Access Control A Guide To Cloud

“Mixed Mode” authentication forced


SQL Auth for deployment: server admin:
Server-level principal for logical server for DB

www.AGuideToCloud.com
Member of sysadmin server role for MI

Need Windows Auth? Use Azure AD Authentication Azure Managed Instance:

Azure AD Server Admin


SQL or Azure AD Logins
Database Users
SQL Server Contained Database supported

Azure SQL Database:

Azure AD Server Admin


SQL logins
loginmanager and dbmanager roles for limited server admins
Database Users
Contained Database Users including Azure AD (recommended)
Azure Role Based Access Control (RBAC) A Guide To Cloud

All Azure operations for Azure SQL are controlled through RBAC
Think of this as security rights outside the Managed Instance or Database

www.AGuideToCloud.com
Security principal and role-based system
Scope includes subscription, resource group, and resource
Decoupled from SQL Security (today)
Applies to operations in Azure portal and CLI
Allows for separation of duties for deployment, management, and usage
Azure locks help protect resources from delete or read-only
Built-in Azure SQL roles available to reduce need for owner

SQL DB SQL Managed


SQL Security Manager SQL Server Contributor
Contributor Instance Contributor
A Guide To Cloud

Demo: Provision an Azure SQL Database instance

www.AGuideToCloud.com
This video demonstrates how to provision an Azure SQL
Database instance, to create a database and server
Demo: Provision Azure SQL Database A Guide To Cloud

One of the most popular deployments within Azure


relational data services is Azure SQL Database. This
video demonstrates how to provision an Azure SQL

www.AGuideToCloud.com
Database instance, to create a database and server
Azure DB – Read replicas A Guide To Cloud

Create up to five replicas of the master server

www.AGuideToCloud.com
Master server
Asynchronous
updates

Read Replica #1 Read Replica #2 Read Replica #3 Read Replica #4 Read Replica #5

Application BI and Analytics Dashboard


Reporting
Lab: Provision Azure relational database service A Guide To Cloud

As part of your role at Contoso as a data engineer, you’ve been asked to create
and configure SQL Server, PostgreSQL, and MySQL servers for Azure
Go to the exercise Provision non-relational Azure data services module on

www.AGuideToCloud.com
Microsoft Learn, and follow the instructions in the module to create data stores
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 10:
Query relational data in Azure
A Guide To Cloud

Query relational data

www.AGuideToCloud.com
Lesson
Describe query techniques for data using the SQL language
objectives
Introduction to SQL A Guide To Cloud

SQL is a standard language for use with relational databases

www.AGuideToCloud.com
SQL standards are maintained by ANSI and ISO

Proprietary RDBMS systems have their own extensions of SQL such as T-SQL, PL/SQL,
pgSQL
SQL Statement types A Guide To Cloud

DML DDL DCL

www.AGuideToCloud.com
Data Manipulation Data Definition Language Data Control Language
Language
Used to define database Used to manage security
Used to query and objects permissions
manipulate data
CREATE, ALTER, DROP GRANT, REVOKE, DENY
SELECT, INSERT,
UPDATE, DELETE
Use DML statements A Guide To Cloud

Statement Description

www.AGuideToCloud.com
SELECT Select/read from a table
INSERT Insert new rows in a table
UPDATE Edit/Update existing rows in a table
DELETE Delete existing rows in a table
Elements of the SELECT Statement A Guide To Cloud

Clause Expression

www.AGuideToCloud.com
SELECT <select list>
FROM <table or view>
WHERE <search condition>
GROUP BY <group by list>
ORDER BY <order by list>
Example of SELECT statement A Guide To Cloud

SELECT EmployeeId, YEAR(OrderDate) AS OrderYear

www.AGuideToCloud.com
FROM Sales.Orders
WHERE CustomerId = 71
GROUP BY EmployeeId, YEAR(OrderDate)
HAVING COUNT(*) > 1
ORDER BY EmployeeId, OrderYear;
Example of INSERT statement A Guide To Cloud

The INSERT ... VALUES statement inserts a new row

www.AGuideToCloud.com
INSERT INTO Sales.OrderDetails
(orderid, productid, unitprice, qty, discount)
VALUES (10255,39,18,2,0.05);

Table and row constructors add multirow capability to INSERT ... VALUES
INSERT INTO Sales.OrderDetails
(orderid, productid, unitprice, qty, discount)

VALUES
(10256,39,18,2,0.05),
(10258,39,18,5,0.10);
Use DDL statements A Guide To Cloud

Statement Description

www.AGuideToCloud.com
CREATE Create a new object in the database, such as a table or a view
Modify the structure of an object. For instance, altering a table to add a
INSERT
new column
UPDATE Remove an object from the database
DELETE Rename an existing object
Example of CREATE statement A Guide To Cloud

CREATE TABLE Mytable


(Mycolumn1 int NOT NULL PRIMARY KEY, Mycolumn2 VARCHAR(50) NOT

www.AGuideToCloud.com
NULL , Mycolumn2 VARCHAR(10) NOT NULL
Query tools A Guide To Cloud

www.AGuideToCloud.com
Azure Portal SQL Management Studio SQL Server Data Tools

Azure Data Studio SQLCMD Azure CLI/Cloud Shell


Azure Portal A Guide To Cloud

www.AGuideToCloud.com
SQLCMD A Guide To Cloud

www.AGuideToCloud.com
Azure SQL Data Studio A Guide To Cloud

www.AGuideToCloud.com
SQL Management Studio A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 11:
Module 2 Knowledge check
A Guide To Cloud

Q1: Which deployment requires the fewest


changes when migrating an existing SQL

www.AGuideToCloud.com
Server on-premises solution?
DP-900
Module 02
❑ Azure SQL Database Managed Instance
Review Q&A
❑ SQL Server running on a virtual machine

❑ Azure SQL Database Single Database


A Guide To Cloud

Q2: Which of the following statements is true


about SQL Server running on a virtual machine?

www.AGuideToCloud.com
DP-900 ❑ You must install and maintain the software for the
Module 02 database management system yourself, but backups are
Review Q&A automated

❑ Software installation and maintenance are automated,


but you must do your own backups

❑ You’re responsible for all software installation and


maintenance, and performing back ups
A Guide To Cloud

Q3: Which of the following statement is true


about Azure SQL Database?

www.AGuideToCloud.com
DP-900 ❑ Scaling up doesn’t take effect until you restart the
Module 02 database
Review Q&A
❑ Scaling out doesn’t take effect until you restart the
database

❑ Scaling up or out will take effect without restarting the


SQL database
A Guide To Cloud

Q4: When using an Azure SQL Database


managed instance, what is the simplest way to

www.AGuideToCloud.com
implement backups?
DP-900
Module 02 ❑ Manual Configuration of the SQL server
Review Q&A ❑ Create a scheduled task to back up

❑ Backups are automatically handled


A Guide To Cloud

Q5: What is the best way to transfer the data in


a PostgreSQL database running on-premises
into a database running Azure Database for

www.AGuideToCloud.com
PostgreSQL service?
DP-900
Module 02 ❑ Export the data from the on-premises database and
Review Q&A import it manually into the database running
in Azure

❑ Upload a PostgreSQL database backup file to the


database running in Azure

❑ Use the Azure Database Migration Services


A Guide To Cloud

Explore non-relational data offerings in Azure

www.AGuideToCloud.com
Explore provisioning and deploying non-relational data
Agenda services in Azure

Manage non-relational data stores in Azure


A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 12:
Explore non-relational data offerings in Azure
A Guide To Cloud

Explore use-cases and management benefits of using


Azure Table storage

Explore use-cases and management benefits of using

www.AGuideToCloud.com
Azure Blob storage
Lesson
objectives Explore use-cases and management benefits of using
Azure File storage

Explore use-cases and management benefits of using


Azure Cosmos DB
Explore Azure Table storage A Guide To Cloud

Key Value
(Customer ID) (Customer Data)

www.AGuideToCloud.com
C1 AAAAA BBB 101 Block Street YY 999 888

C2 MM NN 21 A Street 5 B Avenue

C3 DDD EEE FFF 111 222 66 C Road


Explore Azure Blob storage A Guide To Cloud

Block blobs Page blobs Append blobs

www.AGuideToCloud.com
Has a maximum size of 4.7TB Can hold up to 8TB of data The maximum size is just over
195GB
Best for storing large, discrete, Is organized as a collection of
binary objects that changes fixed sized-512 byte pages Is a block blob that is used to
infrequently optimize append operations
Used to implement virtual disk
Each individual block can storage for virtual machines Each individual block can
store up to 100MB of data store up to 4MB of data
A block blob can contain up to
50000 blocks
Explore Azure File storage A Guide To Cloud

www.AGuideToCloud.com
Explore Azure Cosmos DB A Guide To Cloud

www.AGuideToCloud.com
Scalability Performance Availability Programming
model
Use cases for Azure Cosmos DB A Guide To Cloud

Web and retail Gaming IoT scenarios

www.AGuideToCloud.com
Using Azure Cosmos DB’s multi- The database tier is a crucial Hundreds of thousands of devices
master replication model along component of gaming have been designed and sold to
with Microsoft’s performance applications. Modern games generate sensor data known as
commitments, Data Engineers can perform graphical processing on Internet of Things (IoT) devices.
implement a data architecture to mobile/console clients but rely on Using technologies like Azure IoT
support web and mobile the cloud to deliver customized Hub, Data Engineers can easily
applications that achieve less than and personalized content like design a data solution architecture
a 10-ms response time anywhere in-game stats, social media that captures real-time data.
in the world integration, and high-score Cosmos DB can accept and store
leader boards this information very quickly
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 13:
Deploying non-relational data services in Azure
A Guide To Cloud

Provision non-relational data services

www.AGuideToCloud.com
Configure non-relational data services

Lesson
objectives Explore basic connectivity issues

Explore data security components


Demo: What is provisioning? A Guide To Cloud

This video summarizes the process that Azure performs


when you provision a service

www.AGuideToCloud.com
Provisioning Cosmos DB A Guide To Cloud

www.AGuideToCloud.com
Demo: How to provision a Cosmos DB account A Guide To Cloud

You can provision a Cosmos DB account interactively


using the Azure portal, or you can perform this task
programmatically through the Azure CLI, Azure

www.AGuideToCloud.com
PowerShell, or an Azure Resource Manager template.
This video describes how to use the Azure portal
Demo A Guide To Cloud

Use the Azure portal to create a database and container

www.AGuideToCloud.com
Provisioning Data Lake storage A Guide To Cloud

www.AGuideToCloud.com
Demo: Azure authentication A Guide To Cloud

Azure AD is a separate Azure service. You add users


and other security principals (such as an application) to
a security domain managed by Azure AD. This video

www.AGuideToCloud.com
describes how authentication works with Azure
Configure storage accounts A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 14:
Manage non-relational data stores in Azure
A Guide To Cloud

www.AGuideToCloud.com
Upload data to a Cosmos DB database, and learn how to
query this data
Lesson
objectives
Upload and download data in an Azure Storage account
Cosmos DB APIs A Guide To Cloud

www.AGuideToCloud.com
SQL API MongoDB API Cassandra API

Gremlin API Table API


A Guide To Cloud

Load data using the Cosmos DB Migration tool

You can use the Data Migration tool to import data to Azure Cosmos DB

www.AGuideToCloud.com
from a variety of sources, including:

▪ JSON files
▪ MongoDB
▪ SQL Server
▪ CSV files
▪ Azure Table storage
▪ Amazon DynamoDB
▪ HBase
▪ Azure Cosmos containers
Demo: Configure consistency A Guide To Cloud

Within a single region, Cosmos DB uses a cluster of


servers. This approach helps to improve scalability and
availability. A copy of all data is held in each server in the

www.AGuideToCloud.com
cluster. This video explains how this works, and the
effects it can have on consistency
Query Azure Cosmos DB A Guide To Cloud

SELECT Query Basics Examples

www.AGuideToCloud.com
SELECT <select_list> SELECT*
[FROM <optional_from_specification>] FROM Products p WHERE p.id ="1"
[WHERE <optional_filter_condition>] SELECT p.id, p.manufacturer, p.description
[ORDER BY <optional_sort_specification>] FROM Products p WHERE p.id ="1"
[JOIN <optional_join_specification>] SELECT p.price, p.description, p.productId
FROM Products p ORDER BY p.price ASC
SELECT p.productId
FROM Products p JOIN p.shipping
Manage Azure Blob storage A Guide To Cloud

www.AGuideToCloud.com
Manage Azure File storage A Guide To Cloud

www.AGuideToCloud.com
Copying to Azure storage A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

Lab: Upload, download, and query data in a non-relational data


store

www.AGuideToCloud.com
Go to the exercise Upload, download, and query data in a non-relational data
store module on Microsoft Learn, and follow the instructions in the module
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 15:
Module 3 Knowledge check
A Guide To Cloud

Q1: What are the elements of an Azure Table


storage key?

www.AGuideToCloud.com
DP-900
Module 03
❑ Table name and column name
Review Q&A
❑ Partition key and row key

❑ Row number
A Guide To Cloud

Q2: When should you use a block blob, and when


should you use a page blob?

www.AGuideToCloud.com
❑ Use a block blob for unstructured data that requires
DP-900 random access to perform reads and writes. Use a page
Module 03 blob for discrete objects that rarely change

Review Q&A
❑ Use a block blob for active data stored using the Hot
data access tier, and a page blob for data stored using
the Cool or Archive data access tiers

❑ Use a page block for blobs that require random read and
write access. Use a block blob for discrete objects that
change infrequently
A Guide To Cloud

Q3: Why might you use Azure File storage?

www.AGuideToCloud.com
DP-900 ❑ To share files that are stored on-premises with users
Module 03 located at other sites
Review Q&A
❑ To enable users at different sites to share files

❑ To store large binary data files containing images or


other unstructured data
A Guide To Cloud

Q4: You are building a system that monitors the temperature


throughout a set of office blocks, and sets the air conditioning in
each room in each block to maintain a pleasant ambient temperature.
Your system has to manage the air conditioning in several thousand

www.AGuideToCloud.com
buildings spread across the country/region, and each building
typically contains at least 100 air-conditioned rooms. What type of
DP-900 NoSQL data store is most appropriate for capturing the temperature
Module 03 data to enable it to be processed quickly?

Review Q&A ❑ Send the data to an Azure Cosmos DB database and


use Azure Functions to process the data

❑ Store the data in a file stored in a share created using


Azure File Storage

❑ Write the temperatures to a blob in Azure Blob storage


A Guide To Cloud

Q5: What is provisioning?

www.AGuideToCloud.com
DP-900 ❑ The act of running series of tasks that a service provider
Module 03 performs to create and configure a service
Review Q&A
❑ Providing other users access to an existing service

❑ Tuning a service to improve performance


A Guide To Cloud

Q6: What is a security principal?

www.AGuideToCloud.com
❑ A named collection of permissions that can be granted to
DP-900 a service, such as the ability to use the service to read,
write, and delete data. In Azure, examples
Module 03 include Owner and Contributor
Review Q&A
❑ A set of resources managed by a service to which you
can grant access

❑ An object that represents a user, group, service, or


managed identity that is requesting access to Azure
resources
A Guide To Cloud

Q7: Which of the following is an advantage of


using multi-region replication with

www.AGuideToCloud.com
Cosmos DB?
DP-900
Module 03
Review Q&A ❑ Data will always be consistent in every region

❑ Availability is increased

❑ Increased security for your data


A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 16:
Components of a modern data warehouse
A Guide To Cloud

Examine components of a modern data warehouse

www.AGuideToCloud.com
Explore data ingestion in Azure

Agenda
Explore data storage and processing in Azure

Get started building with Power BI


A Guide To Cloud

Explore data warehousing concepts

www.AGuideToCloud.com
Explore Azure data services for modern data warehousing

Lesson
objectives Explore modern data warehousing architecture and workload

Explore Azure data services in the Azure portal


Demo: Modern data warehouse components A Guide To Cloud

This video describes the components commonly used to


create a data warehouse, and how data might flow
through them. This video shows one particular approach

www.AGuideToCloud.com
What is modern data warehousing? A Guide To Cloud

Ingest & Prep Model & Serve Visualize

www.AGuideToCloud.com
Azure Data Factory Azure Synapse Analytics Power BI
Code-free data transformation and
(Data Warehouse) Leader in the Magic Quadrant for
ingestion from 90+ data integration Up to 14x faster and costs 94% less Business Intelligence and Analytics
connectors than other cloud providers Platforms*

Azure Databricks
(Data prep)
Up to 10x faster than vanilla Spark

Store
Azure Data Lake Storage
High performance data lake available
in all 54 Azure regions
Combine batch and stream processing A Guide To Cloud

Ingest & Prep Model & Serve Visualize

www.AGuideToCloud.com
Azure Data Factory Azure Synapse Power BI
Logs (unstructured) Analytics
Code-free data Leader in the Magic
transformation and ingestion (Data Warehouse) Quadrant for Business
from 90+ data integration Up to 14x faster and Intelligence and Analytics
connectors costs 94% less than Platforms*
Azure Databricks other cloud providers
Media (unstructured)
(Data prep)
Up to 10x faster than
vanilla Spark

Files (unstructured)

Store
Azure Data Lake Storage
Business/custom High performance data lake available
apps (structured) in all 54 Azure regions
A Guide To Cloud

Explore Azure data services for modern data warehousing


What is Azure Data Factory

www.AGuideToCloud.com
A cloud-based data integration service that allows you to
orchestrate and automate data movement and data
transformation
Azure Data Factory A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud
What is Azure Data Lake storage?

www.AGuideToCloud.com
A repository of data Organises data into Supports POSIX It is compatible with
for your Modern directories for and RBAC Hadoop Distributed
Data Warehouse improved file access permissions File System

Store
Azure Data Lake Storage
High performance data lake available
in all 54 Azure regions
Azure Data Lake Storage A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud
What is Azure Databricks?

www.AGuideToCloud.com
Apache Spark-based platform: Enterprise Security: Integration with Azure
Simplifies the provisioning and Utilizes the security capabilities services:
collaboration of Apache Spark- of Azure Can integrate with a variety of
based analytical solutions Azure data platform services and
Power BI
Azure Databricks A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud
What is Azure Synapse Analytics?

www.AGuideToCloud.com
A Guide To Cloud
What is Azure Analysis Services?

www.AGuideToCloud.com
A Guide To Cloud
What is Azure HDInsight?

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 17:
Explore data ingestion in Azure
A Guide To Cloud

Describe data ingestion in Azure

www.AGuideToCloud.com
Lesson
Describe components of Azure Data Factory
objectives

See how to use Azure Data Factory to load data into a data
warehouse
Describe data ingestion in Azure A Guide To Cloud

ADF PolyBase SSIS

www.AGuideToCloud.com
70

100

80

Heterogenous File based Heterogenous


Describe components of Azure Data Factory A Guide To Cloud

Linked Service Triggers


@ Parameters

www.AGuideToCloud.com
Integration
IR
Runtime
Data
Lake Store
Pipeline
CF Control
Flow

Activities
Azure
Databricks
Dataset
Demo: Load data into Azure Synapse Analytics A Guide To Cloud

Imagine that you’re part of a team that is analyzing house price


data. The dataset that you receive contains house price
information for several regions. Your team needs to report on

www.AGuideToCloud.com
how the house prices in each region have varied over the last
few months. To achieve this, you need to ingest the data into
Azure Synapse Analytics. You’ve decided to use
Azure Data Factory to perform this task
In this video, you’ll see how to use Azure Data Factory to
ingest and process house price data for analysis
You’ll store the data in Azure Synapse Analytics for later
analysis
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 18:
Explore data storage and processing in Azure
A Guide To Cloud

www.AGuideToCloud.com
Describe data processing options for performing analytics
in Azure
Lesson
objectives
Explore Azure Synapse Analytics
A Guide To Cloud

Data processing options for performing analytics in Azure

www.AGuideToCloud.com
Azure Synapse Azure Azure Azure Data Data
Analytics Databricks HDInsight Factory Lake Store
Explore Azure Synapse Analytics A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 19:
Get started building with Power BI
A Guide To Cloud

Learn how Power BI services and applications work together

www.AGuideToCloud.com
Lesson
Explore how Power BI can make your business more efficient
objectives

Learn how to create compelling visuals and reports


Power BI services and applications work together
A Guide To Cloud

www.AGuideToCloud.com
A Guide To Cloud

Explore how Power BI can make your business more


efficient

www.AGuideToCloud.com
A Guide To Cloud

Learn how to create compelling visuals and reports

www.AGuideToCloud.com
A Guide To Cloud

www.AGuideToCloud.com
Visualizations
A Guide To Cloud

www.AGuideToCloud.com
Datasets
A Guide To Cloud

www.AGuideToCloud.com
Reports
A Guide To Cloud

www.AGuideToCloud.com
Dashboards
&
Tiles
A Guide To Cloud

www.AGuideToCloud.com
DP-900 Episode 20:
Module 4 Knowledge check
A Guide To Cloud

Q1: When should you use Azure Synapse


Analytics?

www.AGuideToCloud.com
DP-900
Module 04 ❑ To perform very complex queries and aggregations
Review Q&A
❑ To create dashboards from tabular data

❑ To enable large number of users to query analytics data


A Guide To Cloud

Q2: What is the purpose of data ingestion?

www.AGuideToCloud.com
DP-900 ❑ To perform complex data transformations over data
Module 04 received from external sources
Review Q&A
❑ To capture data flowing into a data warehouse system
as quickly as possible

❑ To visualize the results of data analysis


A Guide To Cloud

Q3: What is the primary difference between a data


lake and a data warehouse?

www.AGuideToCloud.com
DP-900
❑ A data lake contains structured information, but a data
Module 04 warehouse holds raw business data
Review Q&A
❑ A data lake holds raw data, but a data warehouse
holds structured information

❑ Data stored in a data lake is dynamic, but information


stored in a data warehouse is static
A Guide To Cloud

Q4: Which component of an Azure Data Factory


can be triggered to run data ingestion tasks?

www.AGuideToCloud.com
DP-900
Module 04
Review Q&A ❑ CSV File

❑ Pipeline

❑ Linked service
A Guide To Cloud

Q5: When might you use PolyBase?

www.AGuideToCloud.com
DP-900
Module 04 ❑ To query data from external data sources from Azure SQL
Database
Review Q&A
❑ To ingest streaming data using Azure Databricks

❑ To orchestrate activities in Azure Data Factory


A Guide To Cloud

Q6: Which of these services can be used to


ingest data into Azure Synapse Analytics?

www.AGuideToCloud.com
DP-900
Module 04 ❑ Azure Data Factory
Review Q&A
❑ Power BI

❑ Azure Active Directory


A Guide To Cloud

Q7: You have a large amount of data held in files


in Azure Data Lake storage. You want to retrieve

www.AGuideToCloud.com
the data in these files and use it to populate
DP-900 tables held in Azure Synapse Analytics. Which
Module 04 processing option is most appropriate?
Review Q&A ❑ Use Azure Synapse Link to connect to Azure Data Lake
storage and download the data

❑ Synapse SQL pool

❑ Synapse Spark pool


A Guide To Cloud

Q8: Which of the components of Azure Synapse


Analytics allows you to train AI models using

www.AGuideToCloud.com
AzureML?
DP-900
Module 04
Review Q&A ❑ Synapse Studio

❑ Synapse Pipelines

❑ Synapse Spark
A Guide To Cloud

Q9: In Azure Databricks how do you change the


language a cell uses?

www.AGuideToCloud.com
DP-900
Module 04
❑ The first line in the cell is %language. For example, %scala
Review Q&A
❑ Change the notebook language before writing the commands

❑ Wrap the command in the cell with ##language##


A Guide To Cloud

Q10: What is the common flow of activity in


Power BI?

www.AGuideToCloud.com
❑ Create a report in Power BI mobile, share it to the Power BI
Desktop, view and interact in the Power BI service
DP-900
Module 04 ❑ Create a report in the Power BI service, share it to Power BI mobile,
Review Q&A interact with it in Power BI Desktop

❑ Bring data into Power BI Desktop and create a report, share it to the
Power BI service, view and interact with reports and dashboards in
the service and Power BI mobile

❑ Bring data into Power BI mobile, create a report, then share it to


Power BI Desktop
A Guide To Cloud

Q11: Which of the following are building blocks of


Power BI?

www.AGuideToCloud.com
DP-900 ❑ Tiles, dashboards, databases, mobile devices
Module 04
❑ Visualizations, datasets, reports, dashboards, tiles
Review Q&A
❑ Visual Studio, C#, and JSON files
A Guide To Cloud

Q12: A collection of ready-made visuals, pre-


arranged in dashboards and reports is called

www.AGuideToCloud.com
what in Power BI?
DP-900
Module 04
❑ The canvas
Review Q&A
❑ Scheduled refresh

❑ An app
A Guide To Cloud

www.AGuideToCloud.com
THANK YOU!

You might also like