Professional Documents
Culture Documents
www.AGuideToCloud.com
DP-900 Episode 1:
Course Introduction
Hello! Instructor Introduction A Guide To Cloud
www.AGuideToCloud.com
Susanth Sutheesh
Blog: AGuideToCloud.com
@AGuideToCloud
A Guide To Cloud
www.AGuideToCloud.com
Skills Weights
DP-900 Describe core data concepts 15-20%
Module Lessons
Module 1: • Explore core data concepts
Explore core data concepts • Explore roles and responsibilities in the world of data
• Describe concepts of relational data
www.AGuideToCloud.com
• Explore concepts of non-relational data
• Explore concepts of data analytics
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 2:
Explore core data concepts
A Guide To Cloud
www.AGuideToCloud.com
Explore roles and responsibilities in the world of data
www.AGuideToCloud.com
Identify characteristics of relational and non-relational data
Learning
objectives Describe and differentiate data workloads
www.AGuideToCloud.com
Table
A Guide To Cloud
www.AGuideToCloud.com
Structured Data
Key-value Stores and Graph databases A Guide To Cloud
www.AGuideToCloud.com
Transactional vs analytical data stores A Guide To Cloud
Customer
www.AGuideToCloud.com
CustomerID CustomerName CustomerPhone
Orders
OrderID CustomerID OrderDate
Transactional workloads A Guide To Cloud
Customer Account
www.AGuideToCloud.com
5558 500
1000
6023 2000
1500
Orders Transfers
OrderID CustomerID OrderDate TransactionID FromAccount ToAccount Transaction Amount OrderDate TransactionDescription
982801 6023 5558 500 DD/MM/YY Transfer 500 from
account 6023 to
account
BEGIN TRANSACTION
UPDATE Account
SET Balance = Balance -500
WHERE CustomerID=6023;
UPDATE Account
SET Balance = Balance +500
WHERE CustomerID=5558;
INSERT INTO Transfers (Fromaccount, ToAccount, TransactionAmount,TransactionDescription)
VALUES (6023,5558,500,’Transfer 500 from account 6023 to account 5558)
COMMIT TRANSACTIONTransaction
Analytical System A Guide To Cloud
www.AGuideToCloud.com
Analytical system A Guide To Cloud
www.AGuideToCloud.com
On-premises data
SQL Server, Oracle, Data ingestion Data storage Data processing Data visualization
fileshares, SAP
Cloud data
Azure, AWS, GCP
SaaS data
Salesforce, Dynamics
Batch data/streaming data A Guide To Cloud
www.AGuideToCloud.com
Batch vs. Streaming data A Guide To Cloud
Data Scope
www.AGuideToCloud.com
Data Size
Performance
Analysis
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 3:
Roles and responsibilities in the world of data
A Guide To Cloud
www.AGuideToCloud.com
Lesson
Explore common tasks and tools for data job roles
objectives
Roles in data A Guide To Cloud
www.AGuideToCloud.com
Database Administrator Data Engineer Data Analyst
Database Management Data Pipelines and processes Provides insights into the
data
Implements Data Security Data Ingestion storage
Visual Reporting
Backups Prepare data for Analytics
Modeling Data for Analysis
User Access Prepare data for analytical
processing Combines data for
Monitors performance
visualization
and analysis
Common tools – Database administrator A Guide To Cloud
www.AGuideToCloud.com
Management Studio
Graphical interface for managing Graphical interface for managing Tools for management and
on-premises and cloud-based on-premises and cloud-based provisioning of Azure
data services data services Data Services
Runs on Windows, macOS, Linux Runs on Windows Manual and automation of
scripts using Azure Resource
Comprehensive Database
Manager or Command Line
Administration tool
Interface scripting
What is Data Studio? A Guide To Cloud
www.AGuideToCloud.com
What is SQL Server Management Studio? A Guide To Cloud
www.AGuideToCloud.com
Azure portal to manage Azure SQL Database A Guide To Cloud
www.AGuideToCloud.com
Common tools – Data engineering A Guide To Cloud
www.AGuideToCloud.com
Management Studio
Azure Portal integrated to manage Graphical interface for managing Tools for management and
Azure Synapse on-premises and cloud-based data provisioning of Azure resources
services
Data Ingestion (Azure Data Manual and automation of scripts
Factory) Runs on Windows using Azure Resource Manager or
Command Line Interface scripting
Management of Azure Synapse Comprehensive Database
assets (SQL Pools/Spark Pool) Administration tool
Common tools – Data analyst A Guide To Cloud
www.AGuideToCloud.com
Power BI Service
Data Visualization tool Authoring and management of Data Visualization tool for paginated
Power BI reports reports
Model and Visualize Data
Authoring of Power BI dashboards Model and Visualize paginated
Management of Azure Synapse
reports
assets (SQL Pools/Spark Pool) Share Reports/Datasets
Data Visualization Tools A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 4:
Describe concepts of relational data
A Guide To Cloud
www.AGuideToCloud.com
Lesson
Define tables, indexes, and views
objectives
Customers
CustomerID CustomerName CustomerPhone
Data is stored in a table
www.AGuideToCloud.com
100 Muisto Linna XXX-XXX-XXXX
101 Noam Maoz XXX-XXX-XXXX
Table consists of rows and columns
102 Vanja Matkovic XXX-XXX-XXXX
103 Qamar Mounir XXX-XXX-XXXX
104 Zhenis Omar XXX-XXX-XXXX All rows have same # of columns
105 Claude Paulet XXX-XXX-XXXX
106 Alex Pettersen XXX-XXX-XXXX
Each column is defined by a datatype
107 Francis Ribeiro XXX-XXX-XXXX
A Guide To Cloud
www.AGuideToCloud.com
Tables cont..
A Guide To Cloud
www.AGuideToCloud.com
Tables cont..
Normalization A Guide To Cloud
Customers Orders
CustomerID CustomerName CustomerPhone OrderID CustomerName CustomerPhone
www.AGuideToCloud.com
100 Muisto Linna XXX-XXX-XXXX AD100 Noam Maoz XXX-XXX-XXXX
101 Noam Maoz XXX-XXX-XXXX AD101 Noam Maoz XXX-XXX-XXXX
102 Vanja Matkovic XXX-XXX-XXXX AD102 Noam Maoz XXX-XXX-XXXX
103 Qamar Mounir XXX-XXX-XXXX AX103 Qamar Mounir XXX-XXX-XXXX
104 Zhenis Omar XXX-XXX-XXXX AS104 Qamar Mounir XXX-XXX-XXXX
105 Claude Paulet XXX-XXX-XXXX AR105 Claude Paulet XXX-XXX-XXXX
106 Alex Pettersen XXX-XXX-XXXX MK106 Muisto Linna XXX-XXX-XXXX
Customers Orders
CustomerID CustomerName CustomerPhone OrderID CustomerID SalesPersonID
100 Muisto Linna XXX-XXX-XXXX AD100 101 200
www.AGuideToCloud.com
101 Noam Maoz XXX-XXX-XXXX AD101 101 200
102 Vanja Matkovic XXX-XXX-XXXX AD102 101 200
103 Qamar Mounir XXX-XXX-XXXX AX103 103 201
104 Zhenis Omar XXX-XXX-XXXX AS104 103 201
105 Claude Paulet XXX-XXX-XXXX AR105 105 200
106 Alex Pettersen XXX-XXX-XXXX MK106 105 201
Customers IDX-CustomerRegion
CustomerID CustomerName CustomerPhone CustomerID Region
www.AGuideToCloud.com
100 Muisto Linna XXX-XXX-XXXX 100 France
101 Noam Maoz XXX-XXX-XXXX 101 Brazil
102 Vanja Matkovic XXX-XXX-XXXX 102 Croatia
103 Qamar Mounir XXX-XXX-XXXX 103 Jordan
104 Zhenis Omar XXX-XXX-XXXX 104 Spain
105 Claude Paulet XXX-XXX-XXXX 105 France
106 Alex Pettersen XXX-XXX-XXXX 106 USA
An index:
Reduces the amount of data pages that need to Data is retrieved by joining tables together
Optimizes search queries for faster data retrieval
be read to retrieve the data in a SQL Statement in a query
View A Guide To Cloud
www.AGuideToCloud.com
SELECT Customers.CustomerID,
100 Muisto Linna XXX-XXX-XXXX AD100 101 200 Customers.CustomerName,
101 Noam Maoz XXX-XXX-XXXX AD101 101 200 Orders.OrderID FROM Customers
JOIN Orders on
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 5:
Explore concepts of non-relational data
A Guide To Cloud
www.AGuideToCloud.com
Lesson
Define types of non-relational data
objectives
www.AGuideToCloud.com
Name: Mark Hanson
Telephone: [ Home: 1-999-9999999, Business: 1-888-8888888, Cell: 1-777- 7777777 ]
Address: [ Home: 121 Main Street, Some City, NY, 10110,
Business: 87 Big Building, Some City, NY, 10111 ]
## Customer 2 ID: 2
Title: Mr
Name: Jeff Hay
Telephone: [ Home: 0044-1999-333333, Mobile: 0044-17545-444444 ]
Address: [ UK: 86 High Street, Some Town, A County, GL8888, UK,
US: 777 7th Street, Another City, CA, 90111 ]
Multiple entities in the same collection or Have a different, Are often defined by labeling each field with the
container with different fields non-tabular schema name it represents
A Guide To Cloud
Explore characteristics of non-relational data
www.AGuideToCloud.com
A Guide To Cloud
Identify non-relational database use cases
www.AGuideToCloud.com
Retail and Marketing:
Gaming
www.AGuideToCloud.com
JSON AVRO ORC Parquet
What is unstructured data? A Guide To Cloud
www.AGuideToCloud.com
Often used to extract data form and categorize or identify “structures”
www.AGuideToCloud.com
Column
Key-value Document Graph
family
stores based Databases
databases
What is a graph database? A Guide To Cloud
www.AGuideToCloud.com
Stores entities centric around relationships
Business requirements:
www.AGuideToCloud.com
OLTP apps with highly correlated data
Easy updates to single or many objects
Flexible data modelling
Data requirements that evolve
Hierarchical data structures
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 6:
Explore concepts of data analytics
A Guide To Cloud
www.AGuideToCloud.com
Lesson
Explore data visualization
objectives
www.AGuideToCloud.com
Data Data Data
Critical ingestion processing exploration
device data
Queries
Financial
transactions
Point-of-Sale data
What is data processing? A Guide To Cloud
www.AGuideToCloud.com
Data
processing
Functions Cognitive Services
Raw
Data
Transform
www.AGuideToCloud.com
Basic filtering and
transformations
Extract Load
Load Transform
www.AGuideToCloud.com
Complex
processing
Extract
Explore data visualization A Guide To Cloud
www.AGuideToCloud.com
Power BI
A Guide To Cloud
Explore data analytics
www.AGuideToCloud.com
Descriptive Diagnostic Predictive Prescriptive Cognitive
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 7:
Module 1 Knowledge check
A Guide To Cloud
www.AGuideToCloud.com
DP-900
Module 01 ❑ Rows and Columns
www.AGuideToCloud.com
unstructured data?
DP-900
Module 01
Review Q&A ❑ An Employee table with columns Employee ID, Employee
Name, and Employee Designation
www.AGuideToCloud.com
streaming dataset?
DP-900
Module 01
Review Q&A ❑ Data from sensor feeds
www.AGuideToCloud.com
database administrator?
DP-900
Module 01
Review Q&A ❑ Backing up and restoring databases
www.AGuideToCloud.com
and reporting tool?
DP-900
Module 01
Review Q&A ❑ SQL Server Management Studio
❑ Power BI
❑ SQL
A Guide To Cloud
www.AGuideToCloud.com
data job role?
DP-900
Module 01
Review Q&A ❑ Systems Administrator
❑ Data Analyst
❑ Database Administrator
A Guide To Cloud
www.AGuideToCloud.com
characteristic of a relational database?
DP-900
Module 01
Review Q&A ❑ All data must be stored as character strings
www.AGuideToCloud.com
DP-900
Module 01 ❑ A structure that enables you to locate rows in a table
Review Q&A quickly, using an indexed value
www.AGuideToCloud.com
on-premises system, to run your database
DP-900 management systems?
Module 01
Review Q&A
❑ Increased day-to-day management costs
❑ Increased scalability
❑ Increased functionality
A Guide To Cloud
www.AGuideToCloud.com
DP-900
Module 01
Review Q&A
❑ Azure Cosmos DB
www.AGuideToCloud.com
DP-900
Module 01
❑ Non-relational databases contain tables with flat fixed-column records
Review Q&A
❑ Non-relational databases require you to use data normalization techniques to
reduce data duplication
Q12: You are building a system that monitors the temperature throughout
a set of office blocks, and sets the air conditioning in each room in each
block to maintain a pleasant ambient temperature. Your system has to
www.AGuideToCloud.com
manage the air conditioning in several thousand buildings spread across
the country or region, and each building typically contains at least 100 air-
DP-900 conditioned rooms. What type of NoSQL data store is most appropriate for
capturing the temperature data to enable it to be processed quickly?
Module 01
Review Q&A
❑ A key-value store
www.AGuideToCloud.com
DP-900
❑ The process of transforming raw data into models containing
Module 01
meaningful information
Review Q&A
❑ Analyzing data for anomalies
www.AGuideToCloud.com
DP-900
Module 01
❑ Key influencers
Review Q&A
❑ Column and bar chart
❑ Matrix chart
A Guide To Cloud
www.AGuideToCloud.com
DP-900
Module 01
❑ Descriptive analytics
Review Q&A
❑ Prescriptive analytics
❑ Predictive analytics
A Guide To Cloud
www.AGuideToCloud.com
Explore provisioning and deploying relational database
Agenda offerings in Azure
www.AGuideToCloud.com
DP-900 Episode 8:
Explore relational data offerings in Azure
A Guide To Cloud
www.AGuideToCloud.com
Lesson Explore provisioning and deploying of relational
objectives database offerings in Azure
www.AGuideToCloud.com
SQL Server on Azure Virtual Azure SQL Managed Instance Azure SQL Database
Machines Best for modernizing existing apps Best for building new apps
Best for re-hosting and apps requiring Offers high compatibility with SQL in the cloud
OS-level access and control Server and native VNET support Pre-provisioned or serverless compute
Automated manageability features and Hyperscale storage to meet
and OS-level access demanding workload requirements
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
Azure SQL Elastic Pool
Azure SQL Managed Instance A Guide To Cloud
www.AGuideToCloud.com
SQL Server on Azure virtual machines A Guide To Cloud
www.AGuideToCloud.com
I want to migrate to the cloud as
access for SQL Server 2008/R2
fast as possible but maintain
operating system control and ▪ Expansive SQL and OS ▪ Automated Backups and Security
Updates
complete SQL Server versions
functionality ▪ Point in Time Restore with Azure
▪ Windows, Linux, Containers Backup
▪ File stream, DTC, and Simple ▪ Accelerated storage performance
Solution: Recovery model with Azure Blob Caching
Get the combined performance, ▪ SSAS, SSRS, and SSIS ▪ 435 percent overall return on an
security, and analytics of SQL Azure IaaS investment over
Server, backed by the flexibility, five years1
security, and hybrid connectivity
of Azure
A Guide To Cloud
SQL Server on Azure VM Deployment choices
Deployment Marketplace pre-installed SQL Server on Windows or Linux | Install your own SQL Server | Lift and Shift with Azure Migrate (Azure Site
Choices Recovery)
www.AGuideToCloud.com
Resource
Unlock Licensing and Edition Flexibility | Automated Backups and Security Updates | Manage VMs through Azure SQL in portal
Provider
Sizes and Memory or Storage optimized sizes for best performance Tempdb on local SSD
Storage Data and log on Premium Storage Managed Disks Ultra disks for extremely low latency needs
Performance Azure Blob Read Caching for data disks
Azure VM built-in HA Failover Cluster Instance with Azure Premium File Share
Azure Storage built-in DR Always On Availability Groups with Cloud Witness
HADR Azure Backup and Automated backups to Hybrid Availability Group Secondary replicas
Azure Blob Storage HADR on RedHat Linux with Pacemaker and fencing
File-Snapshot Backups
IaaS vs PaaS A Guide To Cloud
www.AGuideToCloud.com
High availability Advanced security
www.AGuideToCloud.com
I want to build modern apps,
potentially multi-tenanted, with the ▪ Single database or elastic ▪ Industry highest availability
highest uptime and predictable pool SLA of 99.995%
performance ▪ Hyperscale storage (100TB+) ▪ Industry only business
continuity SLA with 5 second
▪ Serverless compute
RPO and 30 second RTO
Solution: ▪ Fully managed service
▪ Price-performance leader for
Azure SQL Database is a highly ▪ Private link support mission-critical workloads
scalable cloud database service ▪ High availability with AZ while costing up to 86 percent
with built-in high availability and isolation less than AWS RDS
machine learning (GigaOm)
Azure SQL DB service tiers A Guide To Cloud
www.AGuideToCloud.com
Most business workloads Workloads that require low latency, fast Most business workloads
recovery, and a readable secondary with highly scalable storage and
read-scale requirements
P P S S R P R R R R
*Not in managed instance
Azure SQL DB managed instance A Guide To Cloud
www.AGuideToCloud.com
remove management overhead, ▪ Single instance or
▪ Near zero downtime
but I need instance-scoped instance pool
migration using log shipping
features (Service Broker, SQL Server ▪ SQL Server surface area
Agent, CLR…) ▪ Fully managed business
(vast majority)
continuity with failover groups
▪ Native virtual network
▪ Projected return on
Solution: support
investment of 212 percent
Managed instance combines ▪ Fully managed service over three years1
leading security features with SQL
▪ On-premise identities enabled ▪ The best of SQL Server with
Server compatibility and business
with Azure AD and AD the benefits of a managed
model designed for on-premises
Connect service
customers
Managed Instance service tiers A Guide To Cloud
www.AGuideToCloud.com
Most business workloads Workloads that require low latency, fast recovery, and a
readable secondary
vCore model
Independent scalability
P P S S R
Azure SQL Managed Instance or DB A Guide To Cloud
www.AGuideToCloud.com
Azure SQL Managed Instance Azure SQL Database
www.AGuideToCloud.com
PostgreSQL is the MySQL is a leading open MariaDB is a
most popular and source relational database community-developed fork
wanted database for for LAMP stack apps of MySQL with strong focus
modern apps on the user community
A Guide To Cloud
www.AGuideToCloud.com
Fully managed community database:
Take advantage of a fully managed service while still using the tools and languages you’re familiar with
www.AGuideToCloud.com
Azure builds upon the core benefits
of PostgreSQL and Open Source
www.AGuideToCloud.com
Fully managed and secure Intelligent performance Flexible and open High performance
Focus on your apps while Azure optimization Stay productive with your scale-out with Hyperscale
manages resource-intensive Improve performance and favorite Postgres extensions and Break free from the limits of
tasks, supports a large variety of reduce cost with customized leverage Microsoft’s single-node Postgres and scale
Postgres versions and provides recommendations contributions to the Postgres out across 100s of nodes
best-in industry indemnification community
coverage
Single Server
Hyperscale
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 9:
Deploying relational database offerings in Azure
A Guide To Cloud
www.AGuideToCloud.com
Configure relational data services
Lesson
objectives Explore basic connectivity issues
www.AGuideToCloud.com
Configure relational data services A Guide To Cloud
www.AGuideToCloud.com
connectivity settings & create
Subscription Public vs Private access Data source (DB) Terms and Privacy
Resource group VNet/Firewall rules Server Collation (MI)
Managed Instance/ Connection type (MI) Database Collation (DB)
Server name Time zone (MI)
Database Name (DB) Opt-in for Advanced
Admin Login data security (DB)
Password
Region
Opt-in for pools (DB)
Compute + storage
Connectivity and Firewalls A Guide To Cloud
WEST US
mysqldbsrv.database.windows.net
GW GW
westus1-a.control.database.windows.net
www.AGuideToCloud.com
23.99.34.75
104.42.238.205,1433
GW GW
proxy
GW
(1) redirect-find-db
GW GW
104.42.238.205
www.AGuideToCloud.com
US EAST
127.33.201.5
10.0.0.3
Firewall Rules
VMVNET-WUS
174.17.218.16
10.0.0.2 10.0.0.5
US WEST
mysqldbsrv.database.
windows.net
Virtual Private Endpoint westus1-a.control.
mysqldbsrv.privatelink.
database.windows.net
Network Rules 10.0.0.1
102.14.157.9
104.42.238.205
10.0.0.5
Private Link
On-premises
Vnet2Vnet P2S, S2S VPN Express Route
Authentication and Access Control A Guide To Cloud
www.AGuideToCloud.com
Member of sysadmin server role for MI
All Azure operations for Azure SQL are controlled through RBAC
Think of this as security rights outside the Managed Instance or Database
www.AGuideToCloud.com
Security principal and role-based system
Scope includes subscription, resource group, and resource
Decoupled from SQL Security (today)
Applies to operations in Azure portal and CLI
Allows for separation of duties for deployment, management, and usage
Azure locks help protect resources from delete or read-only
Built-in Azure SQL roles available to reduce need for owner
www.AGuideToCloud.com
This video demonstrates how to provision an Azure SQL
Database instance, to create a database and server
Demo: Provision Azure SQL Database A Guide To Cloud
www.AGuideToCloud.com
Database instance, to create a database and server
Azure DB – Read replicas A Guide To Cloud
www.AGuideToCloud.com
Master server
Asynchronous
updates
Read Replica #1 Read Replica #2 Read Replica #3 Read Replica #4 Read Replica #5
As part of your role at Contoso as a data engineer, you’ve been asked to create
and configure SQL Server, PostgreSQL, and MySQL servers for Azure
Go to the exercise Provision non-relational Azure data services module on
www.AGuideToCloud.com
Microsoft Learn, and follow the instructions in the module to create data stores
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 10:
Query relational data in Azure
A Guide To Cloud
www.AGuideToCloud.com
Lesson
Describe query techniques for data using the SQL language
objectives
Introduction to SQL A Guide To Cloud
www.AGuideToCloud.com
SQL standards are maintained by ANSI and ISO
Proprietary RDBMS systems have their own extensions of SQL such as T-SQL, PL/SQL,
pgSQL
SQL Statement types A Guide To Cloud
www.AGuideToCloud.com
Data Manipulation Data Definition Language Data Control Language
Language
Used to define database Used to manage security
Used to query and objects permissions
manipulate data
CREATE, ALTER, DROP GRANT, REVOKE, DENY
SELECT, INSERT,
UPDATE, DELETE
Use DML statements A Guide To Cloud
Statement Description
www.AGuideToCloud.com
SELECT Select/read from a table
INSERT Insert new rows in a table
UPDATE Edit/Update existing rows in a table
DELETE Delete existing rows in a table
Elements of the SELECT Statement A Guide To Cloud
Clause Expression
www.AGuideToCloud.com
SELECT <select list>
FROM <table or view>
WHERE <search condition>
GROUP BY <group by list>
ORDER BY <order by list>
Example of SELECT statement A Guide To Cloud
www.AGuideToCloud.com
FROM Sales.Orders
WHERE CustomerId = 71
GROUP BY EmployeeId, YEAR(OrderDate)
HAVING COUNT(*) > 1
ORDER BY EmployeeId, OrderYear;
Example of INSERT statement A Guide To Cloud
www.AGuideToCloud.com
INSERT INTO Sales.OrderDetails
(orderid, productid, unitprice, qty, discount)
VALUES (10255,39,18,2,0.05);
Table and row constructors add multirow capability to INSERT ... VALUES
INSERT INTO Sales.OrderDetails
(orderid, productid, unitprice, qty, discount)
VALUES
(10256,39,18,2,0.05),
(10258,39,18,5,0.10);
Use DDL statements A Guide To Cloud
Statement Description
www.AGuideToCloud.com
CREATE Create a new object in the database, such as a table or a view
Modify the structure of an object. For instance, altering a table to add a
INSERT
new column
UPDATE Remove an object from the database
DELETE Rename an existing object
Example of CREATE statement A Guide To Cloud
www.AGuideToCloud.com
NULL , Mycolumn2 VARCHAR(10) NOT NULL
Query tools A Guide To Cloud
www.AGuideToCloud.com
Azure Portal SQL Management Studio SQL Server Data Tools
www.AGuideToCloud.com
SQLCMD A Guide To Cloud
www.AGuideToCloud.com
Azure SQL Data Studio A Guide To Cloud
www.AGuideToCloud.com
SQL Management Studio A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 11:
Module 2 Knowledge check
A Guide To Cloud
www.AGuideToCloud.com
Server on-premises solution?
DP-900
Module 02
❑ Azure SQL Database Managed Instance
Review Q&A
❑ SQL Server running on a virtual machine
www.AGuideToCloud.com
DP-900 ❑ You must install and maintain the software for the
Module 02 database management system yourself, but backups are
Review Q&A automated
www.AGuideToCloud.com
DP-900 ❑ Scaling up doesn’t take effect until you restart the
Module 02 database
Review Q&A
❑ Scaling out doesn’t take effect until you restart the
database
www.AGuideToCloud.com
implement backups?
DP-900
Module 02 ❑ Manual Configuration of the SQL server
Review Q&A ❑ Create a scheduled task to back up
www.AGuideToCloud.com
PostgreSQL service?
DP-900
Module 02 ❑ Export the data from the on-premises database and
Review Q&A import it manually into the database running
in Azure
www.AGuideToCloud.com
Explore provisioning and deploying non-relational data
Agenda services in Azure
www.AGuideToCloud.com
DP-900 Episode 12:
Explore non-relational data offerings in Azure
A Guide To Cloud
www.AGuideToCloud.com
Azure Blob storage
Lesson
objectives Explore use-cases and management benefits of using
Azure File storage
Key Value
(Customer ID) (Customer Data)
www.AGuideToCloud.com
C1 AAAAA BBB 101 Block Street YY 999 888
C2 MM NN 21 A Street 5 B Avenue
www.AGuideToCloud.com
Has a maximum size of 4.7TB Can hold up to 8TB of data The maximum size is just over
195GB
Best for storing large, discrete, Is organized as a collection of
binary objects that changes fixed sized-512 byte pages Is a block blob that is used to
infrequently optimize append operations
Used to implement virtual disk
Each individual block can storage for virtual machines Each individual block can
store up to 100MB of data store up to 4MB of data
A block blob can contain up to
50000 blocks
Explore Azure File storage A Guide To Cloud
www.AGuideToCloud.com
Explore Azure Cosmos DB A Guide To Cloud
www.AGuideToCloud.com
Scalability Performance Availability Programming
model
Use cases for Azure Cosmos DB A Guide To Cloud
www.AGuideToCloud.com
Using Azure Cosmos DB’s multi- The database tier is a crucial Hundreds of thousands of devices
master replication model along component of gaming have been designed and sold to
with Microsoft’s performance applications. Modern games generate sensor data known as
commitments, Data Engineers can perform graphical processing on Internet of Things (IoT) devices.
implement a data architecture to mobile/console clients but rely on Using technologies like Azure IoT
support web and mobile the cloud to deliver customized Hub, Data Engineers can easily
applications that achieve less than and personalized content like design a data solution architecture
a 10-ms response time anywhere in-game stats, social media that captures real-time data.
in the world integration, and high-score Cosmos DB can accept and store
leader boards this information very quickly
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 13:
Deploying non-relational data services in Azure
A Guide To Cloud
www.AGuideToCloud.com
Configure non-relational data services
Lesson
objectives Explore basic connectivity issues
www.AGuideToCloud.com
Provisioning Cosmos DB A Guide To Cloud
www.AGuideToCloud.com
Demo: How to provision a Cosmos DB account A Guide To Cloud
www.AGuideToCloud.com
PowerShell, or an Azure Resource Manager template.
This video describes how to use the Azure portal
Demo A Guide To Cloud
www.AGuideToCloud.com
Provisioning Data Lake storage A Guide To Cloud
www.AGuideToCloud.com
Demo: Azure authentication A Guide To Cloud
www.AGuideToCloud.com
describes how authentication works with Azure
Configure storage accounts A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 14:
Manage non-relational data stores in Azure
A Guide To Cloud
www.AGuideToCloud.com
Upload data to a Cosmos DB database, and learn how to
query this data
Lesson
objectives
Upload and download data in an Azure Storage account
Cosmos DB APIs A Guide To Cloud
www.AGuideToCloud.com
SQL API MongoDB API Cassandra API
You can use the Data Migration tool to import data to Azure Cosmos DB
www.AGuideToCloud.com
from a variety of sources, including:
▪ JSON files
▪ MongoDB
▪ SQL Server
▪ CSV files
▪ Azure Table storage
▪ Amazon DynamoDB
▪ HBase
▪ Azure Cosmos containers
Demo: Configure consistency A Guide To Cloud
www.AGuideToCloud.com
cluster. This video explains how this works, and the
effects it can have on consistency
Query Azure Cosmos DB A Guide To Cloud
www.AGuideToCloud.com
SELECT <select_list> SELECT*
[FROM <optional_from_specification>] FROM Products p WHERE p.id ="1"
[WHERE <optional_filter_condition>] SELECT p.id, p.manufacturer, p.description
[ORDER BY <optional_sort_specification>] FROM Products p WHERE p.id ="1"
[JOIN <optional_join_specification>] SELECT p.price, p.description, p.productId
FROM Products p ORDER BY p.price ASC
SELECT p.productId
FROM Products p JOIN p.shipping
Manage Azure Blob storage A Guide To Cloud
www.AGuideToCloud.com
Manage Azure File storage A Guide To Cloud
www.AGuideToCloud.com
Copying to Azure storage A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
Go to the exercise Upload, download, and query data in a non-relational data
store module on Microsoft Learn, and follow the instructions in the module
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 15:
Module 3 Knowledge check
A Guide To Cloud
www.AGuideToCloud.com
DP-900
Module 03
❑ Table name and column name
Review Q&A
❑ Partition key and row key
❑ Row number
A Guide To Cloud
www.AGuideToCloud.com
❑ Use a block blob for unstructured data that requires
DP-900 random access to perform reads and writes. Use a page
Module 03 blob for discrete objects that rarely change
Review Q&A
❑ Use a block blob for active data stored using the Hot
data access tier, and a page blob for data stored using
the Cool or Archive data access tiers
❑ Use a page block for blobs that require random read and
write access. Use a block blob for discrete objects that
change infrequently
A Guide To Cloud
www.AGuideToCloud.com
DP-900 ❑ To share files that are stored on-premises with users
Module 03 located at other sites
Review Q&A
❑ To enable users at different sites to share files
www.AGuideToCloud.com
buildings spread across the country/region, and each building
typically contains at least 100 air-conditioned rooms. What type of
DP-900 NoSQL data store is most appropriate for capturing the temperature
Module 03 data to enable it to be processed quickly?
www.AGuideToCloud.com
DP-900 ❑ The act of running series of tasks that a service provider
Module 03 performs to create and configure a service
Review Q&A
❑ Providing other users access to an existing service
www.AGuideToCloud.com
❑ A named collection of permissions that can be granted to
DP-900 a service, such as the ability to use the service to read,
write, and delete data. In Azure, examples
Module 03 include Owner and Contributor
Review Q&A
❑ A set of resources managed by a service to which you
can grant access
www.AGuideToCloud.com
Cosmos DB?
DP-900
Module 03
Review Q&A ❑ Data will always be consistent in every region
❑ Availability is increased
www.AGuideToCloud.com
DP-900 Episode 16:
Components of a modern data warehouse
A Guide To Cloud
www.AGuideToCloud.com
Explore data ingestion in Azure
Agenda
Explore data storage and processing in Azure
www.AGuideToCloud.com
Explore Azure data services for modern data warehousing
Lesson
objectives Explore modern data warehousing architecture and workload
www.AGuideToCloud.com
What is modern data warehousing? A Guide To Cloud
www.AGuideToCloud.com
Azure Data Factory Azure Synapse Analytics Power BI
Code-free data transformation and
(Data Warehouse) Leader in the Magic Quadrant for
ingestion from 90+ data integration Up to 14x faster and costs 94% less Business Intelligence and Analytics
connectors than other cloud providers Platforms*
Azure Databricks
(Data prep)
Up to 10x faster than vanilla Spark
Store
Azure Data Lake Storage
High performance data lake available
in all 54 Azure regions
Combine batch and stream processing A Guide To Cloud
www.AGuideToCloud.com
Azure Data Factory Azure Synapse Power BI
Logs (unstructured) Analytics
Code-free data Leader in the Magic
transformation and ingestion (Data Warehouse) Quadrant for Business
from 90+ data integration Up to 14x faster and Intelligence and Analytics
connectors costs 94% less than Platforms*
Azure Databricks other cloud providers
Media (unstructured)
(Data prep)
Up to 10x faster than
vanilla Spark
Files (unstructured)
Store
Azure Data Lake Storage
Business/custom High performance data lake available
apps (structured) in all 54 Azure regions
A Guide To Cloud
www.AGuideToCloud.com
A cloud-based data integration service that allows you to
orchestrate and automate data movement and data
transformation
Azure Data Factory A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
What is Azure Data Lake storage?
www.AGuideToCloud.com
A repository of data Organises data into Supports POSIX It is compatible with
for your Modern directories for and RBAC Hadoop Distributed
Data Warehouse improved file access permissions File System
Store
Azure Data Lake Storage
High performance data lake available
in all 54 Azure regions
Azure Data Lake Storage A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
What is Azure Databricks?
www.AGuideToCloud.com
Apache Spark-based platform: Enterprise Security: Integration with Azure
Simplifies the provisioning and Utilizes the security capabilities services:
collaboration of Apache Spark- of Azure Can integrate with a variety of
based analytical solutions Azure data platform services and
Power BI
Azure Databricks A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
What is Azure Synapse Analytics?
www.AGuideToCloud.com
A Guide To Cloud
What is Azure Analysis Services?
www.AGuideToCloud.com
A Guide To Cloud
What is Azure HDInsight?
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 17:
Explore data ingestion in Azure
A Guide To Cloud
www.AGuideToCloud.com
Lesson
Describe components of Azure Data Factory
objectives
See how to use Azure Data Factory to load data into a data
warehouse
Describe data ingestion in Azure A Guide To Cloud
www.AGuideToCloud.com
70
100
80
www.AGuideToCloud.com
Integration
IR
Runtime
Data
Lake Store
Pipeline
CF Control
Flow
Activities
Azure
Databricks
Dataset
Demo: Load data into Azure Synapse Analytics A Guide To Cloud
www.AGuideToCloud.com
how the house prices in each region have varied over the last
few months. To achieve this, you need to ingest the data into
Azure Synapse Analytics. You’ve decided to use
Azure Data Factory to perform this task
In this video, you’ll see how to use Azure Data Factory to
ingest and process house price data for analysis
You’ll store the data in Azure Synapse Analytics for later
analysis
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 18:
Explore data storage and processing in Azure
A Guide To Cloud
www.AGuideToCloud.com
Describe data processing options for performing analytics
in Azure
Lesson
objectives
Explore Azure Synapse Analytics
A Guide To Cloud
www.AGuideToCloud.com
Azure Synapse Azure Azure Azure Data Data
Analytics Databricks HDInsight Factory Lake Store
Explore Azure Synapse Analytics A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 19:
Get started building with Power BI
A Guide To Cloud
www.AGuideToCloud.com
Lesson
Explore how Power BI can make your business more efficient
objectives
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
A Guide To Cloud
www.AGuideToCloud.com
Visualizations
A Guide To Cloud
www.AGuideToCloud.com
Datasets
A Guide To Cloud
www.AGuideToCloud.com
Reports
A Guide To Cloud
www.AGuideToCloud.com
Dashboards
&
Tiles
A Guide To Cloud
www.AGuideToCloud.com
DP-900 Episode 20:
Module 4 Knowledge check
A Guide To Cloud
www.AGuideToCloud.com
DP-900
Module 04 ❑ To perform very complex queries and aggregations
Review Q&A
❑ To create dashboards from tabular data
www.AGuideToCloud.com
DP-900 ❑ To perform complex data transformations over data
Module 04 received from external sources
Review Q&A
❑ To capture data flowing into a data warehouse system
as quickly as possible
www.AGuideToCloud.com
DP-900
❑ A data lake contains structured information, but a data
Module 04 warehouse holds raw business data
Review Q&A
❑ A data lake holds raw data, but a data warehouse
holds structured information
www.AGuideToCloud.com
DP-900
Module 04
Review Q&A ❑ CSV File
❑ Pipeline
❑ Linked service
A Guide To Cloud
www.AGuideToCloud.com
DP-900
Module 04 ❑ To query data from external data sources from Azure SQL
Database
Review Q&A
❑ To ingest streaming data using Azure Databricks
www.AGuideToCloud.com
DP-900
Module 04 ❑ Azure Data Factory
Review Q&A
❑ Power BI
www.AGuideToCloud.com
the data in these files and use it to populate
DP-900 tables held in Azure Synapse Analytics. Which
Module 04 processing option is most appropriate?
Review Q&A ❑ Use Azure Synapse Link to connect to Azure Data Lake
storage and download the data
www.AGuideToCloud.com
AzureML?
DP-900
Module 04
Review Q&A ❑ Synapse Studio
❑ Synapse Pipelines
❑ Synapse Spark
A Guide To Cloud
www.AGuideToCloud.com
DP-900
Module 04
❑ The first line in the cell is %language. For example, %scala
Review Q&A
❑ Change the notebook language before writing the commands
www.AGuideToCloud.com
❑ Create a report in Power BI mobile, share it to the Power BI
Desktop, view and interact in the Power BI service
DP-900
Module 04 ❑ Create a report in the Power BI service, share it to Power BI mobile,
Review Q&A interact with it in Power BI Desktop
❑ Bring data into Power BI Desktop and create a report, share it to the
Power BI service, view and interact with reports and dashboards in
the service and Power BI mobile
www.AGuideToCloud.com
DP-900 ❑ Tiles, dashboards, databases, mobile devices
Module 04
❑ Visualizations, datasets, reports, dashboards, tiles
Review Q&A
❑ Visual Studio, C#, and JSON files
A Guide To Cloud
www.AGuideToCloud.com
what in Power BI?
DP-900
Module 04
❑ The canvas
Review Q&A
❑ Scheduled refresh
❑ An app
A Guide To Cloud
www.AGuideToCloud.com
THANK YOU!