This document outlines the syllabus for a Snowflake data engineer course. It will cover Snowflake architecture and concepts including warehouses, storage, pricing, and the user interface. Students will learn how to create and manage databases, tables, views, and other Snowflake objects. The course will also teach data loading, pipelines, querying, and tuning techniques through hands-on exercises. Additional topics include access control, backups, clustering, continuous integration, and best practices.
This document outlines the syllabus for a Snowflake data engineer course. It will cover Snowflake architecture and concepts including warehouses, storage, pricing, and the user interface. Students will learn how to create and manage databases, tables, views, and other Snowflake objects. The course will also teach data loading, pipelines, querying, and tuning techniques through hands-on exercises. Additional topics include access control, backups, clustering, continuous integration, and best practices.
This document outlines the syllabus for a Snowflake data engineer course. It will cover Snowflake architecture and concepts including warehouses, storage, pricing, and the user interface. Students will learn how to create and manage databases, tables, views, and other Snowflake objects. The course will also teach data loading, pipelines, querying, and tuning techniques through hands-on exercises. Additional topics include access control, backups, clustering, continuous integration, and best practices.
What is Snowflake and why it is the Next Gen of Big Data
Advantages and Disadvantages of Snowflake On-Premises Vs Cloud Quick introduction to AWS cloud products Demo of creating an AWS EC2 Instance How to upgrade and Downgrade an EC2 Instance Cost metrics of Storage and Compute cost Snowflake Architecture Cloud Services/Metadata Layer Optimizer Metadata Manager Security Compute/Local/Warehouse Layer Remote / Permanent Storage Layer How Snowflake Charges its customer Storage Costs Compute Costs Creating a Trial Account Impact of choosing the Regions (Sharing , Data Transfer Cost ) Exploring the Web UI Exploring the "Database" , “Shares” ,” Data Market Place” ,” Worksheets Tab” Exploring the " History " , “Partner Connect” ,”” Help Downloads SnowSQL Connectors Common types of objects in snowflake Account level objects User , Role , Warehouse , Resource Monitor , Integration , Database Database level objects Schema , Procedures, functions, View, stage, Format , Pipe, Stream, Sequence, Tables Exploring the "Accounts" Tab Data Transfer Average Storages Used Types of Users Regular User Read only User Hands on and Use Cases Exploring the “Ware houses” tab Shared Disk Vs Shared Nothing Architecture Scale UP Scale OUT Scaling Policy In-Built ware houses AUTOMATIC_CLUSTERING MATERIALIZED_VIEW_MAINTENANCE CLOUD_SERVICES_ONLY Resource Monitor In-Built Schema INFORMATION_SCHEMA PUBLIC In-Built Databases SNOWFLAKE_SAMPLE_DATA SNOWFLAKE ACCOUNT_USAGE ORGANIZATION_USAGE READER_ACCOUNT_USAGE Access Control ( Roles ) Super User Role Other Default Roles Custom Roles Hands on Micro Partitions Immutable Versioning Features derived using Micro Partitions Zero copy Cloning Streams Time Travel Data Backups and Retention Time Travel Fail Safe Data Replication within Cloud Provider Data Replication across Cloud Provider Clustering Clustering Keys Clustering Information Overlapping Overlap Depth Constant Partition Average Overlapping Average Depth Hands on and Use Cases Types of Tables Temporary Table Transcient Table Permanent Table External Tables Hands on and Use Cases Views Normal View Materialized View Secured Views Hands on and Use Cases Tunning Query Profiling Using the Cache Types of Cache Results Cache Local Cache Enabling and Disabling the Cache Query tunning hands on using the cache Shares In Bound Data Out Bound Data Readonly User Full User Command Prompt Interface SnowSQL Format Objects Pre-Built/Public Formats Explicit format objects Stages Internal ( User Stage ) Internal ( Table Stage ) Internal ( Named Stage ) External Stage ( AWS, Azure, GCP ) Data movement PUT Command Hands on COPY Command Hands on LIST, GET, REMOVE Command Hands on Continuous Data Pipelines Snowpipe Snowpipe hands on Snowflake connector for Kakfa ( Introduction only)
Zero copy cloning
Cloning tables Cloning schema Cloning database Custom functions User Defined Functions (SQL based Functions) Normal functions Table functions User Defined Procedures (JavaScript based Procedures) Normal procedure Table procedure SQL Functions and Procedure Hands on Tasks Tasks hands on Streams Normal streams Append only streams Insert only streams Preview Feature Search Optimization External Table Organizational Accounts Snowflake release management Weekly release Staged release Miscellaneous Hands on Demo on session level lock Constraint Enforcement in Snowflake Multi Table Insert Introduction to VARIANT column ELT ( Extract Load and Transform ) Quick Introduction Data Vault Tri-Secret Snowflake Editions Organizational Accounts Federated Authentication Batch Loading vs Live Streaming Data Warehouse vs Data Lake External Functions Fetching the Information Schema using TABLE function Generate UUID data Sequence number Fetch random data from a table Fetch limited data from a table Certification Questionnaire(Not Dumps ) Walk Through