NG

NOVA GULIYEV
novruz.guliyev.bi@gmail.com | 6179924717 | Boston, MA 02108

Summary

I am a Data Engineer (MS Azure | AWS | Hadoop | Spark) and SQL BI developer (SSIS | SSAS | SSRS | Power BI) with 7+
years of IT experience in querying, designing, maintaining databases, and developing Business Intelligence Solutions on
MS SQL Server. Strong knowledge and wide working experience in developing ETL packages using SSIS to automate data
migrations from various sources to SQL Server both on-premises and cloud and vice versa. Skilled in developing reports,
dashboards using different reporting and visualization tools such as Power BI, SSRS and Tableau. Highly experienced on
Azure Cloud Services (ADF, Databricks, Synapse, Azure ML, Azure SQL etc.). Strong programing skills (SQL, Python,
Scala) for data analysis and developing ML (Machine Learning) and DL (Deep Learning) models. Professional with Big
Data Technologies Like Hadoop ecosystem (Hive | Sqoop | Pig), Spark, Kafka, Apache Airflow and NoSQL Database
development with Apache Cassandra, MongoDB, Cosmos DB etc.

Skills

Skills & Abilities
Over 7 years of experience in Database Design and
Development of MS SQL 2008/2012/2014/2016 and BI
solutions using Microsoft components in various business
domains.
Experience in creating various SQL server Objects like
Tables, Views, Constraints, Indexes, Joins.
Experience in the use of T-SQL for developing complex
Queries, stored procedures, triggers, User Defined
functions.
Very good knowledge in fine tuning long running T-SQL
scripts by breaking down complex scripts to simple once,
Creating Indexes, Updating statistics and so on.
Experience in Creating Backend validations using Insert,
Update and Delete triggers and Created views for
generating reports.
Operating Systems: Windows 10/8/7/XP, Linux
ETL Tools: SQL server business development studio
(BIDS), DTS, SQL server Management Studio (SSMS),
SQL server integration services (SSIS).
Analysis and reporting services: SSAS, SSRS, SSAS,
Microsoft Power BI, MS Excel
Cloud technology: AZURE Data Lake, Azure Data
Factory, Azure Data Warehouse, AZURE SQL Database,
Azure Synapse, Azure Logic Apps.
SQL server Tools: SQL server management studio,
Database engine, Import and export wizard
Architecture: Relational DBMS, Client-server architecture,
OLTP, OLAP
Version Control: GIT
Other Tools: Autosys CA Workload Automation Tool
Big Data Tools: Hadoop, Hive, Spark, Pig, Sqoop, HBase,
MongoDB.
Data Analytics / Science Toolkit: EDA (Pandas, NumPy,
Seaborn, Matplotlib, SciPy, StatModels), ML (Scikit Learn,
Spark ML), DL (TensorFlow), Flask (Back End).
Languages; TSQL, ORACLE PL SQL, MySQL,, VB,
POWERSHELL, DAX, MDX, Python, Scala
Deep Understanding Linear Algebra and Math needed
for ML Algorithms
Complex ML Algorithms Regression and Classification
(SVM, Bagging Models, Boosting Models, Decision Trees,
Random Forersts, PCA, LDA, Naive Bayes) and Deep
Learning (ANN, RNN, CNN, LSTM, GRU and etc).
Expertise in programming languages like Python, Scala,
Sql for Data Engineering.

Experience

Concord | Minneapolis, MN Designed and implemented ETL processes using Python, SQL, and Apache
SR Data Consultant Spark to collect, clean, and transform data from multiple sources, resulting
06/2022 - Current in a 25% improvement in data accuracy
Developed and maintained scalable data pipelines in Databricks, allowing
for efficient processing and analysis of large datasets
Designed and implemented data pipelines using Azure Data Factory to
extract data from various data sources, transform and load it into Azure
SQL Database for analytical reporting.
Created and maintained PySpark jobs using Azure Databricks for data
transformations, aggregations, and cleansing and Accesses Azure Data
Lake Gen2 / Azure Blob Storage via Azure Service Principals.
Create fully Automated Azure Data Factory Pipelines and configured
appropriate Error Handling with Azure Logic Apps.
Collaborated with cross-functional teams, including data analysts and data
scientists, to ensure data integrity and improve the quality of business
insights
Created and managed Azure Stream Analytics and Azure Event Hubs for
real-time data processing and analysis.
Actively participated in gathering Business Requirements and System
Specification
Participated in implementing the logical design to the physical design by
creating tables
Strong experience with SQL Server and T-SQL in implementing,
maintaining developing Stored Procedures, Triggers, Nested Queries,
Joins, Views, User Defined Functions, Indexes, User Profiles, Relational
Databases Models, creating and updating tables and checking the database
consistency by executing DBCC commands
Did SQL performance monitoring and tuning of reporting data by
optimizing indexes and stored procedures
Created and Implemented triggers in T-SQL to facilitate consistent data
entry into the database
Created Alerts, Notifications and emails for system errors, insufficient
resources, fatal database errors, hardware errors and security violation
Designed SSIS packages to Extract, Transfer and Load (ETL) existing data
into SQL Server from different environments
Implemented Data Cleansing, Incremental Data Loading, Logging, Event
Handling and Error Handling
Created SSIS Packages using Pivot Transformation, Fuzzy Lookup,
Derived Columns, Condition Split, Term extraction, Aggregate, Execute
SQL Task, Data Flow Task, and Execute Package Task
Created various types of reports such as sub reports, Tablix and Matrix
using SQL Server Reporting Services and created Parameterized Reports
which consist of report Criteria in various reports to make minimize the
report execution time and to limit the no of records required
Created reports on both cascading and standard parameters
Designed reports on account information, research reports using ad-hoc
reporting to be used by clients and advisors
Worked on Power BI in creating dashboards and reports and visualizing
data
Used Microsoft Power BI Power Query to extract data from external
sources and modify data to certain format as required in Excel and created
SSIS packages to load excel sheets from PC to database
Used Power Query to acquire data, developed calculated columns and
measures using DAX in Power BI desktop for designing rich visuals using
visualizations such as Bar chart, Clustered Column Chart, Waterfall Chart,
Gauge, Pie Chart, Tree map
Shared with user groups, scheduled and maintained the Power BI reports

Hewlett-Packard Co | Houston, TX
SR Azure Data Engineer
01/2020 - 06/2022
published to the Power BI Service
Sourced data from SQL Azure database, SQL Azure Data warehouse, AWS
RDS solutions such as MySQL Aurora and Redshift for my Power BI
reports
Created SSIS Packages by using advance transformations (i.e
Pivot Transformation, Fuzzy Lookup, Derived Columns, Condition Split,
Aggregate) and used Custom components such as Audit on Pre-Execute,
Audit on Post-Execute and Statistics Logging Component
Created Dynamic SSIS packages using complex expressions, variables and
control flow components such as for each Loop Container to loop over a
Directory to load inbound files coming daily
Prepared the Migration document showing the paths for input and output
files, configuration files, table scripts, stored procedures and SSIS packages.
Manage daily operations, including database backups and restores,
maintenance jobs, and developers' requests
Designed and developed scalable data processing pipelines using Spark,
Python, and Scala for a large-scale data warehousing project
Created Advanced features with Python libraries such as Pandas, NumPy,
Matplotlib, Seaborn, Statmodels, Scipy for EDA and Data Transformations.
And for Data Science / Machine Learning (Regression, Decision Tree,
Random Forest, SVM, Dimensionality Reduction techniques PCA, LDA,
Boosting, Bagging and etc) used Scikit-Learn, Tensorflow for Deep
Learning Models (RNN, CNN, LSTM, ANN...)
Wrote back end for ML Models with Flask Python and Deployed to
Production.
Optimizing data pipelines and applications for performance by tuning
Spark configurations, optimizing SQL queries, and implementing caching
strategies
Designed, developed, and maintained data pipelines using Databricks and
Spark for a large e-commerce organization with over 100TB of data
Built and maintained a real-time streaming data processing platform using
Spark Streaming and Kafka to process clickstream data
Designed and developed data ingestion pipelines using Azure Data
Factory, processing large-scale datasets from various sources and formats
including structured, semi-structured and unstructured data, and enabling
real-time and batch processing workflows.
Built and managed Azure HDInsight clusters using Hadoop, Hive, and
Spark, enabling real-time data processing and streaming analytics.
Configured cluster security with Azure Active Directory Domain Services
and implemented encryption-at-rest using Azure Key Vault.
Utilized Azure Data Factory Mapping Data Flows for advanced data
transformations and integration with Azure Databricks for advanced data
processing.
Developed data storage solutions using Azure Blob Storage and Azure
Data Lake Storage, enabling scalable, distributed data storage and retrieval
with advanced features such as Azure Data Lake Storage Gen2 tiering and
Azure Blob Storage lifecycle management.
Designed and implemented data models using Azure Synapse Analytics,
enabling efficient querying and analysis of large datasets. Optimized the
performance of queries by tuning partitioning and indexing strategies, and
implementing Azure Synapse Analytics SQL pool to provide
high-performance analytics capabilities for large datasets.
Created T-SQL scripts, which generated tables and relationships, based on

Cleveland Clinic | Cleveland, OH
Data / BI Engineer
12/2018 - 10/2019
the customer's request
Identified source, destination and staging area per ETL strategy and
performed data cleansing and data profiling
Creating SSIS (SQL Server Integration Service) packages to extract data
from OLTP to OLAP systems (SQL Server) and scheduled Jobs to call the
packages and Stored Procedures
Created new database objects such as procedures, functions, indexes and
views utilized T-SQL
Used System as well as User-Defined functions to enhance the functionality
of my T-SQL code
Utilized Dynamic SQL for user customizable queries to be answered by the
SQL Server
Designed SSIS packages to Extract, Transfer and Load (ETL) existing data
into SQL Server from different environment
Implemented Data Cleansing, Incremental Data Loading, Logging, Event
Handling and Error Handling
Created SSIS Packages using Fuzzy Lookup, Derived Columns, Condition
Split, Execute SQL Task, Data Flow Task, and Execute Package Task
Created Dynamic SSIS packages using complex expressions, variables and
control flow components such as for each Loop Container to loop over a
Directory to load inbound files coming daily
Scheduling jobs and alerts using SQL Server Agent and configured
database mail for any job failure
Moving data from on premise to Azure storage accounts (Blob, Data Lake)
for staging purposes, transforming data and moving to destination tables
Azure SQL DW (Dedicated SQL Pool) or Azure SQL
Hands on experience in creating several SSIS schedule tasks and monitor
those tasks regularly.
Gathered, analyzed and documented the business requirements and
business rules by directly working with end users/clients
Created and maintained documents like Documentation Roadmap, DATA
Models, ETL Execution Plan, Configuration Management Procedures, and
Project Plan
Developed and deployed database objects such as stored procedures,
triggers, indexes, views, and UDFs in SQL Server
Modified temporary tables, indexes, and lookup techniques to optimize
stored procedures
Developed database objects like tables, stored procedures, triggers, user
defined data types and functions
Created and updated clustered and non-clustered indexes to keep up the
SQL Server performance
Implemented Error handling through TRY-CATCH method and used CTEs
Created SSIS packages for data loading utilizing various task and
transformations (such as execute SQL task, script task, execute package
task, data flow task, fuzzy lookup, lookup, OLEDB command, derived
column etc.)
Extracted and loaded data from multiple sources (Excel, flat files, SQL
Server, Oracle) to the staging area
Repaired SSIS packages with checkpoints, breakpoints, and data viewers
Created SSIS packages utilizing different transformations in SSIS toolbox
such as aggregate, Merge, and Merge join
Incorporated package configurations such as XML files and environment

Bank of America | Boston, MA
Data Engineer
01/2016 - 11/2018
Mesirow Financial | Chicago, IL
SQL / BI developer
02/2015 - 12/2016
variables to improve compatibility
Designed ad hoc SSRS reports in the test environment for data validation
utilized SQL Server 2012
Optimized reports by optimizing the embedded queries or improved the
stored procedures that generate them
Formatted the reports by applying parameters, assigned parameter
defaults and data types and extended reports.
Developed and implemented data quality checks and data validation
processes to ensure data accuracy and completeness
Collaborated with Data Scientists and Business Analysts to develop
machine learning models and deploy them into production using
Databricks and Spark
Managed and mentored a team of junior data engineers, providing
guidance and support on best practices and technical issues
Built a recommendation engine for an e-commerce platform using
collaborative filtering and matrix factorization techniques, resulting in a
20% increase in click-through rates and sales
Created complex T-SQL Queries, Stored Procedures, Functions, Indexes,
CTE's, Views, Joins and Triggers
Wrote T-SQL queries, Store Procedures and used them to build packages
and reports
Developing several behavioral reports and data points creating complex
SQL queries and stored procedures using SSRS, Excel
Created SSIS (SQL Server Integration Service) packages to extract data
from OLTP to OLAP systems (SQL Server) and scheduled Jobs to call the
packages and Stored Procedures
Improved Stored Procedures and SQL Queries performance by analyzing
execution plans and creating proper Indexes using SQL Profiler and
Database Tuning Advisor
Designed various SSRS reports as requested by the client
Developed several SSIS packages and data flow tasks by using SSIS
Extracted data from different sources and stored into SQL Staging tables in
BI Staging database
Created different data points and pulling those using SSIS package
Applied various data transformations like Aggregate, Sort, Merge,
Multicasting, Conditional Split, Derived column
Developed SSIS Packages and Stored Procedures to load/transform/cleanse
data from SQL Server, Oracle and Excel Files to Facts and Dimension
Tables in the Data Warehouse
Created SSRS reports such as tabular, matrix, charts, dashboard and
sub-reports using SSRS 2012
Designed various SSRS reports as requested by the client
Used SSIS to create maintain and troubleshoot ETL packages to validate,
extract, transform and load data to data warehouse databases
Wrote complex Stored Procedures, CTEs and Functions for SSRS reports
and ETL projects
Implemented different Slowly Changing Dimension methodologies to
maintain and update historical data.
Successfully extracted data from flat files/excel files, applied complex
transformation and finally loading to SQL Server data warehouse on
monthly basis
 Created database objects like tables, view, store procedures, functions,
triggers using SQL server
Gathered functional requirements and Business requirements and written
the technical specifications for building the Enterprise Integrated Data
warehouse
Worked closely with developers, end users in designing and creating the
Enterprise Integrated Data warehouse
Optimization of queries by looking at Execution Plan for better tuning of
the database
Developed numerous ad-hoc reports using SSRS for day-to-day financial
reporting
Generated custom and parameterized reports using SSRS
Used SQL Server Agent for scheduling jobs and alerts
Extensively used SSIS transformations such as Lookup, Fuzzy Look Ups,
Derived column, Data conversion, Aggregate, Conditional split, SQL task,
Script task and Send Mail task etc
Created Complex ETL Packages using SSIS to extract data from staging
tables to partitioned tables with incremental load
Wrote complex SQL queries using joins, sub queries and correlated sub
queries to retrieve data from different SQL Server Databases and Excel
files, apply business logic, load in table and create view for end users
Worked with Index Tuning Wizard, SQL Profiler and SQL trace for
Performance Tuning
Performed Database Refresh tasks from production to Development and
Staging Servers
Involved in Technical decisions for Business requirement, Interaction with
Business Analysts, Client team, Development team, Capacity planning
Provided scripts to DBA for production implementation of data warehouse
and several other database objects
Work with Business analysts to create data dictionary for end-user
Designed, developed, and deployed reports in MS SQL Server
environment using SSRS 2008/2012
Generated Sub-Reports, Drill down reports, Drill through reports and
Parameterized reports using SSRS.

Education and Training

Northeastern University | Boston, MA

Master of Science in Data Science
04/2022

ADA University | Azerbaijan

Bachelor of Science in Computer Science

References

References References available upon request.