Job Description: Azure Data Engineer
Total Experience: 3 to 6 Years
Skills Required
Roles & Responsibilities
Education Qualification
• 3 - 6 years’ experience in one of the deep technical specializations below:
• Analytics: SQL DW, Azure Data Factory & Azure Databricks.
• Experience in ETL/Pipeline Development using tools such as Azure
Databricks/Apache Spark and Azure Data Factory with development expertise in
batch and Realtime data integration.
• Design and Develop Data Processing
• Advanced Analytics including Azure Synapse Analytics, Azure Data Bricks, data
visualization tools.
• Experience in programming using Pyspark / Python
• Experience in relational data processing technology like MS SQL, Delta Lake,
Spark SQL
• Enterprise-scale technical experience with cloud and hybrid infrastructures,
architecture designs, database migrations, and technology management.
• Hands-on experience on the Application migration from on premises to Azure
cloud
• Data Platform: RDBMS: A-SQL, SQL MI, RDBMS OSS: mySQL, Postgres, noSQL:
CDB, Mongo, Cassandra; Additionally, good experience required (2 years) in SQL
DW, AS, Power BI, Azure Data Factory, Security.
• Sound knowledge & hands-on experience in design and implementation of Azure
Data Factory pipelines.
• Hands-on experience with GitHub, Azure DevOps, and Azure pipelines for CI/CD
performance tuning ADF pipelines, Debugging issues with transformation,
connectivity.
• Sound knowledge & hands-on experience in Azure Data factory, Azure Logic
Apps flow, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark.
• Knowledge on Azure DevOps CI/CD
• Flexible and proactive/self-motivated working style with strong personal
ownership of problem resolution.
• Build ADF pipelines and orchestrate end to end.
• Ability to multi-task under pressure and work independently with minimal
supervision.
• Strong verbal and written communication skills.
• Must be a team player and enjoy working in a cooperative and collaborative
team environment.
• Adaptable to new technologies and standards.
• Participate in all aspects of solution delivery life cycle including analysis, design,
development, testing, production deployment.
• Must be well versed with agile way of delivery
Preferred Skills: - Azure Data Factory, Azure DevOps CI/CD, Azure Logic Apps flow, Azure
Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub.
Bachelor s Degree in Computer Science, Information Technology, Engineering.