Azure Data Engineer

Area(s) of responsibility

Azure Data Engineer

Experience: 6-10 years

•            Azure Lead with experience in Azure ADF, ADLS Gen2, Databricks, PySpark and Advanced SQL

•            Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions and estimation on Azure Cloud

•            4 Years of experience in Azure Databricks and PySpark

•            Experience in Performance Tuning

•            Experience with integration of different data sources with Data Warehouse and Data Lake is required

•            Experience in creating Data warehouse, data lakes

•            Understanding of data modelling and data architecture concepts

•            To be able to clearly articulate pros and cons of various technologies and platforms

•            Experience in supporting tools GitHub, Jira, Teams, Confluence need to be used

•            Collaborate with clients to understand their business requirements and translate them into technical solutions that leverage AWS and Azure cloud platforms.

 

Mandatory Skillset:  Azure Databricks, PySpark and Advanced SQL