Azure Data Engineer | 4 to 10 years | Navi Mumbai | 18 to 30 LPA | Big4

Job Title: Azure Data Engineer

Experience: 5 to 10 Years

Budget: 20 to 30 LPA

Location: Navi Mumbai

Type: Full-Time

Skills Required: Azure, Synapse, ADF, spark, SQL, Pyspark, spark-SQL

Job Description:

Key Responsibilities:

Designs, implements and maintains reliable and scalable data infrastructure

Writes, deploys and maintains software to build, integrate, manage, maintain,

and quality-assure data

Develops, and delivers large-scale data ingestion, data processing, and data

transformation projects on the Azure cloud

Mentors and shares knowledge with the team to provide design reviews,

discussions and prototypes

Works with customers to deploy, manage, and audit standard processes for

cloud products

Adheres to and advocates for software & data engineering standard processes

(e.g. Data Engineering pipelines, unit testing, monitoring, alerting, source

control, code review & documentation)

Deploys secure and well-tested software that meets privacy and compliance

requirements; develops, maintains and improves CI / CD pipeline

Service reliability and following site-reliability engineering standard processes:

on-call rotations for services they maintain, responsible for defining and

maintaining SLAs. Designs, builds, deploys and maintains infrastructure as code.

Containerizes server deployments.

Part of a cross-disciplinary team working closely with other data engineers,

Architects, software engineers, data scientists, data managers and business

partners in a Scrum/Agile setup

Job Requirements:

Education :

Bachelor or higher degree in computer science, Engineering, Information

Systems or other quantitative fields

Experience :

1) Years of experience: 6 to 9 years relevant experience

2) Deep and hands-on experience building, productionizing, maintaining and

documenting reliable and scalable data infrastructure and data products in

complex environments

3) Hands on experience with:

a) Spark for data processing (batch and/or real-time) - must

b) Configuring Delta Lake on Azure Databricks good to have

c) Languages: SQL, pyspark, python - must

d) Cloud platforms: Azure - must

e) Azure Data Factory (must) , Azure Data Lake (must), Azure SQL DB (must),

Synapse (must), SQL Pools (must), Databricks (good to have)

f) Building data solutions in Azure incl. data distributions and partitions,

scalability, cost-management, disaster recovery and high availability

g) Azure Devops (or similar tools) for source control & building CI/CD pipelines

good to have

4) Experience in implementing large-scale distributed systems

5) Customer management and front-ending and ability to lead large

organizations through influence

Desirable Criteria :

Strong customer management- own the delivery for Data track with customer

stakeholders

Continuous learning and improvement attitude

Key Behaviors :

Empathetic: Cares about our people, our community and our planet

Curious: Seeks to explore and excel

Creative: Imagines the extraordinary

Inclusive: Brings out the best in each other