Data Engineer

Azure Data Engineer

Immediate

2PM-11PM (REMOTE)-Bangalore

6-8 years

Job Summary

We are seeking a highly skilled Azure Data Engineer with strong expertise in Python development, Azure cloud services, API integration, and modern data engineering practices. The ideal candidate should have experience building scalable cloud-native data solutions, developing ETL/ELT pipelines, processing APIs, and automating deployments using CI/CD frameworks.

The role requires hands-on expertise in Azure Functions, Azure Blob Storage, Azure SQL, Stored Procedures, Azure IAM, Python, Pandas, and enterprise-grade data integration solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines on Microsoft Azure.

Build serverless data processing solutions using Azure Functions.

Develop and optimize solutions using Azure Blob Storage and Azure SQL Database.

Write complex SQL queries, stored procedures, views, and performance-optimized database objects.

Develop robust Python-based data processing and automation frameworks.

Process and integrate data from REST APIs, third-party APIs, and enterprise systems.

Perform data transformation and analysis using Pandas and Python libraries.

Implement secure authentication and authorization mechanisms using Azure IAM, RBAC, and Managed Identities.

Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions.

Monitor, troubleshoot, and optimize production data pipelines and cloud services.

Collaborate with cross-functional teams including architects, analysts, and business stakeholders.

Ensure data security, governance, reliability, and operational excellence across Azure environments.

Required Skills

Azure Technologies

Azure Functions

Azure Blob Storage

Azure SQL Database

Azure Data Factory (ADF)

Azure Key Vault

Azure IAM / RBAC

Azure Monitor / Log Analytics

Python & Data Processing

Strong hands-on experience in Python programming

Expertise in Pandas for data transformation and analysis

API processing and integration experience

REST API consumption and authentication handling

JSON/XML data processing

Data validation and transformation frameworks

Database & SQL

Advanced SQL programming

Stored Procedures

Query optimization and performance tuning

Data modeling and database design

DevOps & CI/CD

Azure DevOps

CI/CD pipeline automation

Git/GitHub version control

Deployment automation and release management

Additional Skills

Strong problem-solving and debugging skills

Experience working in Agile/Scrum environments

Knowledge of data warehousing concepts

Preferred Qualifications

Experience with Databricks, Synapse Analytics, or Snowflake.

Exposure to PySpark and big data processing frameworks.

Knowledge of Infrastructure as Code (Terraform/ARM templates).

Familiarity with Power BI reporting and analytics.

Azure certifications are preferred:

Microsoft Certified: Azure Data Engineer Associate

Azure Developer Associate