Data Engineer

Data Engineer | 5+ Years Experience

Location: Bangalore

Availability: Immediate Joiner

Professional Summary

Results-driven Data Engineer with 5+ years of experience designing, developing, and optimizing scalable data pipelines. Strong expertise in Azure Data Engineering, Python, and SQL, with hands-on experience in handling large datasets, performing complex data transformations, and building high-performance data workflows. Proven ability to optimize queries and implement efficient DataFrame operations.

Technical Skills

Cloud & Platform

• Microsoft Azure
• Azure Data Factory (ADF)
• Azure Databricks
• Azure Storage (Blob, ADLS)
• Azure Python SDK

Programming

• Python (Advanced)
• PySpark
• Azure Python integrations

Data Processing

• Strong DataFrame (DF) operations:
• Column transformations
• Group By
• Order By
• Limit
• Window functions
• Joins (Inner, Left, Right, Full, Cross)
• Data cleaning & transformation
• Handling large-scale structured & semi-structured datasets

Database & SQL

• Advanced SQL query writing
• Query optimization & performance tuning
• Indexing strategies
• Stored procedures
• Complex joins & subqueries

Core Competencies

• ETL/ELT pipeline development
• Large dataset processing
• Data modeling
• Performance optimization
• Data validation & quality checks
• Troubleshooting & debugging production data pipelines

Interview Availability

• L1: Virtual
• L2: Face-to-Face