Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks.
Write efficient and optimized data transformations using PySpark (Python).
Develop complex queries and perform data analysis using advanced SQL.
Work with large-scale structured and unstructured datasets.
Integrate data from multiple sources including APIs, databases, and data lakes.
Optimize data workflows and improve performance of ETL processes.
Collaborate with data scientists, analysts, and business stakeholders.
Implement data quality checks, validation, and monitoring.
Ensure data security and compliance with enterprise standards.
Participate in code reviews and follow best coding practices.

Data Engineer