Design and develop scalable ETL/ELT pipelines using Databricks.
Build and optimize data workflows using Apache Spark (PySpark/Scala).
Implement data transformation and ingestion frameworks for batch and streaming data.
Develop and manage Delta Lake tables using Delta Lake architecture.
Optimize performance of Spark jobs and SQL queries.
Collaborate with Data Scientists, Analysts, and BI teams for data modeling and analytics requirements.
Implement data quality, governance, and security best practices.
Work with orchestration tools like Airflow / ADF / Databricks Workflows.
Monitor, troubleshoot, and optimize production pipelines.
Participate in CI/CD processes for data engineering workflows

Data Engineer