Senior Consultant - Databricks

Senior Data Engineer – Databricks (Azure/AWS)

Role Overview:

We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions.

Required Skills and Experience:

• 6+ years of hands-on data engineering experience, with 2+ years specifically working on Databricks in Azure or AWS.
• Proficiency in building and optimizing Spark pipelines (batch and streaming).
• Strong experience implementing bronze/silver/gold data models.
• Working knowledge of cloud storage systems (ADLS, S3) and compute services.
• Experience migrating data from RDBMS (Oracle, SQL Server) or Hadoop ecosystems.
• Familiarity with Airflow, Azure Data Factory, or AWS Glue for orchestration.
• Good scripting skills (Python, Scala, SQL) and version control (Git).

Preferred Qualifications:

• Databricks Certified Data Engineer Associate or Professional.
• Experience with Delta Live Tables (DLT) and Databricks SQL.
• Understanding of cloud security best practices (IAM roles, encryption, ACLs).