Data Engineering (Databricks & Snowflake)

Area(s) of responsibility

Technical Lead/Data Architect – Data Engineering (Databricks & Snowflake)
Job Summary
Key Responsibilities
•    Lead the design and architecture of scalable, high-performance data solutions on Databricks and Snowflake
•    Define and enforce best practices for data engineering, including coding standards, performance optimization, and cost management
•    Oversee the development and maintenance of robust ETL/ELT pipelines ensuring data quality, reliability, and scalability
•    Collaborate with data architects, product owners, and business stakeholders to translate requirements into technical solutions
•    Implement and ensure adherence to data governance, security, and compliance standards
•    Mentor and guide engineering teams through code reviews, design discussions, and technical problem-solving
•    Monitor system performance, troubleshoot issues, and optimize workloads for efficiency and cost
•    Drive release planning, deployment strategies, and continuous improvement across data platforms
•    Identify and resolve technical blockers, ensuring smooth project delivery
Required Skills & Qualifications
•    7+ years of experience in data engineering or related roles
•    Strong expertise in Databricks (Spark, Delta Lake) and Snowflake
•    Proficiency in Python, SQL, and distributed data processing frameworks
•    Experience designing and implementing ETL/ELT pipelines at scale
•    Strong understanding of data modeling, data warehousing, and lakehouse architecture
•    Experience with orchestration tools (Airflow, Azure Data Factory, etc.)
•    Knowledge of cloud platforms (Azure, AWS, or GCP)
•    Familiarity with data governance, security, and compliance practices
•    Excellent problem-solving and leadership skills
Preferred Qualifications
•    Experience with CI/CD pipelines and DevOps practices
•    Exposure to real-time data processing and streaming frameworks
•    Knowledge of cost optimization strategies in cloud data platforms
•    Prior experience in leading teams or managing technical delivery