Data Engineer

Data Engineer

Main Technology & Mandatory skills: Data Bricks, Snowflake, PySpark, MS Fabric, Power Platforms

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Databricks (PySpark) and Snowflake optimizing performance, cost, and reliability
• Author and tune complex SQL and implement transformations, stored procedures, streams/tasks, and CDC patterns for analytical workloads.
• Orchestrate and integrate data flows across Microsoft Fabric (Power Query, Fabric pipelines), Databricks, and Snowflake, ensuring lineage, governance, and monitoring.
• Enable Power Platform and BI consumers by providing curated datasets, semantic models and guidance for Power BI, Power Apps, and Power Automate usage.
• Collaborate with stakeholders, troubleshoot production issues, document data contracts/metadata, and mentor peers to drive best practices and measurable data platform outcomes.

Qualifications

Mandatory Skills:

• Building and maintaining scalable ETL/ELT pipelines
• Performance-tuning SQL for analytical workloads
• Building and scheduling pipelines
• Creating/curating datasets and semantic models
• Strong coding experience in Python (Pyspark)
• Stakeholder engagement, Documentation of workflows, mentoring peers

Required Skills

Optional Skills:

• Advanced PowerBI