Data Engineer

Job Overview

We are seeking a skilled Data Engineer to design, build, and maintain scalable data systems. The ideal candidate will have strong expertise in data pipeline development, cloud platforms, and data architecture, enabling efficient data processing and analytics across the organization.

Key Responsibilities

• Design and implement scalable data pipelines for both batch and streaming data
• Build and maintain data lakes and data warehouses to support analytics and reporting needs
• Collaborate with data scientists and analysts to deliver clean, structured, and reliable datasets
• Optimize query performance and ensure high standards of data integrity and reliability
• Automate data ingestion and transformation workflows (ETL/ELT)
• Monitor, troubleshoot, and enhance data infrastructure for performance and stability
• Ensure compliance with data privacy, security, and governance standards

Core Competencies

Data Pipeline Development:

• Strong experience with ETL/ELT workflows using tools like Apache Airflow, Talend, or AWS Glue

Programming Languages:

• Proficiency in Python, SQL, and/or Java

Cloud Platforms:

• Hands-on experience with AWS services such as Redshift, S3, EMR, Athena

Database Systems:

• Experience with PostgreSQL, MySQL, Oracle, and MongoDB

Data Warehousing (Preferred):

• Exposure to platforms like Amazon Redshift, Databricks, Snowflake

Streaming Data (Preferred):

• Experience with Apache Kafka or AWS Kinesis

Data Modelling & Governance:

• Strong understanding of schema design, data quality, and metadata management

DevOps & CI/CD (Good to Have):

• Familiarity with Docker, Git, Jenkins, Terraform

Preferred Qualifications

• Strong problem-solving and analytical skills
• Ability to work in a collaborative, cross-functional environment
• Excellent communication skills