Principal Consultant, Senior Data Engineer

Responsibilities

• Responsible for development based on client prioritization and approval
• Support client technical architects in conducting PoCs , including cost evaluations, of various AWS services and other tools
• Develop data ingress frameworks using the AWS tech stack like AWS Glue, Athena, Databricks, Python, Pyspark, SQL
• Design and development of the Workflow Orchestration using Airflow, step functions
• Manage releases
• Oversee testing
• Ensure data pipelines meet intraday and daily SLAs, as per documented SLA definitions
• Ensure data quality through building data quality frameworks
• Oversee incident management & request fulfillment
• Ensure SLAs are met, as per documented SLA definitions
• Manage escalations and approvals

Qualifications  we seek in you!
Minimum qualifications
• Bachelor’s degree in business information systems (IS), computer science or related field, or equivalent-related IT experience.
• AWS certified Cloud Data Engineer
• Databricks certified Data Engineer
• Have practical experience in Python, PySpark, SQL

Preferred Qualifications/skills
• Good Communication skills
• Able to interact with client independently