Lead Consultant, Data Engineer

Responsibilities

Develop a thorough understanding of the data definitions, domain values, data relationships, business rules, sources, and data integration used in the business domain.
Develop and test programs to load, unload, transform and aggregate data from and into data stores.
Build data pipelines to link data processing programs together into jobs. Set up jobs to run daily, weekly and monthly under scheduler control.
Incorporate programs into automated CI/CD build and test pipelines.
Work with Data Analysts to perform data analysis, data profiling and data sourcing in relational and Big Data database environments to implement solutions to business requirements
Support business analysts and developers with data subject expertise, query building and optimization
Translate business requirements into data models and ETL design specifications
Assist in ETL development, testing and troubleshooting of ETL issues.
Troubleshoot data issues and work with data providers for resolution. Perform L3 support when needed