Sr. SQL developer

DATA ENGINEER JOB DESCRIPTION

Good Knowledge in designing ETL processes, preparing mapping documents, writing SQL queries, and SQL scripts to efficiently process data in databases   

Designing, developing, documenting, and testing ETL jobs and mappings in ADF to populate tables in Data Warehouse.

Troubleshooting ADF/ETL jobs and scripts as per mapping specifications and requirements

Conducting ETL walkthroughs to ensure adherence to ETL standards and naming conventions.

Monitor ETL running jobs, analyzing failures, and resolving errors in SQL Server.

Migrating mappings from one database to another.

knowledge in understanding table mappings/relations

Knowledge of performance tuning and optimization techniques for ETL transformation jobs

Utilize Azure Data Factory (ADF) or SQL Server stored procedures to automate data transformation and clean up workflows

Designing and developing Parallel Jobs using stages like Join, Sort, Lookup, Change Capture, Remove Duplicates, Filter, Dataset, Aggregator, etc..

Created PL/SQL packages, stored procedures, triggers, views.

Knowledge in design, transform transactional and dynamic data through ETL jobs for cutover  

Perform data conversion from Oracle databases to SQL Server.

Troubleshoot and resolve issues related to data conversion and transformation processes

Design ETL jobs for data processing from multiple sources and Monitor and optimize data pipelines for performance

Write SQL scripts to validate and compare data

Design mapping sheets for development

Design mappings and workflows for ETL jobs in sql server to spaceial files

Performed database uplifting and ETL standard compliance checks.

SQL, PL/SQL developer, and T-SQL experience in writing store procedures to transform data

handle Informatica mappings and transformations.

Key knowledge should be in data transformation using pipeline jobs or SPs

Key knowledge in SQL server. 

Secondary knowledge: Oracle, PostgreSQL

ETL tools knowledge: ADF, Informatica PowerCenter, talend or any other ETL tools