Data Engineer

Group Company: Bajaj Finserv Direct Ltd

Designation: Senior Software Engineer - 1

Required years of experience: 4 to 6

Location – Bangalore

Must-Have - 
 -  SQL and Python
 
Good to Have -
 - ETL and DWH
- RESTFul API

Experience: 5 + Years
Domain: eCommerce / Financial Reconciliation

Brief JD:

We are seeking a Data Engineers own and operate  a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support and enhancement of  real-time data ingestion and batch processing ETL dataflows (SQL, Python, PySpark, Hive), and SLA based execution of SQL based financial report generation. 

You will be responsible for triaging reconciliation issues, performing deep root cause analysis (RCA) using data from MySQL, HBase, and HDFS, and implementing fixes with a focus on process automation, data lineage (DataHub), and platform reliability.
 
Key Responsibilities:
 
 Execute  large scale data processing and report generation for in order to drive successful financial reconciliation on monthly basis. Work closely with the Finance Controllers.
 Perform RCA, issue triaging  and resolve anomalies
Build and monitor data quality, lineage, and SLA adherence across systems
Enable observability through monitoring dashboards and diagnostics

Required Skills:

Strong hands-on experience with: SQL, Python( or PySpark) Based ETL for a Data Lake environment (or a large DWH platform)
 Proficiency in SQL and Python (PySpark) performance tuning, and building complex business  logic
Fast learner and willing to learn new  data analytics tools, basic java programming and microservices architecture