Data Engineer

Job Title: Senior Data Engineer / Reporting Data Engineer

Experience: 8+ Years

Location: Pune

We are looking for a highly experienced Data Engineer with strong ownership of reporting pipelines and reporting operations . This role requires deep hands-on expertise in SQL, PySpark, Databricks, and Tableau , along with the ability to design, operate, and scale reliable reporting systems. The ideal candidate brings a strong point of view on Reporting Ops , owns solutions end-to-end, and ensures BAU-ready operations from day one.

Key Responsibilities

Pipeline Build & Technical Ownership

• Design, build, and maintain recurring reporting pipelines using Databricks and Tableau
• Own end-to-end reporting pipeline development with a focus on scalability, reliability, and performance
• Independently validate data using advanced SQL , perform root-cause analysis, and drive QA
• Debug complex data issues across multiple layers (source transformation reporting)
• Work closely with Data Engineering teams but operate independently for day-to-day problem solving
• Develop and optimize data transformations using PySpark and SQL

Reporting Operations Ownership

• Define and implement a clear Reporting Ops strategy , including:
• Automation vs. manual processes
• Mandatory data controls and validation checks
• Monitoring, alerting, and failure handling mechanisms
• Ownership, access controls, and governance models
• Establish and enforce reporting standards (naming conventions, versioning, documentation, refresh SLAs)
• Design reporting solutions assuming scale, frequent change, and imperfect upstream data
• Ensure reporting pipelines are production-ready and operationally stable from day one

Execution & Ownership

• Independently set up reporting operations , including:
• SOPs and run-books
• Validation and reconciliation checklists
• Escalation paths and incident management processes
• Own postgo-live stability , issue triage, and continuous improvement
• Proactively identify operational risks and drive resolutions before issues surface
• Balance fast delivery with long-term operational robustness and maintainability

Required Skills & Qualifications

• 6+ years of experience in Data Engineering, Reporting Engineering, or Analytics Engineering
• Strong expertise in SQL (advanced querying, debugging, data validation)
• Proficient in PySpark and Databricks
• Hands-on experience with Tableau reporting pipelines
• Strong understanding of data pipeline architecture and reporting systems
• Experience designing scalable, reliable, and production-grade data solutions
• Ability to work independently with high ownership and accountability

Preferred Qualifications

• Experience in enterprise-scale reporting environments
• Familiarity with data quality frameworks and monitoring tools
• Experience working with imperfect or evolving upstream data sources
• Strong documentation and process-design skills

Key Attributes

• Ownership mindset with strong problem-solving skills
• Operationally driven with a focus on long-term stability
• Proactive, detail-oriented, and execution-focused
• Strong communication and stakeholder management skills