Data Engineer
AppsForBharat
2 - 5 years
Bengaluru
Posted: 24/12/2025
Job Description
Role Overview
We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business logic, personalisation, user cohorting, CRM, product analytics, and Generative AI workloads.
Youll work cross-functionally with analysts, engineers, and product teams to build high-throughput data pipelines, ensure reliability and cost-efficiency, and empower data-driven decisions across all touchpoints web, mobile (Android/iOS) and server.
Key Responsibilities
Data Platform & Pipeline Development
- Build and scale real-time and batch data pipelines capable of supporting high-volume data ingestion and processing.
- Power diverse applications across: business logic and personalization, user cohorting and CRM, product and business analytics, and Generative AI (data retrieval, prompt engineering, context feeding).
Analytics Enablement Across Platforms
- Partner with product analysts to co-design analytics schemas that align across all client platforms.
- Enable consistent event tracking and unified user behavior analysis.
- Ensure availability of enriched and aggregated datasets that can be plugged directly into product and business workflows.
Lifecycle Management & Platform Efficiency
- Own the entire lifecycle of the data platform from design and provisioning to resource decommissioning.
- Implement systems for:
- Dynamic resource allocation (compute, storage, streaming)
- Tiered data retention and archival
- Usage-based cost governance and alerting
- Develop tooling, playbooks, and dashboards for observability, efficiency, and compliance.
Monitoring, Governance & Reliability
- Build proactive monitoring and alerting for data freshness, volume anomalies, and schema drift.
- Conduct root cause analyses (RCA) for failures or inconsistencies across systems.
- Define and enforce role-based access control (RBAC) and audit policies for secure data operations.
- Maintain thorough documentation of data flows, architecture, and contracts.
Must-Have Qualifications
- Experience building cloud-native data solutions on AWS (RDS, Redshift, Athena, Kinesis, Lambda, S3) and GCP (BigQuery, Dataflow, Datastream).
- Proficiency in SQL, NoSQL, and data modeling for both OLTP and OLAP systems.
- Strong backend engineering skills using Golang (preferred) or other typed languages.
- Hands-on experience with event streaming platforms like Kafka, Kinesis, or RabbitMQ.
- Deep understanding of data warehousing, pipeline orchestration, and cloud architecture.
- Demonstrated ability to implement secure, auditable, and scalable data governance frameworks.
Good-to-Have Skills
- Scripting expertise in Bash or Python for automation.
- Familiarity with Apache Spark, Flink, or other big data processing engines.
- Experience with CI/CD, Infrastructure-as-Code (Terraform, CloudFormation), and deployment automation.
- Experience designing datasets and platforms that support both BI and machine learning workloads.
Why Our Team Loves Working at AppsForBharat!
We don't just offer benefits ; we offer a life-first approach to work.
- Family-First Insurance Coverage for you, your spouse, AND your parents/in-laws because your peace of mind includes theirs.
- Mental Health Support Unlimited confidential therapy sessions, accessible from wherever you're comfortable.
- Wellness Perks Exclusive medicine discounts plus complimentary eye and dental checkups.
- Life conscious policies such as Period Leave, generous maternity, paternity, and wedding leave because life happens.
- Why wait for month-end blues? Your salary hits your account by the 25th every month.
- We invest in your future self with dedicated professional development benefits to fuel your journey.
- Monthly activities and quarterly outings spanning sports, music, and diverse interests. Every personality type finds their groove.
- Located in the heart of HSR Layout pet-friendly, plant-happy, and designed as your peaceful sanctuary in the bustling city.
If you're interested, please fill out the job application form -
Services you might be interested in
Improve Your Resume Today
Boost your chances with professional resume services!
Get expert-reviewed, ATS-optimized resumes tailored for your experience level. Start your journey now.
