Senior Big Data Developer - Youappi

Designation: Senior Big Data Developer 

Office Location: Gurugram or Bangalore 

Position Description: 

We are looking for an experienced Senior Big Data Developer to join our team and help build and optimize high-performance, scalable, and resilient data processing systems. You will work in a fast-paced startup environment, handling highly loaded systems and developing data pipelines that process billions of records in real time.

As a key member of the Big Data team, you will be responsible for architecting and optimizing distributed systems, leveraging modern cloud-native technologies, and ensuring high availability and fault tolerance in our data infrastructure.

Primary Responsibilities:

• Design, develop, and maintain real-time and batch processing pipelines using Apache Spark, Kafka, and Kubernetes.
• Architect high-throughput distributed systems that handle large-scale data ingestion and processing.
• Work extensively with AWS services, including Kinesis, DynamoDB, ECS, S3, and Lambda.
• Manage and optimize containerized workloads using Kubernetes (EKS) and ECS.
• Implement Kafka-based event-driven architectures to support scalable, low-latency applications.
• Ensure high availability, fault tolerance, and resilience of data pipelines.
• Work with MySQL, Elasticsearch, Aerospike, Redis, and DynamoDB to store and retrieve massive datasets efficiently.
• Automate infrastructure provisioning and deployment using Terraform, Helm, or CloudFormation.
• Optimize system performance, monitor production issues, and ensure efficient resource utilization.
• Collaborate with data scientists, backend engineers, and DevOps teams to support advanced analytics and machine learning initiatives.
• Continuously improve and modernize the data architecture to support growing business needs.

Required Skills:

• 7-10+ years of experience in big data engineering or distributed systems development.
• Expert-level proficiency in Scala, Java, or Python.
• Deep understanding of Kafka, Spark, and Kubernetes in large-scale environments.
• Strong hands-on experience with AWS (Kinesis, DynamoDB, ECS, S3, etc.).
• Proven experience working with highly loaded, low-latency distributed systems.
• Experience with Kafka, Kinesis, Flink, or other streaming technologies for event-driven architectures.
• Expertise in SQL and database optimizations for MySQL, Elasticsearch, and NoSQL stores.
• Strong experience in automating infrastructure using Terraform, Helm, or CloudFormation.
• Experience managing production-grade Kubernetes clusters (EKS).
• Deep knowledge of performance tuning, caching strategies, and data consistency models.
• Experience working in a startup environment, adapting to rapid changes and building scalable solutions from scratch.

Nice to Have

• Experience with machine learning pipelines and AI-driven analytics.
• Knowledge of workflow orchestration tools such as Apache Airflow.

Work Environment Details:

About Affle:

Affle is a global technology company with a proprietary consumer intelligence platform that delivers consumer engagement, acquisitions, and transactions through relevant Mobile Advertising. The platform aims to enhance returns on marketing investment through contextual mobile ads and also by reducing digital ad fraud. While Affle's Consumer platform is used by online & offline companies for measurable mobile advertising, its Enterprise platform helps offline companies to go online through platform-based app development, enablement of O2O commerce and through its customer data platform.

Affle India successfully completed its IPO in India on 08. Aug.2019 and now trades on the stock exchanges (BSE: 542752 & NSE:AFFLE). Affle Holdings is the Singapore based promoter for Affl e India and its investors include Microsoft, Bennett Coleman &Company (BCCL) amongst others.

For more details: www.affle.com

About YouAppi: 

YouAppi is a programmatic mobile app retargeting products that put your app where you want it - top of mind. A holistic marketing funnel approach activates valuable users, keeping them engaged, and growing your app revenue. For every app that helps in retargeting DSP offers a tailored approach with flexible integrations, optimizations, and transparent reporting going beyond downloads.

For more information visit https://youappi.com/