Big Data Developer

Job Title: Big Data Engineer (5+ Years Experience)

Location: Gurgaon / Bangalore / Chennai (Hybrid Work Model) for a Giant American Banking Client

Experience: 5+ Years

Employment Type: Full-Time

Job Summary

We are seeking an experienced Big Data Engineer to design, develop, and optimize scalable data pipelines and architectures. The ideal candidate will have strong expertise in distributed data processing, cloud platforms, and modern big data technologies. You will work closely with data scientists, analysts, and cross-functional teams to deliver high-quality data solutions that drive business insights.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines (batch & real-time).
• Develop and optimize ETL/ELT processes for large-scale data processing.
• Work with structured and unstructured data from multiple sources.
• Implement data models and data warehousing solutions.
• Ensure data quality, integrity, and security across systems.
• Collaborate with data scientists and analysts to support analytics and ML use cases.
• Monitor and troubleshoot performance issues in data pipelines.
• Optimize big data workflows using best practices.
• Stay updated with emerging big data technologies and tools.

Required Skills & Qualifications

• 5+ years of experience in Big Data Engineering or related field.
• Strong programming skills in Python, Scala, or Java.
• Hands-on experience with Apache Spark, Hadoop ecosystem.
• Experience with data pipeline tools like Apache Airflow.
• Strong knowledge of SQL and NoSQL databases (e.g., MongoDB, Cassandra).
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Familiarity with data warehousing solutions like Snowflake, Redshift, or BigQuery.
• Understanding of distributed systems and parallel processing.
• Experience with version control systems like Git.

Preferred Qualifications

• Experience with real-time streaming tools like Apache Kafka or Flink.
• Knowledge of containerization tools like Docker and orchestration tools like Kubernetes.
• Exposure to CI/CD pipelines and DevOps practices.
• Experience working in Agile/Scrum environments.
• Understanding of data governance and security standards.

Soft Skills

• Strong problem-solving and analytical thinking.
• Excellent communication and collaboration skills.
• Ability to work independently and in a team environment.
• Attention to detail and commitment to quality.

Work Model

• Hybrid work model (combination of remote and office work).
• Flexibility to work from Gurgaon, Bangalore, or Chennai offices.

Why Join Us

• Opportunity to work on large-scale, cutting-edge data platforms.
• Collaborative and innovative work environment.
• Career growth and learning opportunities.
• Competitive salary and benefits package.