Big Data Developer

Walk in drive at 23 May 2026!!!!

Location

Chennai - Siruseri ATL,Tata Consultancy Services (TCS) Siruseri Campus is located at Plot No. 1/G1, SIPCOT IT Park, Navalur Post, Siruseri, Chennai, Tamil Nadu 603103

Bangalore- TCS, Think Campus 42, 45-P, Hosur Rd, Phase II, Konappana Agrahara,Bengaluru, Karnataka 560100

Pune- A1 Interview Bay, Plot No. 2 & 3, Phase 3, Rajiv Gandhi Infotech Park, Hinjewadi, Pune, Maharashtra, 411057

Job Title

Big Data Engineer Hadoop Ecosystems

Experience

4 to 15 Years

Location

Chennai / Pune / Bangalore

Job Summary

We are looking for experienced Big Data Engineers with strong expertise in the Hadoop Ecosystem to design, develop, and support large-scale data processing and analytics platforms. The ideal candidate will have hands-on experience in building and optimizing data pipelines for batch and streaming workloads.

Key Responsibilities

• Design, develop, and maintain scalable Big Data solutions using Hadoop ecosystem technologies
• Build and enhance data ingestion and processing pipelines for structured and unstructured data
• Work extensively with HDFS, Hive, Spark, and YARN
• Develop high-performance batch and streaming applications
• Optimize performance of Hive/Spark jobs and storage formats
• Ensure data quality, reliability, and availability
• Collaborate with data scientists, analysts, and platform teams
• Monitor, troubleshoot, and resolve production issues
• Follow best practices for data security and governance
• Create technical documentation and support knowledge sharing

Mandatory Technical Skills

Hadoop & Big Data

• Hadoop Core: HDFS, YARN, MapReduce (conceptual understanding)
• Apache Spark (Core, SQL; Streaming preferred)
• Hive (query optimization, partitions, file formats)

Data Ingestion & Workflow

• Kafka / Sqoop / Flume
• Workflow orchestration tools: Oozie / Airflow

Programming & Querying

• Proficiency in Python / Scala / Java (at least one mandatory)
• Strong SQL skills

Data Storage

• HBase or other NoSQL databases
• Experience with data lakes and large datasets

Cloud & Platform (Good to Have)

• Hadoop on AWS EMR, Azure HDInsight, or Databricks
• Understanding of Docker and Kubernetes
• Exposure to CI/CD pipelines for data engineering

Qualifications

• Bachelors or Masters degree in Computer Science, IT, or related field
• 310 years of hands-on experience in Big Data and Hadoop technologies

Soft Skills

• Strong analytical and problem-solving skills
• Ability to work in agile and cross-functional teams
• Good communication and documentation skills

Preferred / Nice to Have

• Real-time data processing experience
• Knowledge of data governance, security, and lineage
• Hadoop or cloud-related certifications