Big Data and Hadoop Developers With Spark/Scala

I hope you're doing well! I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS

Job Title: Big Data and Hadoop Developers With Spark/Scala

Location: PAN India

Mode: Full Time

Experience: 5-10 years

Job Summary: An experienced Big Data and Hadoop Developer / Lead to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have a strong background in Hadoop ecosystem, big data technologies, and programming languages like Java, Python, or Scala.

Responsibilities:

Design and Development: Design, develop, and maintain Hadoop applications, including data ingestion, processing, and storage.

Data Processing: Develop and optimize Hadoop MapReduce jobs, Hive queries, and Pig scripts for data processing and analysis.

Data Management: Manage and maintain Hadoop clusters, including configuration, monitoring, and troubleshooting.

Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.

Innovation: Stay up to date with industry trends, new technologies, and best practices in big data and Hadoop.

Required Skills:

Hadoop Ecosystem: In-depth knowledge of Hadoop, HDFS, MapReduce, Hive, Pig, HBase, and Spark.

Programming: Strong programming skills in Java, Python, or Scala.

Big Data Technologies: Experience with big data technologies, including NoSQL databases, data warehousing, and ETL tools.

Data Processing: Experience with data processing frameworks, including Hadoop, Spark, and Flink.

Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark

Communication: Excellent communication and collaboration skills.

Preferred Skills:

Cloud Experience: Experience with cloud-based big data platforms, such as AWS EMR, Azure HDInsight, or Google Cloud Dataproc.

Machine Learning: Experience with machine learning and deep learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn.

Certifications: Relevant certifications, such as Cloudera Certified Professional (CCP) or Hortonworks Certified Developer (HCD)