Data Engineer

Job Opening: Data Engineer

Location: Navi Mumbai

Experience : 2+Yrs

Notice period : Immediate Joiners

Work Model : WFO

Interview Rounds - 2 (2nd Round - F2F Mandatory)

Job Description

We are seeking a Data Engineer to join our Technology team. The ideal candidate will design, implement, and optimize data pipelines and solutions, focusing on the Hadoop ecosystem and Cloudera platform. You will work with structured and unstructured data to deliver scalable business solutions, collaborating closely with analysts and business stakeholders.

Key Responsibilities

• Automate new data pipelines as requirements arise.
• Monitor ETL jobs and reports daily for multiple departments.
• Support and enhance existing ETL processes.
• Handle Hadoop administration tasks:
• Linux administration and troubleshooting
• Planning, deploying, and maintaining Hadoop clusters
• Monitoring and ensuring high availability and security
• Work with Hadoop ecosystem tools (Apache Sqoop, PySpark) for efficient data movement and processing.
• Connect to diverse data sources and manage authentication mechanisms.
• Optimize workflows (mappers, memory allocation, partitioning strategies).
• Diagnose and resolve issues such as connectivity problems, data type mismatches, performance bottlenecks, and job failures.

Required Skills & Experience

• Bachelors degree in Computer Science, Engineering, or equivalent.
• 23 years of experience as a Data Engineer, preferably in BFSI or fintech.
• Strong hands-on experience with Hadoop ecosystem components: HDFS, Hive, Pig, Impala, Sqoop, Oozie, YARN, Cloudera Manager.
• Proficiency in PySpark for large-scale data processing and ETL pipelines.
• Experience with Spark, MapReduce, or other distributed computing frameworks.
• Proficiency in SQL and data manipulation.
• Familiarity with Hadoop/Cloudera troubleshooting.
• Programming skills in Python/Scala (Java is a plus).
• Linux administration, shell scripting, and networking basics.
• Experience with data ingestion frameworks (Kafka, Flume).
• Strong understanding of data security, governance, and access controls.
• Excellent problem-solving, communication, and cross-team collaboration skills.

Interested and eligible candidates can share their CV's to Pranjal.Deshmukh@Simplelogic.in along with below details :

Current Location :

Preferred Location :

Total Experience :

Current CTC :

Expected CTC :

Notice Period/Last working Day :