Senior Big Data Engineer - C12 - PUNE

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Key Responsibilities:

Design, develop, and optimize large-scale data pipelines and workflows using Big Data technologies such as Hadoop, Hive, Impala, Spark
Build and maintain data integration solutions to process structured and unstructured data from various sources.
Implement and manage CI/CD pipelines to automate deployment and testing of data engineering solutions.
Work with relational databases like Oracle to design and optimize data storage and retrieval.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Ensure data quality, security, and governance across all data engineering processes.
Monitor and troubleshoot performance issues in data pipelines and systems.
Stay updated with the latest trends and advancements in Big Data and data engineering technologies.

Required Skills and Qualifications:

• 5-8 years of proven experience in Big Data technologies: Hadoop, Hive, Impala, Spark
•  Strong programming skills in Java, Scala and Python
• Hands-on experience with CI/CD tools like Jenkins, Git, or similar.
• Proficiency in working with relational databases, especially Oracle.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Experience in systems analysis and programming of software applications
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
• Excellent communication and collaboration skills.

Education:

• Bachelor’s degree/University degree or equivalent experience

Education:

• Bachelor’s degree/University degree or equivalent experience