Spark / Scala Developer - C11 - CHENNAI

This is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities:

• Design & development of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform.
• Develop and optimize Spark applications for performance and scalability.
• Design, code, test, document and implement application release projects as part of development team.
• Work with onsite development partners to participate in design and architecture for key enterprise applications to ensure deliver software on time, to required standards and as per the design documentation.
• Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns.
• Compliance with Citi's System Development Lifecycle and Information Security requirements.
• Will work closely with Quality Control teams to deliver quality software to agreed project schedules.
• Work with BA and understand all functional and technical requirements of the project.

Qualification & Key Competencies:

• BS or MS Degree in Computer Science, Information Technology, or equivalent
• Minimum 5+ years of proven project experience in developing big data solutions using Apache Spark. Having strong hold on Spark-core, Spark-SQL & Spark Streaming
• Strong programming skills in Scala, Java, or Python
• Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc. 
• Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like mongoDB
• Familiarity with data warehousing concepts and ETL processes
• Knowledge in Ab Initio especially in GDE, Plans will be an added advantage

Other Competencies:

• Excellent organization skills, attention to detail, and ability to multi-task
• Demonstrated sense of responsibility and capability to deliver quickly
• Excellent communication skills. Clearly articulating and documenting technical and functional specifications is a key requirement.
• Proactive problem-solver
• Build relationships with various stakeholders, team player
• Flexibility to work in multiple complex projects and changing priorities
• Excellent verbal, written and interpersonal communication skills
• Good analytical and business skills

Desirable Skills:

• Experience in Financial industry
• Experience in working on a large scale global project.
• Experience with Commercial Cards applications and processes would be advantageous
• Experience/knowledge on Cloud technologies AWS, GCP
• Experience with Agile methodology