Big Data (Spark, Python) - AVP - Pune

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Key Responsibilities:

The Senior Big Data Engineer will be working very closely with and managing the work of a team of data engineers working on our Big Data Platform. The tech lead will need below core skills:

• Work closely with the Olympus core & product processor teams and drive the build out & implementation of the CitiDigital reporting using Olympus framework
• Accountable for all phases of development process – analysis, design, construction, testing and implementation in agile development lifecycles
• Perform Unit Testing, System Testing for all applications developed / enhancements and ensure that all critical and high-severity bugs are addressed.
• Subject Matter Expert (SME) in at least one area of Applications Development
• Align to Engineering Excellence Development principles and standards
• Promote and increase our Development Productivity scores for coding
• Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline
• Strong SQL skills to extract, analyze and reconcile huge data sets
• Demonstrate ownership and initiative taking
• Project will run in iteration lifecycles with agile practices, so experience of agile development and scrums is highly beneficial.

Qualifications:

• Bachelor's degree/University degree or equivalent experience, Master's degree preferred
• 8-12 year’s experience in application / software development

Skills:

• Prior work Experience in Capital/Regulatory Market or related industry
• Experience with Big Data technologies (Spark, Hadoop, HDFS, Hive, Impala)
• Experience with Python/Scala and Unix Shell scripting is a must
• Excellent analytical, problem solving, negotiating, influencing, facilitation, prioritization, decision-making and conflict resolution skills are required
• Solid understanding of the Big Data architecture and the ability to trouble shoot development / Performance issues on Hadoop (Cloudera preferably)
• Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
• Passionate, self-driven with can do attitude
• Able to build practical solutions
• Good Team player, who can work with global team model and deadline oriented
• The candidate is expected to be dynamic, flexible with a high energy level as this is a demanding and rapidly changing environment.
• Ability to work independently given general guidance

Education:

• Bachelor’s degree/University degree or equivalent experience