Senior Big Data Developer (AVP)

Job Description:

Data Fabric team is building the next generation Data fabric to solve for Business, Analytics and growing regulatory needs. Vast amounts of data assets have been accumulated through the years. Data fabric built on emerging technologies will facilitate the data being inspected, cleansed, transformed for support decision-making

We are looking for a highly motivated, self-starter Senior Big Data developer with a passion for data and with the ability to drive multiple projects on our Big Data Platform for regulatory applications. This job involves being part of a dynamic team and contributing towards software development of Olympus components within the next generation Big Data Platform. The ideal candidate will have an eye for building and optimizing data systems and will work closely with our systems architects, data scientists, and analysts to help direct the flow of data within the pipeline and ensure consistency of data delivery and utilization across multiple projects.

Development Value:

Candidate has the opportunity to be a major contributor to the Citi Markets Data Strategy and contribute towards the goal of increasing revenue using key metrics for decision-making. The candidate will work with bright and innovative individuals both on the business and technology side and the successful candidate can make a significant difference to the business performance. The successful candidate will have an excellent opportunity to work with various businesses within SPIDER and LOPR application areas.

Key Responsibilities:

The Senior Big Data developer will be working very closely with and managing the work of a team of data engineers working on our Big Data Platform. This role needs below core skills:

• Work closely with the Olympus data model, core & product processor teams and drive the build out & migration of DMS SPIDER and LOPR feeds to Olympus using Olympus framework
• Accountable for all phases of development process – analysis, design, construction, testing and implementation in agile development lifecycles
• Perform Unit Testing, System Testing for all applications developed / enhancements and ensure that all critical and high-severity bugs are addressed.
• Subject Matter Expert (SME) in at least one area of Applications Development
• Align to Engineering Excellence Development principles and standards
• Promote and increase our Development Productivity scores for coding
• Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline
• Strong SQL skills to extract, analyze and reconcile huge data sets
• Demonstrate ownership and initiative taking
• Project will run in iteration lifecycles with agile practices, so experience of agile development and scrums is highly beneficial.

Qualifications:

• Bachelor's degree/University degree or equivalent experience, Master's degree preferred
• 8-12 year’s experience in application / software development

Skills:

• Experience with Big Data technologies (Spark, Hadoop, Hive, Impala, Scala)
• Performance optimization on Big Data
• Solid understanding of the Big Data architecture and the ability to trouble shoot development / Performance issues on Hadoop (Cloudera preferably)
• Experience with Python and Shell scripting is a Must
• Prior work Experience in Capital/Regulatory Market or related industry
• Experience in Analysis, Design, Development, Testing and Implementation (all phases of software development life cycle - SDLC)
• Strong SQL development experience either Oracle, Sybase or MySQL
• Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
• Ability to work independently given general guidance