Big Data Engineer

We are looking for a highly motivated, self-starter Big Data Developer (Applications Development - C11) with a passion for data and with the ability to drive multiple projects on our Big Data Platform for regulatory applications. This job involves being part of a dynamic team and contributing towards software development of the next generation Big Data Platform. The ideal candidate will have an eye for building and optimizing data systems and will work closely with our systems architects, data scientists, and analysts to help direct the flow of data within the pipeline and ensure consistency of data delivery and utilization across multiple projects.

Development Value:

Candidate has the opportunity to be a major contributor to the Citi Trade Data Strategy and contribute towards the goal of increasing revenue using key metrics for decision-making. The candidate will work with bright and innovative individuals both on the business and technology side and the successful candidate can make a significant difference to the business performance. The successful candidate will have an excellent opportunity to work with various businesses.

Key Responsibilities:

• The Big Data developer will be working very closely with and managing the work of a team of data engineers working on our Big Data Platform. This role needs below core skills:
• Work closely with the Vanguard data model, core & product processor teams and drive the build out & migration of Trade data for multiple incentive.
• Accountable for all phases of development process – analysis, design, construction, testing and implementation in agile development lifecycles
• Perform Unit Testing, System Testing for all applications developed / enhancements and ensure that all critical and high-severity bugs are addressed.
• Subject Matter Expert (SME) in at least one area of Applications Development
• Align to Engineering Excellence Development principles and standards
• Promote and increase our Development Productivity scores for coding
• Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline
• Strong SQL skills to extract, analyze and reconcile huge data sets
• Demonstrate ownership and initiative taking
• Project will run in iteration lifecycles with agile practices, so experience of agile development and scrums is highly beneficial.

Qualifications:

• 4+ years of experience in application/software development
• Experience with Big Data technologies (Spark, Hadoop, Hive, Impala, Scala) Performance optimization on Big Data Solid understanding of the Big Data architecture and the ability to trouble shoot development and/or performance issues on Hadoop (Cloudera preferably)
• Hands-on with Relational SQL and NoSQL databases (Oracle, MongoDB) and Big Data querying tools (Hive and Impala)
• Experience with Python and Shell scripting is required, Deep functional and technical experience in Capital/Regulatory Markets Technology across Front Office, Middle Office, Operations, Risk & Finance
• Experience in all phases of Software Development Life Cycle (SDLC): analysis, design, development, testing, implementation 
• Strong data analysis skills, including the ability to slice and dice the data as needed for business reporting
• Ability to work independently given general guidance

Education:

Bachelor's degree/University degree or equivalent experience,

Master's degree preferred