Principal Data Engineer

Primary responsibilities for this role will include:

• Collaborate with product and development teams to drive the technical roadmap and guide development and implementation of new data driven business solutions
• Drive technical standard and best practices, and continuously improve commercial data platform engineering & scalability.
• Architecture and design of commercial data platform & product capabilities including data processing batch and streaming engines, Data Lake, Machine Learning models, In Memory Computing Systems, Distributed Data Systems, Data Governance & Observability
• Bring in the best architecture and build highly available and scalable applications
• Participate in design and code review sessions as appropriate to ensure the quality of work in accordance with development standards
• Identify opportunities for future enhancements and refinements to standards, best practices, and development methodologies
• Contribute to development of product innovation
• Coaching and mentoring junior team members and evolving team talent pipeline

Basic Qualifications:



• 12+ years of relevant work experience with a Bachelor’s Degree or at least 9 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 6 years of work experience with a PhD, OR 15+ years of relevant work experience.

• BS or MS in computer science or related field

• 15+ years of System Development Experience

• Expert in leading-edge areas such as Batch, Stream Computing, In-Memory Computing.

• Expert in few of the following: Apache Spark, Streaming, Flink, Java, Python

• Expert in web service standards and related patterns (REST, gRPC)

• Expert in developing large scale, enterprise class distributed system or subsystems that require high availability, low-latency, & strong data consistency computing.

• Expert in architecting solutions with Continuous Integration and Continuous Delivery in mind

• Experience with Big Data and analytics in general leveraging technologies like Hadoop, Spark, and MapReduce

• Experience developing proper metrics instrumentation in software components, to help facilitate real-time and remote troubleshooting/performance monitoring.

• Strong interpersonal and leadership skills with effective communication (both written and verbal) skills and the ability to present complex ideas in a clear & concise way, to different audiences. A team player with good work ethics

• A background in the payment domain is a plus