Data Engineer

The Opportunity:

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities:

• Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
• Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
• Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing/verification applications and other tools, while adhering to specific development best practices and quality standards.
• Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
• Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
• Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
• Implement and maintain data governance and API governance policies and standards across the microservices landscape.
• Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
• Available to support/unblock planned deployments during off hours.
• Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
• Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies:

• Git, CI/CD, Jenkins, ArgoCD
• Scala/Java, SQL/SparkSQL, Python
• Apache Spark, Databricks, Apache Storm
• Cosmos DB, Redis,
• Maven, Gradle Build Tools
• Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
• Cosmos DB, Redis Cache and Redis Insight Tool
• Grafana, Grafana Loki Logging
• Restful API Design Patterns, Swagger Documentation
• Experience with markup languages such as JSON and YAML
• Proven experience designing and implementing microservices architectures.
• Strong understanding of data modeling, data warehousing, and ETL processes.
• Experience with containerization technologies such as Docker and Kubernetes.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
• Experience with Node.js.

Familiarity with Rust is a plus.