Senior AI/Big Data Engineer

• Design and implement large-scale, fault-tolerant data pipelines on OCI, using services like OCI Data Integration, OCI Data Flow (Apache Spark), Object Storage, and Autonomous Database.
• Build and manage streaming data architectures using tools such as OCI GoldenGate, Apache Kafka, and Spark/Flink Streaming.
• Enforce standards and automation across the entire data lifecycle, including schema evolution, dataset migration, and deprecation strategies.
• Improve platform resilience, data quality, and observability with advanced monitoring, alerting, and automated data governance.
• Serve as a technical leader, mentoring junior engineers, reviewing designs and code, and promoting engineering best practices.
• Collaborate cross-functionally with ML engineers, platform teams, and data scientists to integrate data services with AI/ML workloads.
• Partner in AI pipeline enablement, ensuring Lakehouse services efficiently support model training, feature engineering, and real-time inference.

Minimum Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related technical field.
• 4–6 year’s experience designing and building cloud-based data pipelines and distributed systems.
• Proficiency in at least one core language: Python, Java, or Scala.
• Familiar with lakehouse formats (Iceberg, Delta, Hudi), file formats (Parquet, ORC, Avro), and streaming platforms (Kafka, Kinesis).
• Strong understanding of distributed systems fundamentals: partitioning, replication, idempotency, consensus protocols.