Lead Data Engineer - Spark/Scala

Job Title : Lead Data Engineer - Spark/Scala

Job Location : Bengaluru

Exp : 6-12 years

Position Overview : We are hiring Data Engineer with hands on experience on Spark/Scala and other Big Data Technologies .

Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms) Proficient in developing automated frameworks for unit & integration testing. Proficient with Kubernetes, Docker, Helm and related container technologies. Proficient in deploying and managing Spark workloads on Kubernetes clusters.