AWS-Scala Engineer

We are seeking a highly skilled and experienced Senior Big Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks.

Key Responsibilities:

• Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data .
• Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway .
• Work extensively with streaming platforms like Kafka, Flink, Spark Streaming .
• Develop and optimize data ingestion workflows using Apache NiFi, Airflow, Sqoop, Oozie .
• Build and maintain data lakes and analytics platforms using AWS Lake Formation .
• Hands-on development using Scala with Spark for distributed data processing.
• Work with NoSQL databases including DynamoDB, HBase , and Hadoop ecosystem tools like MapReduce, Hive, HDFS .
• Collaborate with cross-functional teams to deliver high-performance data solutions.

Technical Skills Required:

• Mandatory: Spark, Scala, AWS, Hadoop
• Big Data Tools: EMR, Glue, Hive, HDFS, HBase, MapReduce
• Streaming & Messaging: Kafka, Kinesis, Flink, Spark Streaming
• Data Ingestion: Apache NiFi, Airflow, Sqoop, Oozie
• Cloud Platforms: AWS (preferred), Hortonworks, Cloudera, MapR
• Programming: Scala (with Spark), Python (optional)
• Databases: DynamoDB, NoSQL, HBase
• Others: AWS Athena, Lake Formation, CloudFormation