Data Engineer

Position: AWS Scala Data Engineer (410 Years Experience)

Location: Hyderabad

We are seeking a skilled Data Engineer to join our team, specializing in Scala, PySpark, and Databricks. In this position, youll work with complex data sets and a variety of data sources, ensuring the highest standards of data quality through robust validation processes.

Key Responsibilities:

• Design, develop, and support data processing pipelines, analytics, and visualizationsespecially within Quantexa (experience with Quantexa is a plus)
• Analyze large and complex data sets to uncover patterns, trends, and actionable insights
• Collaborate with cross-functional teams to understand business needs and deliver data-driven solutions
• Integrate multiple disparate data sources into a unified data platform and build interactive dashboards
• Establish and enforce validation procedures to ensure data accuracy and consistency
• Leverage PySpark, Spark, SQL, and Databricks to optimize data processing and query performance

Qualifications:

Strong hands-on experience in Scala, Python, ETL, PySpark, Spark, SQL, AWS, and Databricks

• Familiarity with Quantexa is an advantage