Senior Data Engineer

Acuity Analytics is hiring multiple 'Senior Data Engineers ' for its Data and Technology Services Team at Bengaluru, Gurgaon and Pune (hybrid).

"The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of Databricks (including core data engineering concepts); we need primarily are people with strong experience of working with data - from files, real-time data streams - using Python

'Immediate Joiners are highly preferred! ' (0-30 days)

Mandatory Skills:

• Candidates should have a Bachelors or masters in science or engineering disciplines (Computer Science, Engineering, Math's, Physics, etc.) or a related field.
• 6+ years of strong hands-on experience in a data engineering role, preferably within the financial services industry.
• Strong experience with data pipeline tools and frameworks such as Python, SQL, and Spark.
• Proficiency in cloud platforms, particularly Azure, Snowflake, and Databricks.
• Experience with data integration from various sources including APIs and databases.
• Strong understanding of data warehousing concepts and practices.
• Familiarity with big data technologies and frameworks.
• Excellent communication skills, both written and verbal.

Responsibilities:

• Develop, optimize, and maintain scalable and reliable data pipelines using tools such as Python, SQL, and Spark.
• Integrate data from various sources including APIs, databases, and cloud storage solutions such as Azure, Snowflake, and Databricks.
• Implement data quality checks and ensure the accuracy and consistency of data.
• Manage and optimize data storage solutions, ensuring high performance and availability.
• Work closely with data scientists and DevOps engineers to ensure seamless integration of data pipelines and support machine learning model deployment.
• Monitor and optimize the performance of data workflows to handle large volumes of data efficiently.
• Implement security best practices and ensure compliance with industry standards.

Interested ones, please share your updated CVs at