Azure Data Engineer

Creospan is a growing tech collective of makers, shakers, and problem solvers, offering solutions today that will propel businesses into a better tomorrow. Tomorrows ideas, built today! In addition to being able to work alongside equally brilliant and motivated developers, our consultants appreciate the opportunity to learn and apply new skills and methodologies to different clients and industries.

Job Title: Azure Data Engineer

Location: , Pune, Maharashtra, India (Hybrid)

The Data Analytics Engineer will be responsible for implementing solutions on Azure Data Lake for integration with Power BI. They must collaborate with team members and stakeholders to understand data requirements and use that to effectively structure datasets and develop metrics.

MAJOR DUTIES INCLUDE:

• Collaborate with team members and stakeholders to understand data and metric requirements
• Pull data from a variety of sources into a central data platform
• Structure datasets and calculate metrics based on requirements
• Develop automated scripts to automate otherwise manual processes
• Communicate concerns and data findings as they arise to the appropriate team members or stakeholders
• Present data findings and solutions in a way that is easy for non-technical team members and stakeholders to understand

KNOWLEDGE/SKILLS:

• Minimum of 8 years of Data Engineering Experience (Min 4 years of relevant dev experience in Azure Data Lake. Overall experience may be higher).
• Build and manage scalable data lake solutions using Azure Data Lake Storage Gen2, integrating with services like Data Factory, Databricks, and Synapse Analytics.
• Design and optimize data pipelines for efficient ingestion, transformation, and storage using SQL, Python, and modern file formats such as Parquet and Delta Lake.
• Develop and deploy ETL solutions on Azure
• Excellent oral and written communication skills
• Self-starter with analytical, organizational, and problem-solving skills
• Must be highly flexible and adaptable to change