Azure Data Engineer

Azure Data engineer

Candidate must have a strong background in data engineering, with expertise in Azure Databricks, Azure Data Factory (ADF), SQL. You will be responsible for designing, developing, and maintaining data pipelines and solutions that support our business objectives.

Key Responsibilities:

• Design and maintain scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.
• Use PySpark for efficient data processing of large volumes.
• Optimize SQL queries and scripts for ETL processes.
• Manage and integrate data from various sources, including Teradata, ensuring quality and consistency.
• Monitor and troubleshoot data pipelines for reliability.
• Implement best practices for data governance, security, and compliance.
• Stay updated with industry trends and technologies to enhance data engineering practices.

Qualifications:.

• 5+ years of experience in data engineering or a related role.
• Strong proficiency in Databricks and PySpark.
• Experience with Azure Data Factory (ADF).
• Proficient in SQL and experience with Teradata.
• Solid understanding of data warehousing concepts and ETL processes.
• Experience with data integration and data migration projects.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Preferred Qualifications:

• Experience with other Azure services such as Azure Synapse Analytics, Azure Data Lake Storage, and Azure SQL Database.
• Knowledge of data visualization tools like Power BI.
• Certification in Azure Data Engineering or related areas.