Job Summary
Senior Data Engineer who will work on ADF Azure Synapse Pyspark Python API C# Azure function SQL Server queries and Azure services.
Responsibilities
Design develop and maintain scalable data pipelines using Azure Synapse PySpark and SQL.
Collaborate with cross-functional teams and stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune data processing workflows for performance and scalability.
Implement data quality checks and ensure data integrity across various data sources.
Monitor and troubleshoot data pipelines to ensure smooth operation and minimal downtime.
Provide technical support and guidance to team members on data-related issues.
Participate in code reviews to ensure adherence to best practices and coding standards.
Contribute to the design and architecture of data solutions to meet business objectives.
Stay updated with the latest industry trends and technologies to continuously improve data solutions and cloud computing.
Drive continuous improvement in data processing and analysis methodologies.
Document data processes models and workflows for future reference and knowledge sharing.