Required Skills:
- 8-10+ years of Data Engineering experience in Cloud and Big Data technologies like Azure, Spark, PySpark, Hive, Scala or Java, SQL queries
- 2+ years of good hands on experience in data extraction, ingestion, transformation and processing of large and complex data sets in Azure big data services
- Development / Coding experience required in :
- Azure Data Factory
- Azure Data Lake Storage
- Azure Databricks
- PySpark
- Azure DevOps, CI/CD
- SQL Queries, Functions, Procedures
- Azure Data Flow
- Azure Synapse
- Azure SQL Database / Azure SQL Data Warehouse
- Experience with AGILE / SAFe project delivery. Strong experience with estimating tasks for user stories.
- Verbal and written communication skills, problem solving skills, customer service and interpersonal skills.
- Expert ability to work independently and manage one’s time.
- Expert mentoring skills necessary to provide support and constructive performance feedback.
- Expert knowledge of the full software development lifecycle: from business/systems analysis, through requirements gathering and functional specification authoring, to development, testing and delivery.
- Expert ability to troubleshoot issues and make system changes as needed to resolve issue.
Education/Experience:
- Bachelor’s degree in computer science, data engineering or relevant IT field required.
Certifications:
- DP-200 / DP-201 / DP-203 : Azure Data Engineering Associate
- SAFe 5 Practitioner
AZ-400: Designing and Implementing Microsoft DevOps Solutions
Azure Data Factory