Job Summary
Join our dynamic team as a Developer with the mini Exp of 4 to 6 years where you will leverage your expertise in Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. With a hybrid work model and day shifts you will contribute to innovative projects that drive our companys success. Your role will be pivotal in enhancing data solutions and optimizing workflows impacting both the company and society positively.
Responsibilities
- Develop and implement data solutions using Azure Data Lake Store to enhance data storage and retrieval processes.
- Collaborate with cross-functional teams to integrate Azure DevOps for streamlined development and deployment workflows.
- Utilize Python to design and execute efficient data processing scripts ensuring high-quality data management.
- Employ Databricks SQL to create and optimize queries for data analysis and reporting improving decision-making processes.
- Manage and automate data workflows using Databricks Workflows ensuring seamless data pipeline operations.
- Apply PySpark for large-scale data processing enabling faster and more efficient data handling.
- Ensure data security and compliance with industry standards safeguarding company and client information.
- Troubleshoot and resolve technical issues related to data solutions maintaining system reliability and performance.
- Collaborate with stakeholders to understand business requirements and translate them into technical specifications.
- Provide technical guidance and support to team members fostering a collaborative and innovative work environment.
- Continuously evaluate and improve existing data solutions driving innovation and efficiency within the organization.
- Document and maintain comprehensive records of data solutions and workflows ensuring knowledge sharing and continuity.
- Stay updated with the latest industry trends and technologies incorporating them into the companys data strategy.
Qualifications
- Possess a strong background in Azure Data Lake Store and Azure DevOps with proven experience in implementing data solutions.
- Demonstrate proficiency in Python Databricks SQL and Databricks Workflows with a focus on optimizing data processes.
- Have hands-on experience with PySpark for large-scale data processing ensuring efficient data management.
- Exhibit excellent problem-solving skills and the ability to troubleshoot technical issues effectively.
- Show a keen understanding of data security and compliance standards ensuring data integrity and protection.
- Display strong communication skills with the ability to collaborate effectively with cross-functional teams.
- Be adaptable to a hybrid work model with a commitment to maintaining productivity and collaboration.
Certifications Required
- Microsoft Certified: Azure Data Engineer Associate Databricks Certified Data Engineer Associate