Job Skills:

Azure ADF, Azure ADF, BI/BA

Responsibilities:

• Design and implement cloud-based data management, big data, data warehousing, and analytics solutions using Azure technologies.
• Architect and develop highly scalable and performant data solutions using Azure Databricks, Azure SQL, Apache Spark (Scala/Python), and other Azure data management services.
• Develop ETL transformations and loads using Azure Databricks to apply built-in functions to manipulate data, write UDFs, and apply UDFs with multiple DataFrame column inputs.
• Manage Delta Lake using Databricks to create, append, and upsert data into a data lake.
• Use Spark SQL to examine and query datasets, and develop DataFrames for ETL transformation and loads.
• Implement Azure Data Factory Pipelines using the latest technologies and techniques.
• Apply advanced SQL techniques and experience in Azure SQL DW.
• Communicate actionable insights using data for a non-technical audience and connect with stakeholders to gain a full understanding of the problems they are looking to solve.
• Apply analytical thinking and critical thinking to find analytical solutions to abstract business issues.
• Work in an agile environment and apply software development lifecycles/methodologies.
• Collaborate with team members, stakeholders, and clients to deliver solutions that meet their needs.

Essential Skills:

• 10+ years of experience in data management, big data, data warehousing, and analytics.
• Hands-on experience in architecting and implementing cloud platforms, including Azure Databricks, Azure SQL, Apache Spark (Scala/Python), etc.
• Expert in Azure Data Factory, Azure Data Lake Analytics, Python, Spark SQL, and Azure Databricks.
• Strong SQL skills with experience in Azure SQL DW.
• Experience handling structured and unstructured datasets.
• Experience in data modeling and advanced SQL techniques.
• Strong problem-solving, time management, and organizational skills.
• Excellent oral and written communication skills, with the ability to communicate effectively with all stakeholders.
• Strong collaboration and interpersonal skills.
• Strong presentation skills, with the ability to communicate all aspects of job requirements, including the creation of formal documentation.

Essential Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• Relevant industry certifications, such as Azure Architect certification, are preferred.
• Experience in big data analytics technologies.
• Experience in working with distributed computing tools such as Hadoop and Spark.
• Experience in managing and architecting big data solutions in Azure.
• Experience in agile development methodologies.
• Familiarity with DevOps tools and processes.
• Proven track record of delivering successful data solutions promptly.