Data Engineer - Azure

What you’ll be doing:

• Designing, implementing, and supporting key datasets that provide structured and timely access to actionable business information with the needs of the end customer always in view
• Retrieving and analysing data using SQL, Excel, and other data management systems
• Creating ETLs/ELTs to take data from various operational systems and craft a unified dimensional or star schema data model for analytics and reporting
• Developing a deep understanding of vast data sources (existing on the cloud) and know exactly how, when, and which data to use to solve particular business problems
• Creating data tools and web/digital/mobile applications for analytics and data scientist team members that assist them in building and optimising our analytics, including deployment into operations and client systems
• Assembling large, complex data sets that meet functional / non-functional business requirements
• Identifying, designing, and implementing internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
• Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Azure and the continually emerging big data technologies
• Embedding processes to ensure we regularly check and improve data quality of our core analytics data sources and warehouse
• Assisting with data-related technical issues and support their data infrastructure needs
• Creating and maintaining optimal data pipeline architecture and work with data and analytics experts to strive for greater functionality in our data systems
• Building analytics tools that utilise the data pipeline to provide actionable insights into customer experience, operational efficiency and other key business performance metrics

What you’ll need:

• Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
• Hands-on experience with Microsoft Azure Stack including Azure Data Lake, Azure Data Factory, Azure Data bricks, Notebooks, Analytics / OLAP Cube Development (Microsoft AAS and MDX), Log Analytics, DevOps, Python, Pyspark Sql , Spark Sql, and Data Modelling
• Knowledge of ASP.Net, C#.NET, LINQ, JQuery, Java Script, Angular DataTables, Ajax, XML, Web Services and Web API
• Experience with Azure to design, support, and management of the environment.
• Experience leading and designing data warehousing and analytics project infrastructure, and integrating technical components including using Azure
• Experience with production BI implementation in the Cloud
• Exposure to reporting tools such as Qlikview or Power BI (Desirable)
• Expertise with application design, software development and automated testing, preferably in a mobile/digital space
• Ability to effectively interpret technical and business objectives and challenges, and articulate solutions
• Experience building and optimising big data pipelines, architectures and data sets