Job Purpose

The analytics engineer will be able to support the maintenance, optimisation and monitoring of our data infrastructure. Provide technical expertise to ensure efficient data handling and data modelling for data driven solutions. Additionally, deliver user-friendly tools that enable non-technical users to explore and understand data with ease.

Key Responsibilities

Ownership

This role deals with a wide variety of tasks including, but not limited to the following:

• Support the development of ETL/ELT pipelines through Azure Databricks.
• Support the development and implementation of medallion (Bronze/Silver/Gold) datasets in Azure Databricks
• Support the data team in collaborating with other business teams to understand their data-related challenges and be an advocate for a “data-first” approach.
• Support the management and organisation of data assets within Unity Catalog for data governance, security and access control.
• Assist in developing maintaining data quality, consistency and compliance with industry best practices.
• Support the development of data pipeline monitoring tools within Databricks.
• Work closely with data and business teams to understand requirements to translate business needs into technical solutions and best practices.

Knowledge, Skills and Experience

Essential

• Understanding of Azure (Data Lake, Blob Storage)
• Understanding of Databricks (AWS, Azure, GCP)
• Understanding of Python, including experience with data manipulation libraries (PySpark)
• Ability to write SQL for data retrieval and transformations.
• Proficiency in data visualization tools (Preferably Power BI)
• Strong problem-solving skills to address and resolve data-related issues.
• IT literate use of Microsoft applications.
• High attention to detail.

Desirable

• Understanding of version control (Git)
• Understanding of data architecture and data modelling
• Understanding of Unity Catalog.
• Experience collaborating with teams and stakeholders to deliver data projects.
• Microsoft Azure Data Fundamentals (DP-900) or Databricks certified