Senior Data Engineer

*Senior Data Engineer
*$107,876 - 123,593 + super - Pro rata
*On-site requirements - Oran Park

We are seeking a highly skilled and motivated Senior Data Engineer to join our team and spearhead our data transformation initiatives using Azure cloud services. This role will be responsible for delivering data integration solutions through ETL pipelines, data modelling, data governance, and analytics capabilities by translating complex business requirements into a data

Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL processes using Azure Data Factory for data ingestion from diverse sources including on-premises databases (Authority), API-based CAMMS, and data files in CSV and JSON formats.
• Utilize data lake storage (GEN2) and data lake for managing data in different.
• Implement data processing workflows using Azure Databricks to transform raw data into processed high-quality data assets
• Develop and optimize data models in Databricks and Power BI ensuring they meet performance and scalability requirements.
• Enable advanced analytics capabilities by providing clean, structured, and reliable data for analysis and reporting using Azure Databricks and Power BI.

Essential Criteria:

• Bachelor's degree or above in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, data modelling, data management, and data governance using Azure cloud services.
• Strong expertise in data architecture, ETL processes, and data modelling on Azure.
• Proficiency in programming languages such as Python and SQL with demonstratable experience in Azure Data
  Factory, Azure Databricks, and other Azure data services.
• Experience with DevOps practices, including CI/CD pipelines.
• Experience in ingesting data from on-premises RDBMS databases, APIs, and various formats like CSV, XLS and
  JSON.

Please email sean.hillier@randstaddigital.com.au for further information

At Randstad Digital, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.