Lead Data Engineer

Your new company

Join a key Australian Government department supporting Australia's agriculture sectors. You will work within its Enterprise Analytics and Technology Services team, helping deliver modern cloud-based data solutions that enable informed decision-making across the department.

Your new role

As Lead Data Engineer, you will design, build, test and maintain data movement, transformation and visualisation solutions across Azure and Databricks environments. You will create automated ingestion and transformation frameworks, prepare data for operational analytics and AI use cases, and provide technical leadership and quality oversight to data engineers working in Agile delivery teams.

• Develop and maintain scalable ETL and ELT pipelines for complex data environments.
• Design cloud-based data solutions using Azure Data Factory, Databricks, SQL Server and Data Lake Storage.
• Optimise data for distributed query and analytics engines, including Spark and Azure SQL.
• Support the delivery of high-quality data products through technical guidance, reviews and constructive feedback.
• Work with multidisciplinary teams to deliver solutions aligned with departmental priorities.

What you'll need to succeed

• Recent demonstrated experience as a Data Engineer, across the federal government landscape, supported by relevant qualifications or training.
• Strong experience developing ETL and ELT processes for large or complex data movement and transformation, ideally in cloud environments.
• Hands-on capability across Azure Data Factory, Databricks, SQL Server, Data Lake Storage and related analytics services.
• Experience preparing data for query performance, advanced analytics and AI use cases using formats such as Parquet or Delta.
• Strong leadership, stakeholder engagement, negotiation and written and verbal communication skills.
• The ability to take ownership, work productively and collaborate within an Agile, multidisciplinary environment.
• A current NV1 security clearance, or the willingness and eligibility to obtain one, with commencement subject to obtaining Baseline clearance.

What you'll get in return

This is an excellent opportunity to lead meaningful data engineering work within a high-profile Federal Government environment. The role is based in Canberra and offers an initial up to 12-month contract, with two possible up to 12-month extensions, providing long-term project potential and exposure to modern Azure, Databricks, lakehouse and analytics technologies.

What you need to do now

If you're interested in this role, please forward me an up-to-date copy of your CV, Ginger.Taylor@hays.com.au , or call us now.

If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.

Desired Skills and Experience

Lead the design and delivery of modern cloud data solutions using Azure, Databricks and ETL/ELT technologies!