We are seeking an experienced Data Engineer to support a Data & Analytics (D&A) team during a period of increased demand. This role will help ensure delivery of key data engineering roadmap activities following the resignation of an internal Data Engineer.

The successful candidate will play a critical role in maintaining momentum on priority data initiatives, improving data platform performance, and providing operational support.

Scope of Work

Engage as an external Data Engineer resource to reduce the impact on planned D&A team deliverables. Key activities include:

• Upgrade Databricks clusters from version 9.1 to 14.3(compliance requirement)

• Enhance Databricks data processing to improve performance and reduce costs, including:

  • Implementing Autoloader

  • Transitioning from all-purpose clusters to job clusters

  • Implementing workflows

• Support progression of additional Data Engineering priorities (time permitting), including:

  • Completing planned data ingestions into the Enterprise Data Warehouse (EDW) (minimum of 2, simple to medium complexity)

  • Supporting on-premises production EDW decommissioning

  • Providing project support related to data ingestions

  • Providing Data Engineering BAU support as required

  • Assisting with Microsoft Fabric trial learnings, where needed

Key Responsibilities

• Design, develop, and support data pipelines and ingestion processes into the EDW

• Provide ITIL Level 2 operational support for EDW and ingestion processes

• Ensure data quality, integrity, security, and accessibility

• Develop and maintain data models and data warehouse solutions

• Collaborate with stakeholders to understand requirements and deliver solutions aligned to business priorities

• Contribute to continuous improvement of data and analytics platforms

• Support agile delivery and promote a digital-first culture

Skills & Experience

• 3–6 years’ experience in a Data Engineer role

• Strong experience with Databricks, ETL development, and data integration

• Hands-on experience in cloud and on-premise environments (Azure preferred)

• Experience with data modelling and enterprise data warehouse concepts

• Proficiency in data programming, ETL, and scripting tools

• Strong communication skills and ability to work with technical and non-technical stakeholders

Qualifications

• Tertiary qualification in Information Technology, Business, or a related discipline (or equivalent experience)

To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Nayana Lahoti on 07 3339 5616 or email: nlahoti@paxus.com.au and quote the above job reference number.

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.