Grow Talent

Senior Platform Data Engineer – Azure Databricks

Grow Talent

contract

Posted on:

Location Type: Hybrid

Location: Melbourne • 🇦🇺 Australia

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzureCloudETLPythonSparkSQLTerraform

About the role

  • **What you’ll do**
  • - Design and implement a modern Azure lakehouse platform using Synapse, Databricks, Data Lake Storage Gen2, Delta Lake, and Data Factory
  • - Lead migrations from legacy on-premise data systems to Azure with a focus on integrity, reliability, and minimal disruption
  • - Build and maintain scalable ETL and ELT pipelines with Spark, Python, and SQL, integrated into CI and CD workflows
  • - Provision cloud resources using Terraform, Bicep, or ARM, and automate deployments via Azure DevOps or GitHub Actions
  • - Monitor and optimise performance, storage, and compute, implementing diagnostics, logging, and alerting with Azure Monitor and Log Analytics
  • - Partner with squads and stakeholders in Melbourne, Sydney, Brisbane, and Canberra, providing documentation and support for platform components

Requirements

  • **Experience**
  • - Hands-on with Azure data services such as Databricks, Synapse, Data Lake, and Data Factory
  • - Strong Spark, Python, and SQL, including modular, reusable pipeline design
  • - Proven delivery of cloud data platforms and migration of on-premise assets to Azure
  • - CI and CD using Azure DevOps or GitHub Actions
  • - Infrastructure as Code with Terraform, Bicep, or ARM
  • - Strength in performance tuning, troubleshooting, observability, and cost optimisation
Benefits
  • **Benefits**
  • - Hybrid work and flexible hours to support work life balance
  • - Structured career pathways, mentoring, and communities of practice
  • - Certification support across leading cloud platforms including Microsoft Azure
  • - Employee assistance and well-being programs
  • - Modern hardware, tooling, and access to large scale enterprise projects**

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
AzureDatabricksSynapseData Lake Storage Gen2Delta LakeData FactorySparkPythonSQLTerraform
Soft skills
leadershipcommunicationcollaborationdocumentationsupport