Megaport

DataOps Engineer

Megaport

full-time

Posted on:

Location Type: Hybrid

Location: Brisbane • Australia

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AWSAzureETLGoogle Cloud PlatformPySparkPythonSQLUnityVault

About the role

  • Designing, implementing and managing data pipelines.
  • Work closely with the Data Office, both from a design perspective as well as hands-on technical development.
  • Assist in building a team culture of good architecture and design, understand best practices throughout the team, focus on operational excellence, security, reliability and performance and help us optimise our costs in relation to all things Data Warehousing.
  • Focus on the day-to-day operations of the Megaport data warehouse environment.
  • Support the BI reporting and analytics functions of Megaport.

Requirements

  • Very strong SQL skills with extensive experience in ETL/ELT and Data modelling.
  • Strong experience working in DataOps in a large data warehouse environment and experience in automating data warehouse processes.
  • Sound knowledge and experience in CI/CD while maintaining a data pipeline.
  • Software Development and scripting experience (preferably with Python(PySpark), or similar).
  • Automated data quality checks, error handling processes and alerts.
  • Data Lake & EDW methodologies; Data analysis, data modelling, data integration, data warehousing and database design(data vault); Azure Stack.
  • Instincts for identifying, documenting and mitigating risks.
  • Excellent documentation skills and communication skills.
  • Passionate about data, showing a commitment to keeping on top of current industry trends, new and emerging technologies, and the ability to think outside the box.
  • Experience troubleshooting and deploying Azure resources (or other major clouds like AWS/GCP) using Infrastructure as Code (IaC), scripting languages, and Azure DevOps for automated configuration.
  • Proven track record managing complex data ecosystems, including Databricks (Unity Catalog), dbt, and Git, alongside seamless integration of D365, APIs, and Fivetran within the Azure environment.
Benefits
  • 25 days annual leave
  • Private healthcare
  • Pension scheme
  • Flexible working hours
  • Professional development opportunities
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
SQLETLELTData modellingDataOpsCI/CDPythonData LakeData WarehousingDatabase design
Soft Skills
Documentation skillsCommunication skillsRisk managementTeam cultureOperational excellenceProblem-solvingAdaptabilityAttention to detailCreativityPassion for data