Staff Data Platform Engineer
Shippit
full-time
Posted on:
Location Type: Hybrid
Location: Sydney • Australia
Visit company websiteExplore more
Job Level
About the role
- Work with our Engineering, Product and Data & Analytics teams to drive opportunities that continue to scale and fine-tune how we build and operationalise our products.
- Engineer and build effective, efficient, and sustainable infrastructure, including data pipelines, within cloud-based technologies.
- Identify and solve big data, throughput, streaming, and batch processing challenges.
- Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, and redesigning infrastructure for greater scalability.
- Work collaboratively with squads and other teams to architect, develop and implement continuous improvements, whether that be with our technology, product or processes.
- Design and implement patterns for data flow across the business.
- Ensure data security and risk management across Shippit.
- Bring software engineering expertise combined with a data perspective to make holistic and informed decisions that will best serve the product, team and Shippit.
- Lead and mentor junior data engineers, providing guidance on best practices and technical challenges.
Requirements
- Several years of experience in a senior data engineering or technically oriented data role.
- Experience in developing, deploying, and operating scalable data pipelines.
- Proficient in working with large-scale data sets using a range of cloud-based technologies, such as AWS, Snowflake, and dbt.
- Broad understanding of the data engineering lifecycle from ETL/ELT, pipeline build, and data visualisation.
- Familiarity with NoSQL-based technologies, such as DynamoDB.
- Knowledge of Kafka and Kubernetes with a strong approach to Data Engineering.
- Hands-on experience with Infrastructure as Code, with languages such as Terraform; and other coding languages such as Python.
- Excellent collaboration and communication skills to work effectively within a cross-functional team.
Benefits
- Flexible hybrid - ability to mix your working week between The Shippit office and your home office
- Employee Share Option Plan
- Generous parental leave policy and pet friendly office
- Wellbeing Policy with strong focus on whatever makes you feel good from inside out
- Unlocking your potential with a blend of in person and online learning and development opportunities
- Casual Friday everyday
- Team outings, weekly lunches, team events, loaded pantry and the list goes on…
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringdata pipelinesETLELTdata visualisationInfrastructure as CodePythonTerraformNoSQLKafka
Soft skills
collaborationcommunicationmentoringproblem-solvingprocess improvementleadershipteamworkguidancetechnical expertiseholistic decision-making