
Data Engineer
SafetyCulture
full-time
Posted on:
Location Type: Hybrid
Location: Sydney • Australia
Visit company websiteExplore more
About the role
- Deliver big data datasets on time and with quality using the most out of our infrastructure.
- Support the design of new feature data tracking to match our patterns.
- Apply software engineering principles to our data pipeline, providing reusable and efficient code in Python, Scala and SQL.
- Support our infrastructure in AWS and Databricks using Terraform.
- Manage our data architecture via orchestration tools like Airflow.
- Manage and optimise data at scale with Data Lake (Delta), Data Warehouse (Redshift and Databricks), ML architecture and external tools (Fivetran and Segment)
- Work closely with the Software Engineers to design efficient data contracts, ensuring the requirements of data analysts, and support the analytics engineer team with sourcing very reliable datasets.
- Contribute to fostering an open, positive atmosphere within the team, promoting collaboration, learning, and growth.
Requirements
- Experience with data engineering architecture and cloud base solutions for big data.
- Python or Scala - Comfort of writing solutions for scalable pipelines in Apache Spark.
- Data Orchestration tools such as Apache Airflow.
- AWS Infrastructure Experience (Terraform, EMR, S3, Glue).
- Data warehouse experience (Redshift, Databricks or Snowflake).
- Curiosity and self-drive to continuously learn new techniques and tools to extract value from data.
- High level of comfort with ambiguity and ability to work in a fast-paced, agile environment in which you rapidly adapt and learn for any given business problem.
Benefits
- Equity with high growth potential, and a competitive salary
- Flexible working arrangements, we encourage you to create the best work blend while working from your home and the local SafetyCulture office
- Access to professional and personal training and development opportunities
- Hackathons, Workshops, Lunch & Learns
- We encourage involvement in the community, open source work, attending talks and events, and experimenting with new technologies
- In-house Culinary Crew serving up daily breakfast, lunch and snacks.
- Barista coffee machine, craft beer on tap, boutique wines and a range of non-alcoholic beverages.
- Wellbeing initiatives such as subsidized fitness programs, EAP services and generous parental leave policy.
- Quarterly celebrations and team events, including the annual Shiplt global offsite.
- On-site gym, table tennis, board games, books library, and pet-friendly offices.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonScalaSQLApache SparkData LakeData WarehouseMachine Learning architectureData OrchestrationTerraformBig Data
Soft skills
collaborationlearninggrowthcuriosityself-driveadaptabilitycomfort with ambiguityteamworkcommunicationproblem-solving