Collaborate with marketing, product, and engineering teams to build data pipelines, infrastructure and tooling to support business initiatives
Oversee the design and maintenance of data pipelines and contribute to the continual enhancement of the data engineering architecture
Collaborate with the team to meet performance, scalability, and reliability goals
Write out tests and thorough documentation for processes and tooling
Adapt to working with new technologies and frameworks, sometimes headlining the investigation into their usefulness to the team
Maintain and expand existing systems, tooling and infrastructure
Develop and maintain streaming pipelines that ingest near-real time data for teams across the enterprise
Take ownership of projects, plan and collaborate with other members of the engineering teams or others within the company
Provide on-call support for workloads critical to the organization
Other duties as required

Requirements

A solid foundation in computer science, with strong competencies in data structures, distributed systems, algorithms and software design
5+ years of experience in data or software engineering
Strong knowledge of Python
Strong knowledge of relational databases and SQL
Strong knowledge of streaming technologies, such as Kafka, Spark, Flink and Beam
Experience with Docker and Kubernetes
Experience building out a scalable infrastructure to fit the needs of a growing company
Experience with Google Cloud Platform
Experience with testing frameworks such as Pytest
Strong organization and collaboration skills
Excellent written and oral communication skills

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonSQLdata structuresdistributed systemsalgorithmssoftware designstreaming technologiesKafkaSparkFlink

Soft Skills

organizationcollaborationwritten communicationoral communication