FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowApacheETLKafkaKubernetesPySparkPythonSparkSQLTerraform
About the role
Key responsibilities & impact- Build and maintain high-throughput ETL/ELT pipelines
- Drive the adoption of dbt for transformation and PySpark
- Implement "Data SLAs" and build monitoring systems
- Work closely with the BI team and Data Scientists
- Deep-dive into SQL and Spark query plans for optimization
- Implement a local development workflow with DuckDB
- Build specialized pipelines for client reporting
- Explore use of DuckDB for internal tools or edge processing
Requirements
What you’ll need- 5+ Years in Data Engineering
- Expert-level proficiency in Python, SQL, and PySpark
- Hands-on experience with Databricks (Delta Lake) or Snowflake
- Advanced experience with dbt (Data Build Tool)
- Experience with Apache Airflow or Prefect
- Familiarity with Kafka, Kinesis, or Spark Streaming
- Comfort with Terraform or CloudFormation
- Proven experience using DuckDB
- Deep understanding of Kubernetes (K8s)
Benefits
Comp & perks- comprehensive benefits packages
- competitive industry salaries