DOOR3

Senior Data Engineer, AWS Lakehouse

DOOR3

contract

Posted on:

Location Type: Remote

Location: Netherlands

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

ApacheAWSCloudPythonSQL

About the role

  • Build and maintain a medallion architecture (landing/integrated/reporting) on S3 using Apache Iceberg
  • Develop and operate data pipelines using dbt-core running against Athena
  • Implement ingestion patterns using AWS AppFlow, DMS, and custom Lambda functions
  • Design incremental load and merge logic for CDC data streams
  • Optimize query performance for BI consumption (partitioning, aggregation, file compaction)
  • Build orchestration workflows using Step Functions
  • Establish data quality testing, monitoring, and alerting
  • Support PowerBI integration and troubleshoot refresh issues
  • Document data models and maintain lineage

Requirements

  • 5+ years working with cloud data platforms (AWS strongly preferred)
  • Production experience with dbt (dbt-core or dbt Cloud)
  • Strong SQL skills including window functions, CTEs, and incremental/merge patterns
  • Hands-on experience with at least one modern table format (Iceberg, Delta, or Hudi)
  • Familiarity with Athena, Glue, or similar serverless query engines
  • Experience with CDC pipelines and handling SaaS data sources
  • Working knowledge of Python for custom ingestion and tooling
  • Understanding of BI tool requirements and how to optimize serving layers for reporting
  • Upper-Intermediate/B2 English across all four skills
Benefits
  • Opportunity to work remotely
  • Overlap with EST working hours

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
medallion architecturedata pipelinesdbt-coreAWS AppFlowDMSLambda functionsSQLPythonCDC data streamsquery performance optimization
Soft skills
communicationdocumentationproblem-solvingmonitoringalerting