Data Engineer

• Design and enforce Bronze / Silver / Gold architecture and layering principles
• Lead global data model harmonization (conformed dimensions, unified facts, SCD2)
• Drive migration from Teradata to BigQuery with parallel validation and cutover strategy
• Design end-to-end pipelines (ingestion → transformation → consumption) using Airflow
• Establish data governance framework: lineage, metadata, RBAC, auditability
• Implement data quality & observability with automated checks and pipeline gating
• Define CI/CD processes and schema evolution strategy (Flyway, Git-based workflows)
• Optimize performance and cost (partitioning, clustering, aggregation strategies)
• Align architecture with finance, tax, and compliance requirements

Data Architect – Part-time

• Design, build, and maintain streaming pipelines.
• Develop custom ingestion pipelines from third-party APIs, webhooks, and SDKs.
• Migrate existing data ingestion pipelines from SaaS tools to our own infrastructure.
• Deliver data to the raw layer of our Snowflake warehouse with schema consistency, idempotency, and resilience to malformed or late data.
• Evolve the existing AWS streaming stack (Kinesis, SQS, Lambda, API Gateway), improving cost efficiency, observability, and resilience.
• Maintain infrastructure as code (Terraform) for ingestion and processing resources.
• Monitor pipelines, troubleshoot, and resolve incidents.
• Contribute to our ongoing work on safe data access for AI agents and tooling.
• Continuously improve ingestion architecture, tooling, and engineering practices.

See all jobs on JobTailor

Data Architect – Part-time

Senior Data Engineer