EXL

GCP Data Engineer

EXL

contract

Posted on:

Location Type: Hybrid

Location: Edinburgh • United Kingdom

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

SeniorLead

Tech Stack

AirflowApacheBigQueryCloudETLGoogle Cloud PlatformPythonTerraform

About the role

  • Lead the design, development, and deployment of data pipelines on GCP.
  • Drive migration of legacy data platforms and use cases to GCP, ensuring minimal disruption and optimal performance.
  • Build and manage data transformation workflows using DBT.
  • Orchestrate pipelines using Cloud Composer (Apache Airflow).
  • Develop robust, reusable code in Python for data processing and automation.
  • Implement Infrastructure as Code (IaC) using Terraform for scalable and repeatable deployments.
  • Collaborate with business and technology stakeholders to understand requirements and translate them into technical solutions.
  • Ensure data quality, governance, and best practices across all implementations.
  • Provide technical leadership, mentor team members, and guide design decisions.

Requirements

  • 10+ years of experience
  • Strong hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, etc.)
  • Proven experience in DBT for data transformation
  • Expertise in Cloud Composer / Apache Airflow for workflow orchestration
  • Advanced proficiency in Python
  • Solid experience with Terraform for infrastructure provisioning
  • Demonstrated experience in migrating legacy systems (on-prem or other cloud) to GCP
  • Strong understanding of data warehousing concepts and ETL/ELT frameworks
  • Experience in leading teams and managing end-to-end delivery
  • Preferred Qualifications: Experience in large-scale data transformation programs
  • Familiarity with CI/CD pipelines and DevOps practices
  • Exposure to data governance and regulatory environments (e.g., banking/financial services).
Benefits
  • Flexible hybrid working
  • Umbrella Contract (Inside IR35) to start ASAP
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data pipelinesGCPDBTCloud ComposerApache AirflowPythonInfrastructure as CodeTerraformdata transformationETL/ELT frameworks
Soft Skills
technical leadershipmentoringcollaborationcommunicationproblem-solvingstakeholder managementteam managementdesign decision guidance