AND Digital

Data Engineer, AWS

AND Digital

contract

Posted on:

Location Type: Hybrid

Location: Croydon • United Kingdom

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AWSETL

About the role

  • Build and enhance Glue-based data pipelines.
  • Implement quality layers and validation logic.
  • Work with the architect to deliver outputs in multiple ready-to-consume formats.
  • Contribute to the design and delivery of the overall channel strategy.
  • Support integration of pipeline outputs with backend/API layer.

Requirements

  • Deep experience with AWS Glue (jobs, crawlers, Glue Studio, Glue workflows).
  • Understanding complexities of CI/CD with Glue, avoiding AWS CodeCommit/Repo if needed.
  • Strong ETL background in AWS (Athena, S3, Lambda, Step Functions, etc.).
  • Experience implementing data-quality checks, validation steps, logging, lineage.
  • Understanding the differences between code-unit-testing and data-pipeline testing.
  • Familiar with traditional ETL operational patterns (e.g., DTS-style stage validation).
  • Strong grasp of modern data-engineering patterns (bronze/silver/gold).
  • Familiar with transforming data into multiple target formats (XML, graph structures, relational schemas).
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
AWS GlueETLAWS AthenaAWS S3AWS LambdaAWS Step Functionsdata-quality checksvalidation logicdata-pipeline testingdata transformation