AWS Data Engineer

UBDS

AWS Data Engineer responsible for designing and maintaining scalable data pipelines using AWS services and collaborating with cross-functional teams for robust infrastructure.

Posted 6/3/2026full-timeLondon • 🇬🇧 United KingdomMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

AirflowAmazon RedshiftApacheAWSDockerPythonSQLTerraform

About the role

Key responsibilities & impact

Develop and maintain data pipelines using Python, SQL, and Apache Airflow.
Containerise data applications and workflows using Docker.
Build and optimise data solutions using AWS services including:
Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
Collaborate with cross-functional teams to deliver robust, secure, and scalable data infrastructure.
Manage version control using GitLab (or similar).
Monitor and troubleshoot data pipeline performance and reliability.
Contribute to documentation and process improvement initiatives.
Ensure data quality, governance, and security best practices are followed.

Requirements

What you’ll need

Strong programming skills in Python and proficiency in SQL.
Experience with Apache Airflow for DAG orchestration and monitoring.
Hands-on experience with Docker for containerisation.
Proficient in AWS data services:
Redshift, OpenSearch, Lambda, Glue, Step Functions, Batch.
Familiarity with CI/CD pipelines and YAML-based configuration (e.g., GitLab CI/CD).
Proficient in Git and collaborative development using GitLab (or similar).
Understanding of AWS security best practices, IAM policies, and RBAC.
Desirable Skills:
Experience with AWS services such as Athena, SQS, CloudWatch, CloudTrail, EMR.
Exposure to infrastructure-as-code tools (e.g., Terraform, CloudFormation).
Familiarity with documentation tools like Confluence and README standards.
Experience working in consulting or client-facing environments.
Strong problem-solving and troubleshooting abilities.
Comfortable working in Agile environments.
Effective stakeholder management and communication skills.
Collaborative mindset and willingness to share knowledge.

Benefits

Comp & perks

Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
Private medical cover for you and your spouse/partner, offered via Vitality
Discretionary bonus based on a blend of personal and company performance
Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
Electric Vehicle leasing with salary sacrifice
Contributed Pension Scheme
Death in service cover

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonSQLApache AirflowDockerAWS RedshiftAWS OpenSearchAWS LambdaAWS GlueAWS Step FunctionsAWS Batch

Soft Skills

problem-solvingtroubleshootingstakeholder managementcommunicationcollaborationprocess improvementdata governancedata qualityAgile mindsetcross-functional teamwork