Data Engineer

CMSPI

Data Engineer building secure ingestion, analytics workflows, and client-data solutions for CMSPI’s payments intelligence platform. Working with Azure, Databricks, Spark, and Python in a Manchester hybrid squad.

Posted 9/10/2026full-timeManchester • 🇬🇧 United KingdomJuniorMid-LevelWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing scalable data architectures and retrieval solutions, with a strong focus on security and performance. Proficient in building ETL/ELT workflows and utilizing advanced tools such as Databricks and Microsoft Azure for data engineering.

Highest-signal resume keywords

Data EngineeringETL/ELT WorkflowsMicrosoft AzureDatabricksAdvanced Python

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data ArchitectureETLELTSparkHadoopPythonFunctional ProgrammingObject-Oriented ProgrammingData PipelinesAutomated Testing

Soft Skills

Problem-SolvingAnalytical SkillsCommunicationCross-Functional Collaboration

Tools & Technologies

Azure Data FactoryAzure Data LakeDatabricks AI GatewayTerraformDockerKubernetes

Industry Keywords

AgileContinuous IntegrationData SolutionsPaymentsCloud Deployment

Tech Stack

Tools & technologies

AzureCloudDockerETLHadoopKubernetesPythonScalaSeleniumSparkTerraformUnityVault

About the role

Key responsibilities & impact

Design scalable data architectures and retrieval solutions across APIs, web scrapers and SFTP, with security and performance at the centre.
Deliver prompt, efficient onboarding of CMSPI client data and contribute to new data features that create continuous business value.
Collaborate with engineers, agile delivery leads and business stakeholders to define, refine and deliver requirements in an agile squad.
Maintain high software quality through clean code, collaborative code and architecture reviews, automated testing and continuous integration.
Respond to stakeholder issues and queries, troubleshoot production problems and drive practical improvements to data solutions.
Help shape CMSPI’s next generation data platform using Databricks AI Gateway, enabling governed, agent-powered capabilities that support self-building and self-healing data pipelines.
Participate in sprint planning and daily stand-ups, keeping stories and tasks current and raising critical blockers early.
Learn, adopt and promote best practices in data engineering, including reusable Python libraries and maintainable functional and object-oriented code.
Stay aware of emerging technology trends and research ideas that can improve CMSPI’s data platforms and engineering practices.
Work collaboratively as part of an Agile development squad and contribute to a culture of continuous learning and delivery.

Requirements

What you’ll need

2+ years’ professional experience as a Data Engineer or DevOps Engineer.
Experience building ETL/ELT workflows for analytics using Spark or Hadoop.
Strong Microsoft Azure experience across DevOps/CI/CD, Azure Data Factory, Azure Data Lake, Azure Functions, Key Vault, monitoring, networking, identity, and cloud deployment services.
Databricks experience, including workflows/jobs, notebooks, Delta Lake, Unity Catalog and other Databricks-native tools.
Advanced Python skills, including efficient functional and object-oriented code, reusable Python libraries, and practical experience with packages such as requests, Selenium, and Playwright.
Strong problem-solving, analytical, communication and cross-functional collaboration skills.
Bachelor’s degree in Computer Science, Mathematics or another analytical/numerical subject.
Highly desirable: experience with Agile squads, payments, Terraform/Bicep, Docker/Kubernetes, Scala, PowerShell or YAML.

Benefits

Comp & perks

Competitive annual company bonus linked to company and individual performance.
Future opportunity for equity (shadow stock) awarded to high performers.
Competitive pension plan from day 1 plus Vitality healthcare cover & cycle to work (after 6-months)
Monthly reimbursement for commuting costs.
22 days' annual leave, increasing with service, plus UK bank holidays.
Wellbeing support, including an Employee Assistance Programme and mental health resources.
Learn from payments industry experts and accelerate your career through ongoing training and development.
Personal and professional growth opportunities, with personalised development plans tailored to your ambitions.
Quarterly employee recognition awards including a financial prize.
Regular officewide and team-based socials.