Core Data Engineer

Optima Partners

Data Engineer building scalable pipelines and architectures for Optima Partners, a UK data and business consultancy. Delivering client-facing solutions across consumer brands and commercial sectors.

Posted 9/3/2026full-time🇬🇧 United KingdomJuniorMid-LevelWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing scalable data pipelines, optimizing data architectures, and maintaining ETL/ELT workflows. Proficient in utilizing big data tools and cloud ecosystems to deliver effective data solutions while collaborating with cross-functional teams.

Highest-signal resume keywords

Python ProficiencyBig Data Tools ExperienceData Warehousing ExpertiseCloud Ecosystem FamiliarityStrong Problem-Solving Skills

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Pipeline DesignETL/ELT WorkflowsData Architecture OptimizationSchema DesignRelational DatabasesData Integration ToolsBig Data TechnologiesCloud Data EngineeringData Warehousing SolutionsAutomation Opportunities Identification

Soft Skills

Excellent Communication SkillsTeam-Oriented MindsetAnalytical ThinkingCollaborationAdaptability

Tools & Technologies

DatabricksApache SparkHadoopAWSAzureGCPAirflowApache NiFiTalendGit

Industry Keywords

Data EngineeringAgile MethodologiesScrumClient-Facing SolutionsTechnical Documentation

Tech Stack

Tools & technologies

AirflowAmazon RedshiftApacheAWSAzureBigQueryCloudDockerETLGoogle Cloud PlatformHadoopJavaPostgresPythonScalaSparkSQL

About the role

Key responsibilities & impact

Design and implement robust, scalable, and efficient data pipelines
Collect, transform, and integrate data from various sources
Develop and optimise data architectures, including data warehouses, data lakes, and other storage solutions
Create and maintain reliable ETL/ELT workflows
Work closely with data scientists, analysts, and client stakeholders to understand requirements and deliver solutions
Monitor and enhance data-system performance to minimise downtime and improve query response times
Identify automation opportunities and recommend tools to improve data-engineering workflows
Maintain detailed technical documentation for solutions and processes
Collaborate within dynamic, multi-disciplinary project teams across diverse commercial sectors

Requirements

What you’ll need

Proficiency in Python, Java, Scala, or similar languages
Hands-on experience with big data tools such as Databricks, Apache Spark, and Hadoop
Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks
Expertise in relational databases such as Postgres and SQL Server
Knowledge of data integration tools such as Airflow, Apache NiFi, or Talend
Experience with data warehousing tools such as Snowflake, Redshift, and BigQuery
Experience with schema design
Familiarity with Git, Docker, and CI/CD pipelines
2+ years of experience in data engineering or a similar role
Proven track record of delivering data solutions in a consulting or client-facing environment is a plus
Experience with Agile or Scrum methodologies is beneficial
Strong problem-solving and analytical thinking abilities
Excellent communication skills to explain complex technical concepts to non-technical stakeholders
Team-oriented mindset with collaboration and adaptability

Benefits

Comp & perks

Inclusive space for professional development
Continuous learning and knowledge sharing
Clear path to career development and promotion
Opportunities to learn and grow in different engineering disciplines
Collaborative, engaged, and creative work environment