Elasticsearch Data Engineer – Medallion Architecture

Capgemini

Data Engineer responsible for architecting and maintaining scalable data pipelines in a medallion architecture. Join a leading insurer transforming data engineering processes.

Posted 5/27/2026full-timeRemote • 🇮🇳 IndiaMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

ApacheAWSCloudElasticSearchJavaJenkinsKubernetesLogstashPythonSparkSpringSpring BootSpringBootVault

About the role

Key responsibilities & impact

Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.
Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.

Requirements

What you’ll need

At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge)
Java Spring Boot
IBM ACE Programming
BS in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling or similar
Full English Fluency
Strong understanding of data modeling, governance, and best practices in modern data architectures.
Excellent analytical, problem-solving, and communication skills.
Deep experience with Spark, Python and ETLs and Amazon EMR
Hands-on experience with DBT for data transformation and modeling.
Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management.
Experience with Kubernetes for container orchestration.
Experience with Dremio, Looker, or equivalent business view/semantic layer technologies
AWS Cloud – Intermediate, AWS Lambda, Step Functions, IAM, SNS, API Gateway, VPC, Transit Gateway, Intermediate
JSON - Intermediate
Jenkins – Data Pipeline Intermediate
CloudWatch - Intermediate

Benefits

Comp & perks

Competitive salary and performance-based bonuses
Comprehensive benefits package
Career development and training opportunities
Flexible work arrangements (remote and/or office-based)
Dynamic and inclusive work culture within a globally renowned group
Private Health Insurance
Pension Plan
Paid Time Off
Training & Development

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data pipelinesSparkAmazon EMRDBTJava Spring BootIBM ACE Programmingdata modelingETLPythonKubernetes

Soft Skills

analytical skillsproblem-solving skillscommunication skills

Certifications

AWS certification