
Senior Data Engineer
A.P. Moller - Maersk
full-time
Posted on:
Location Type: Hybrid
Location: Bengaluru • 🇮🇳 India
Visit company websiteJob Level
Senior
Tech Stack
AWSAzureCloudDistributed SystemsGoogle Cloud PlatformGrafanaKafkaKubernetesPrometheusSparkTerraform
About the role
- Design and build foundational platform components for data ingestion, transformation, metadata, and lineage
- Develop reusable, cloud-native infrastructure and tooling across AWS, Azure, and on-prem environments
- Work across streaming (Kafka, Flink) and batch (Spark, SQLMesh, dbt) systems to support diverse data processing needs
- Enable open table formats (Iceberg, Delta Lake, Hudi) as first-class citizens of the platform
- Contribute to platform observability (e.g., Prometheus, Grafana), lineage (OpenLineage), and data quality tooling (Great Expectations)
- Implement GitOps-driven CI/CD pipelines, Terraform modules, and containerized deployments
- Partner with AI/ML, metadata, and governance teams to drive consistency, automation, and platform-wide operability
Requirements
- Strong engineering background in data infrastructure, platform engineering, or distributed systems
- Deep hands-on experience with open-source data tooling and frameworks (Kafka, Spark, Flink, Iceberg, dbt, SQLMesh, etc.)
- Proficiency with cloud-native services on AWS, Azure, or GCP—especially around data storage, compute, and orchestration
- Infrastructure-as-code mindset (Terraform, GitHub Actions, GitOps) and familiarity with container ecosystems (Kubernetes preferred)
- Comfort working on modular, multi-tenant systems that enable self-service, observability, and scalability by design
- Clear thinking around data architecture principles like data mesh, decentralized ownership, and federated governance.
Benefits
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data ingestiondata transformationmetadata managementdata lineagecloud-native infrastructurestreaming systemsbatch processingopen table formatsCI/CD pipelinesinfrastructure-as-code
Soft skills
engineering backgroundclear thinkingcollaborationautomationconsistencyobservabilityscalabilitymodular designself-servicefederated governance