Walmart

Senior Manager, Data Engineering

Walmart

full-time

Posted on:

Location Type: Office

Location: Chennai • India

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAzureBigQueryCloudDistributed SystemsGoogle Cloud PlatformKafkaSparkSQL

About the role

  • Lead and grow a high-performing team of 8-10 data engineers building and operating the People Data Lake
  • Own the architecture, design, and delivery of scalable batch and future streaming data pipelines using Spark, Big Query, Airflow, and related cloud-native technologies.
  • Drive best practices across data modeling, pipeline reliability, observability, and cost optimization to ensure high performance and availability.
  • Define and implement the data security framework for the lake, including encryption (at rest and in transit), masking and fine-grained access controls.
  • Establish secure data sharing and governance mechanisms to protect sensitive data and ensure regulatory and enterprise compliance.
  • Partner with Product, HR, Analytics, Security, and Architecture teams to define roadmap, prioritize initiatives, and deliver scalable, resilient, and secure data solutions.
  • Build a strong engineering culture focused on operational excellence, technical rigor, and continuous improvement while shaping the mid- to long-term platform vision.
  • Establish best engineering and operational excellence practices based on product, engineering, and scrum metrics.
  • Work with senior leadership to chart out the future roadmap of the products
  • Participate in hiring, mentoring, and building high performing agile teams.
  • Establishing clear expectations with individuals based on their level and role, meeting regularly to discuss performance, provide feedback and coaching

Requirements

  • 12+ years of experience in software or data engineering with 3+ years leading high-performing engineering teams.
  • Strong hands-on expertise in Spark, BigQuery, Airflow (or equivalent), and distributed data systems on GCP.
  • Experience with big data and distributed systems like Spark, Flink, etc.
  • Proven experience designing, building, and operating large-scale data lakes or lakehouse platforms with batch and streaming ingestion.
  • Deep understanding of data security principles including encryption, PII protection, masking, IAM, and row/column-level security.
  • Strong SQL and data modeling skills with experience implementing CI/CD, monitoring, and reliability best practices for data platforms.
  • Ability to operate at both strategic and execution levels, influence cross-functional stakeholders, and translate platform vision into secure, scalable business outcomes.
  • Knowledge in Pub sub system like Kafka.
  • Knowledge of cloud platforms like Azure, GCP etc.
  • Lead the integration of AI/ML toolkits and frameworks into day-to-day (D2D) data engineering workflows, enabling teams to accelerate development, automate data processes, and enhance decision-making capabilities.
Benefits
  • incentive awards for your performance
  • maternity and parental leave
  • PTO
  • health benefits
  • best-in-class benefits
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
SparkBigQueryAirflowSQLdata modelingCI/CDdata securityencryptionPII protectiondistributed data systems
Soft Skills
leadershipmentoringcoachingstrategic thinkinginfluencingcommunicationoperational excellencecontinuous improvementteam buildingperformance management