EXL

Lead Data Engineer

EXL

full-time

Posted on:

Location Type: Hybrid

Location: Gurugram • India

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

Amazon RedshiftApacheAWSCloudDistributed SystemsDockerETLKafkaKubernetesMicroservicesPySparkPythonPyTorchSparkTensorflow

About the role

  • Design scalable data solutions and build robust pipelines.
  • Integrate machine learning models into data workflows.
  • Collaborate with cross-functional teams to optimize data processes and workflows.
  • Lead technical discussions on data engineering best practices and frameworks.

Requirements

  • 8+ years of hands-on experience in data engineering with a focus on ETL workflows, data pipelines, and cloud computing.
  • Proven expertise or certification in Palantir Foundry is highly preferred.
  • Strong experience with AWS services for data processing and storage (e.g., S3, Glue, Athena, Lambda, Redshift).
  • Proficiency in programming languages such as Python, PySpark
  • Deep understanding of microservices architecture and distributed systems.
  • Familiarity with AI/ML tools and frameworks (e.g., TensorFlow, PyTorch) and their integration into data pipelines.
  • Experience with big data technologies like Apache Spark, Kafka, and Snowflake.
  • Strong problem-solving and performance optimization skills.
  • Exposure to modern DevOps practices, including CI/CD pipelines and container orchestration tools like Docker and Kubernetes.
  • Experience working in agile environments delivering complex data engineering solutions.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data engineeringETL workflowsdata pipelinescloud computingPythonPySparkmicroservices architecturedistributed systemsbig data technologiesDevOps practices
Soft Skills
problem-solvingperformance optimizationcollaborationleadership