Lead Data Engineer

EXL

Lead Data Engineer responsible for designing and maintaining scalable data platforms using AWS and Python. Collaborating with teams on data pipelines and automation.

Posted 6/11/2026full-timePune • 🇮🇳 IndiaSeniorWebsite

Tech Stack

Tools & technologies

AirflowAWSCloudDistributed SystemsHadoopPySparkPythonSparkSQL

About the role

Key responsibilities & impact

Design, build, and maintain scalable data platforms and services
Implement data pipeline solutions in Python and cloud platforms like AWS
Optimize data delivery and reduce cloud costs through automation
Monitor Data Quality, Observability, Governance, and Lineage
Collaborate with internal teams and client stakeholders
Write unit/integration tests and document design/implementation

Requirements

What you’ll need

Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field
8+ years of experience in data engineering or related domain
Strong hands-on experience with PySpark, Python, SQL, Databricks, and AWS Cloud
Experience with distributed systems such as Hadoop, Spark, Hive, DBT, and Airflow
Familiarity with Agile methodology, test-driven development, source control management, and test automation
Excellent collaborative problem-solving and communication skills
Experience supporting cross-functional teams in a dynamic environment

Benefits

Comp & perks

Health Insurance
Flexible Work Arrangements
Professional Development

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonPySparkSQLDatabricksAWS CloudHadoopSparkHiveDBTAirflow

Soft Skills

collaborative problem-solvingcommunication

Certifications

Bachelor's degree in Computer ScienceBachelor's degree in Data ScienceBachelor's degree in Information Technology