Lead Data Engineer, Sr. Specialist

MSD

Lead Data Engineer architecting scalable data platforms and driving innovation for a global healthcare biopharma company. Working with a diverse portfolio of prescription medicines, vaccines, and animal health products.

Posted 6/23/2026full-timeHyderabad • 🇮🇳 IndiaSeniorWebsite

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

data engineeringSQLPythonApache SparkApache AirflowAWSDatabricksdata architecturedata modelingbig data systems

Soft Skills

leadershipcollaborationcommunication

Tools & Technologies

AWS S3AWS GlueAWS RedshiftAWS LambdaGitHub Actions

Industry Keywords

data pipelinesorchestration frameworksCI/CD practicesscalable solutionscost-efficient solutions

Tech Stack

Tools & technologies

AirflowAmazon RedshiftApacheAWSCloudPythonSparkSQL

About the role

Key responsibilities & impact

Lead the design and implementation of end-to-end data engineering solutions
Architect and optimize large-scale data pipelines using Spark, Python, and SQL
Design and manage orchestration frameworks using Apache Airflow
Build scalable and cost-efficient solutions on AWS ecosystem (S3, Glue, Redshift, Lambda)
Drive development and optimization of Databricks-based data platforms
Collaborate with cross-functional stakeholders to deliver business value
Implement and drive CI/CD practices, including GitHub Actions

Requirements

What you’ll need

Typically 9+ years of experience in data engineering (Lead role)
Strong expertise in SQL, Python, and Apache Spark
Extensive hands-on experience with Apache Airflow
Deep experience with AWS cloud services (S3, Glue, Redshift, Lambda)
Strong experience building solutions on Databricks platform
Proven experience in data architecture, modeling, and big data systems

Benefits

Comp & perks

Flexible Work Arrangements
Professional development opportunities