Senior Lead Data Engineer

MSD

Lead Data Engineer for healthcare biopharma, architecting scalable data platforms and driving innovation through data insights. Collaborate across global teams and mentor engineering staff.

Posted 6/23/2026full-timeHyderabad • 🇮🇳 IndiaSeniorWebsite

Tech Stack

Tools & technologies

AirflowAmazon RedshiftApacheAWSCloudPythonSparkSQL

About the role

Key responsibilities & impact

Architect, build, and lead scalable data platforms
Lead the design and implementation of end-to-end data engineering solutions
Architect and optimize large-scale data pipelines using Spark, Python, and SQL
Design and manage orchestration frameworks using Apache Airflow
Build scalable and cost-efficient solutions on AWS ecosystem (S3, Glue, Redshift, Lambda)
Drive development and optimization of Databricks-based data platforms
Mentor and guide data engineering teams
Collaborate with cross-functional stakeholders to deliver business value
Implement and drive CI/CD practices, including GitHub Actions
Ensure data platform scalability, performance, and reliability
Develop and maintain dimensional models (Star/Snowflake schemas) for analytics and reporting
Build and optimize data Lakehouse architectures using Databricks & Delta Lake
Define data standards, naming conventions, and modeling best practices

Requirements

What you’ll need

Bachelor’s/Master’s degree in Computer Science or related discipline
Typically 9+ years of experience in data engineering (Lead role)
Strong expertise in SQL, Python, and Apache Spark
Extensive hands-on experience with Apache Airflow
Deep experience with AWS cloud services (S3, Glue, Redshift, Lambda)
Experience building solutions on Databricks platform
Experience in DBT
Proven experience in data architecture, modeling, and big data systems
Experience leading engineering teams and projects
Strong analytical, problem-solving, and communication skills

Benefits

Comp & perks

Flexible Work Arrangements: Hybrid
Professional Development Opportunities
Global Team Collaboration

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringdata architectureSQLPythonApache SparkApache AirflowAWSDatabricksDBTdata modeling

Soft Skills

leadershipmentoringcollaborationanalytical skillsproblem-solvingcommunication

Certifications

Bachelor’s degree in Computer ScienceMaster’s degree in Computer Science