Lead Data Engineer – Databricks

AmeriLife

Lead Data Engineer at AmeriLife developing scalable data pipelines on Databricks. Collaborating with teams and establishing engineering standards.

Posted 4/14/2026full-timeRemote • Florida, Massachusetts, Missouri, Montana, Rhode Island • 🇺🇸 United StatesSenior💰 $150,000 - $175,000 per yearWebsite

Tech Stack

Tools & technologies

AWSAzureETLPySparkPythonSparkSQL

About the role

Key responsibilities & impact

Design and build scalable Databricks data pipelines
Develop ETL/ELT pipelines using PySpark
Implement data ingestion and transformation frameworks
Optimize Spark workloads for performance and scalability
Establish engineering standards and mentor engineers
Collaborate with architecture and analytics teams to enable data products

Requirements

What you’ll need

Strong expertise in Python and SQL
Deep experience with Databricks, PySpark, and Spark
Experience building large-scale data pipelines
Strong understanding of data transformation and distributed processing
Databricks certification (Bonus)
AWS or Azure certification (Bonus)

Benefits

Comp & perks

PTO
medical
dental
vision
retirement savings
disability insurance
life insurance

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonSQLDatabricksPySparkSparkETLELTdata ingestiondata transformationdistributed processing

Soft Skills

mentoringcollaborationengineering standards

Certifications

Databricks certificationAWS certificationAzure certification