Lead Data Engineer – Databricks
AmeriLife
full-time
Posted on:
Location Type: Remote
Location: Florida • Massachusetts • United States
Visit company websiteExplore more
Salary
💰 $150,000 - $175,000 per year
Job Level
About the role
- Design and build scalable Databricks data pipelines
- Develop ETL/ELT pipelines using PySpark
- Implement data ingestion and transformation frameworks
- Optimize Spark workloads for performance and scalability
- Establish engineering standards and mentor engineers
- Collaborate with architecture and analytics teams to enable data products
Requirements
- Strong expertise in Python and SQL
- Deep experience with Databricks, PySpark, and Spark
- Experience building large-scale data pipelines
- Strong understanding of data transformation and distributed processing
- Databricks certification (Bonus)
- AWS or Azure certification (Bonus)
Benefits
- PTO
- medical
- dental
- vision
- retirement savings
- disability insurance
- life insurance
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonSQLDatabricksPySparkSparkETLELTdata ingestiondata transformationdistributed processing
Soft Skills
mentoringcollaborationengineering standards
Certifications
Databricks certificationAWS certificationAzure certification