Salary
💰 $130,000 - $150,000 per year
Tech Stack
AirflowApacheAWSAzureCloudGoogle Cloud PlatformPythonScalaSpark
About the role
- Build the next-gen data infrastructure for Zinnia using Lakehouse frameworks, Apache Airflow, Apache Spark, and Hive
- Design, build, and optimize data workflows across real-time, nearline, and offline data ecosystems
- Leverage Lakehouse platforms (Delta Lake, Hudi, Iceberg) to enable unified batch and streaming pipelines
- Collaborate with stakeholders and cross-functional teams to translate business requirements into scalable technical solutions
- Provide technical expertise in troubleshooting and resolving complex, distributed data-related issues
- Recommend best practices for data engineering, integration, and operational efficiency
- Mentor and guide junior engineers, fostering automation and continuous learning
Requirements
- Bachelor’s degree in computer science, Information Technology, or related field
- 10+ years of experience in Big Data engineering or a similar role
- Proven leadership and project management experience
- Strong expertise in data integration, transformation, and orchestration using Spark, Hive, and Airflow
- Proficiency in Lakehouse platforms (Delta Lake, Apache Hudi, Apache Iceberg)
- Familiarity with cloud-based data environments (AWS, GCP, or Azure)
- In-depth understanding of scalable data pipelines, distributed computing, and modern data architectures
- Programming knowledge in Scala or Python
- Knowledge of data quality and governance principles and experience implementing them
- Excellent communication, leadership, and interpersonal skills
- Ability to adapt to changing priorities and manage multiple projects simultaneously
- health/dental insurance
- parental leave
- 401(k)
- incentive/bonus opportunity
- tuition reimbursement
- competitive compensation
- excellent career progression
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringdata integrationdata transformationdata orchestrationApache AirflowApache SparkHiveLakehouse platformsDelta LakeApache Hudi
Soft skills
leadershipproject managementcommunicationinterpersonal skillsmentoringcollaborationadaptabilityproblem-solvingtechnical expertisecontinuous learning