Senior Manager, Data Engineering
The Walt Disney Company
AirflowBigQueryETL
Staff Data Engineer
Laurel
full-time
Posted on:
Location Type: Hybrid
Location: San Francisco • California, New York • 🇺🇸 United States
Visit company websiteSalary
💰 $200,000 - $250,000 per year
Job Level
Lead
Tech Stack
AirflowAWSDjangoDockerGoKubernetesLinuxMongoDBPostgresPythonTerraform
About the role
- Write Terraform modules and Go libraries other teams can use to manage their infrastructure.
- Work on Python API Services (Django) to improve the serving of our AI infrastructure.
- Improve Airflow DAGs and optimize MongoDB and Postgres usage.
- Develop and manage kubernetes, docker, and compute infrastructure for all of engineering.
- Improve continuous integration, continuous deployment, and other automation.
- Participate in an oncall rotation.
- Help teams improve their reliability, security and observability through documentation, pull requests and developing tooling.
- Work with vendors, engineers and others to improve the cost efficiency of our services.
- Write backend code to help teams deliver functionality when there are deadlines or lack of resources.
- Attend quarterly offsites (required travel), team standups, and other company meetings.
- Raise the bar for quality and advocate to make our engineering best practices.
Requirements
- 6+ years of experience in the following areas:
- A developer with strong Python skills building and deploying APIs to support our AI team in delivering models to end users.
- Experience with Airflow, Kubernetes, AWS.
- Experience with Machine Learning and Large Language Models
- Development experience with Terraform.
- Experience working in startup environments
- Significant experience with Linux administration
- Experience with taking part in a regular engineering oncall rotation
- Experience with any CI tooling/platforms
- Experience with Postgresql and Mongodb
Benefits
- Comprehensive medical/dental/vision coverage with covered premiums
- 401(k)
- additional benefits including wellness/commuter/FSA stipends
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonTerraformAirflowKubernetesAWSMachine LearningLarge Language ModelsLinux administrationPostgreSQLMongoDB
Soft skills
reliabilitysecurityobservabilitydocumentationpull requeststeam collaborationadvocacy for best practices
