Principal Data Engineer
Docker, Inc
AirflowApacheAWSAzureBigQueryCloudDistributed SystemsDockerERPETLGoGoogle Cloud Platform+7 more
Director, Data Engineering
Vimeo
full-time
Posted on:
Location Type: Office
Location: New York City • New York • 🇺🇸 United States
Visit company websiteSalary
💰 $172,800 - $264,750 per year
Job Level
Lead
Tech Stack
AirflowApacheCloudKafkaSparkSQLTerraformUnity
About the role
- Lead Vimeo's data strategy, architecture, and automation efforts
- Drive and lead strategic, cross-functional initiatives to enable data standardization and increase data consumption
- Communicate findings and insights to technical and non-technical stakeholders
- Build and maintain dashboards, reports, and presentations to enable data-driven decision-making
- Perform advanced analytical deep dives for stakeholder insights
- Design and implement a lakehouse architecture and lead migration from Snowflake to Databricks
- Build and scale batch and real-time data processing pipelines using Spark, SQL engines, Airflow, and cloud services
- Drive data modeling and optimization for analytics and ML
- Ensure integration between storage, compute, and analytics layers
- Lead automation-first initiatives for ingestion, transformation, and governance using CI/CD, dbt, Airflow, and Terraform
- Establish observability, monitoring, and fault-tolerance frameworks for data workflows
- Optimize cost efficiency and scalability of compute-intensive workloads
- Implement SRE best practices to automate incident detection and resolution
- Define and enforce data governance, access control, metadata management, and lineage tracking
- Build, mentor, and scale a high-performing data engineering team
- Partner with Analytics, Product, Engineering, and AI/ML teams to enable data-driven innovation
- Champion a data-first culture and self-service analytics
Requirements
- 8+ years of experience in data engineering, analytics, or data architecture
- 3+ years in a leadership role
- Deep expertise in modern cloud data platforms, ideally Google Cloud
- Experience designing and implementing lakehouse architectures and enterprise migrations (Snowflake to Databricks)
- Hands-on with Databricks, Apache Spark, SQL engines
- Experience building and scaling batch and real-time data pipelines
- Proficiency with orchestration and automation tools (Airflow, dbt, CI/CD, Terraform)
- Experience with streaming technologies (Kafka, Flink)
- Experience optimizing query performance and compute cost efficiency
- Experience implementing observability, monitoring, and SRE best practices
- Hands-on experience with data catalogs, metadata management, Databricks Unity Catalog, and Atlan
- Strong data modeling and analytics enablement skills
- Experience enforcing data governance and compliance (GDPR, CCPA)
- Strong cross-functional collaboration and stakeholder communication
- Experience building and mentoring high-performing teams
Benefits
- Paid time off
- Generous 401k match
- Commuter benefits
- Health Savings Account (HSA)
- Flexible Spending Account (FSA)
- Fertility reimbursement
- Group term life insurances
- Wellbeing resources
- Wide range of additional benefits and perks
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringdata architecturelakehouse architecturedata modelinganalyticsreal-time data processingbatch data processingquery performance optimizationdata governancemetadata management
Soft skills
leadershipcross-functional collaborationstakeholder communicationmentoringdata-driven decision-makingproblem-solvingstrategic thinkingteam buildingautomation-first mindsetchampioning data culture
Similar jobs on JobTailor
Data Engineer – Engenheiro de Dados Pleno
Dadosfera
AirflowApacheCloudKubernetesLinuxPythonScalaSparkSQLTableauTerraform
Senior Staff Data Engineer
SecurityScorecard
AirflowApacheAWSCyber SecurityDockerJavaJenkinsKafkaPostgresPythonRedisScala+3 more
Engineering Manager, Data Infrastructure
OpenAI
AirflowApacheKafkaKubernetesSparkTerraform
Senior Software Engineer
Workiva
AirflowApacheAWSAzureCloudDockerETLKafkaKubernetesMySQLPostgresSQL+1 more