Data Architect – Databricks
Allata
AirflowAWSAzureCloudETLGrafanaJenkinsMS SQL ServerOraclePostgresPrometheusPySpark+4 more
Senior Data Engineer, Data Platform
Zocdoc
full-time
Posted on:
Location: New York • 🇺🇸 United States
Visit company websiteSalary
💰 $152,000 - $228,000 per year
Job Level
Senior
Tech Stack
AirflowETLPythonSQLUnity
About the role
- Own and evolve the data platform that connects producers and consumers, building contracts, frameworks, and endpoints to ensure reliable, transparent, and secure data.
- Focus on data quality, governance, and lifecycle management to enable responsible data sharing and activation across Zocdoc.
- Build and maintain endpoints and tooling for ingestion, validation, and discovery; develop data quality monitoring, validation, and observability processes.
- Partner with product engineers, analytics engineers, and security teams to enforce standards and compliance; manage metadata and governance systems (Unity Catalog, Collibra, OpenMetadata).
- Support education and adoption of data culture and best practices across the company; leverage CDP experience for governance and activation.
Requirements
- 5+ years of experience in data engineering, with a strong focus on platform, governance, or quality frameworks.
- Expertise in Python and SQL, with a track record of designing scalable pipelines and data models.
- Familiarity with data contracts, schema enforcement, and validation frameworks.
- Hands-on experience with lakehouse architectures (Databricks, Delta Lake/Iceberg) and data warehouses (Snowflake).
- Exposure to customer data platforms (Segment, mParticle, or homegrown CDPs), particularly in data development and governance contexts.
- Experience with orchestration (Dagster, Airflow) and CI/CD workflows.
- Strong communication and problem-solving skills to partner effectively with producers and consumers.
