Lead Snowflake Data Engineer
Medsuite Inc
ApacheAzureCloudETLKafkaMatillionPythonSparkSQL
Job Level
Mid-LevelSenior
Tech Stack
ApacheETL
About the role
- Build and scale data management systems that power our AutoML and forecasting platforms
- Own and evolve the feature store and feature engineering workflows
- Implement robust data SLAs and lineage systems across time series data pipelines
- Collaborate with ML engineers, infra, and product teams to ensure scalable and user-aware platform design
- Drive architectural decisions around data distribution, versioning, and composability
- Participate in the design of reusable systems for varied supply chain problems
- Build scalable, composable data infrastructure and pipelines that support ML and analytics use cases
- Support automated model building, experimentation, and data lineage systems with high SLA requirements
Requirements
- Strong experience working with large-scale data systems (Big Data, distributed pipelines)
- Hands-on experience with ETL pipelines, data lineage, and data reliability tooling
- Proven experience in ML feature engineering and/or building feature stores
- Exposure to time series data, forecasting pipelines, or AutoML workflows
- Strong problem-solving and design thinking ability — can break down ambiguous platform problems
- Familiarity with modern data infra (e.g., Apache Iceberg, ClickHouse, Data Lakes)
- Product thinking — can anticipate how users will interact with the system and build accordingly
- Experience building composable, user-extensible systems
- Prior exposure to AutoML frameworks (e.g., SageMaker, VertexAI) or internal ML platforms
