Senior Data Engineer
Sauce
full-time
Posted on:
Location Type: Remote
Location: North Macedonia
Visit company websiteExplore more
Job Level
About the role
- Build and optimize Sauce's lakehouse architecture using Azure Databricks and Unity Catalog for data governance
- Manage and optimize cluster resources to balance performance and cost
- Transform stage/raw layer data, define and manage data schemas, and add data quality tests
- Create and maintain data quality tests, improve existing alerting setups
- Develop reports/dashboards about data quality and consistency
- Improve existing CI/CD pipeline(s) using Databricks Asset Bundles and GitHub Actions/Workflows
- Own data warehouse - connecting data sources, and maintaining a platform and architecture in coordination with R&D infrastructure and operations teams
Requirements
- 5+ years of experience building data pipelines, data infrastructure, data quality suites, and alerting functionality
- Proficient in SQL, Python
- Proficient in Git
- Experience with Databricks
- Familiar with data governance, implementing or managing Unity Catalog
- Understanding of CI/CD principles, with experience implementing Databricks Asset Bundles
- Hands-on experience with data quality suites/frameworks/tools
- Experience with document-based databases (MongoDB) as well as relational databases (PostgreSQL)
Benefits
- Strong & Competitive Compensation Package
- Flexible Work Environment
- Up to 5 Paid Sick Days
- Up to 15 Paid Personal/Vacation Days
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
SQLPythonGitDatabricksUnity CatalogCI/CDDatabricks Asset Bundlesdata quality suitesMongoDBPostgreSQL