Senior Data Platform Engineer
Samsara
AWSCloudEC2ETLIoTPythonRDBMSSQLTerraformUnity
Salary
💰 CA$127,075 - CA$164,450 per year
Job Level
Senior
Tech Stack
AWSCloudEC2ETLPythonRDBMSSQLTerraformUnity
About the role
- Administer and monitor Databricks workspaces and underlying AWS Infra: develop platform admin tools and capabilities to administer, monitor, track and troubleshoot clusters, catalogs, users, groups, databases, storage and security
- Act as the primary Databricks SME, assisting and guiding teams on platform features and best practices
- Collaborate with data engineers, analysts, and data scientists to operationalize and optimize workflows and data pipelines
- Oversee data-engineering dev ecosystem, including dev-tooling, CI/CD pipelines, and monitoring frameworks
- Own implementation and management of IaaC (Terraform, CloudFormation) and CI/CD automation for Databricks and AWS resources
- Ensure security, high availability, disaster recovery, and compliance across data services
- Incorporate DevOps best practices including automated testing, deployment, observability, and monitoring
- Engage directly with internal cross-functional stakeholders to understand their data needs and design scalable solutions
- Collaborate with engineers, managers, and vendor representatives to evaluate new features and solutions; lead rapid prototyping and proofs-of-concept for performance, cost, security, scalability, observability
- Provide mentorship, technical guidance, training, and knowledge-sharing across teams
Requirements
- This role is open to candidates residing in Canada
- Bachelor's or Master's degree in Computer Sciences, Software Engineering, Electrical Engineering, Computer Engineering, or related discipline
- 10+ years experience in a Software Engineering, Platform Engineering, Data Engineering, DevOps/DataOps or similar technical role, including at least 2+ years experience in data infrastructure or platform focused role
- Experience building, delivering, and administering large-scale production-grade data platforms and services to data engineering, business analyst and data-science teams
- Solid knowledge of Databricks features and administration, including Unity Catalog, cluster management, security, troubleshooting, root-cause analysis, and performance optimization
- Experience and familiarity with AWS services and Cloud Infrastructure provisioning, management, monitoring, and security (e.g., S3, IAM, RDS, Lambda, API-Gateway, VPC, EC2, ECS/EKS)
- Strong knowledge of SQL and Python, and hands-on data-engineering experience in designing and developing data pipelines and ETL routines from a variety of sources (SaaS corporate systems, APIs, RDBMS)
- Skilled with change-data capture, incremental and batch loading techniques
- Experience troubleshooting underlying issues and translating them into technical solutions
- Excellent problem-solving, communication, and stakeholder management skills
- (Ideal) Experience delivering and managing Databricks and AWS Infra for 100s of users
- (Ideal) Experience as a technical lead
- (Ideal) Knowledge of DevOps tools and practices: GitHub/GitLab, CI/CD systems, Terraform, monitoring/logging tools (e.g., Datadog, CloudWatch)
- (Ideal) Experience implementing robust data governance and security measures to ensure data integrity and compliance
Similar jobs on JobTailor
Senior Cloud Engineer, AWS
Refinery89
AWSCloudDockerEC2KubernetesPythonTerraform
Senior Systems Reliability Engineer
The Walt Disney Company
AWSCloudDistributed SystemsDockerEC2FluxGoKubernetesPackerPythonPyTorchSplunk+3 more
AWS Cloud Engineer
General Dynamics Information Technology
AWSCloudDockerDynamoDBEC2KubernetesLinuxPython
Cloud Solution Architect
KeyrusCloud
AWSAzureCloudEC2Python