DevOps Engineer

• Develop and maintain CI/CD pipelines in Azure DevOps to deploy notebooks, jobs, and workflows to Azure Databricks
• Integrate Databricks Repos with Azure Repos (Git) for source control of PySpark/R notebooks
• Automate job runs in Databricks using Databricks CLI, REST API, or DevOps tasks
• Maintain infrastructure-as-code practices (e.g., using Terraform)
• Monitor and troubleshoot pipeline failures, notebook issues, and deployment inconsistencies
• Collaborate with Data Engineers and Platform teams to maintain development, staging, and production environments
• Implement best practices for version control, testing, and notebook promotion in a multi-environment setup
• Store and manage Databricks secrets, tokens, and configuration securely within Azure Key Vault and DevOps variable groups
• Understand and apply DevOps practices in a data platform context

DevOps Engineer

DevOps, Middleware Engineer

Senior DevOps Engineer