Data Engineer – DataOps
Stefanini Brasil
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇧🇷 Brazil
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
AzureCloudKubernetesLinuxSparkVault
About the role
- Create and maintain scalable and efficient data pipelines on Azure Cloud.
- Work with Databricks for distributed processing and data analysis.
- Administer and automate routines on Linux, focusing on performance and security.
- Collaborate with development and infrastructure teams to ensure DataOps best practices.
Requirements
- Experience with Azure Cloud: Strong hands-on experience with Azure Cloud, including tools such as Data Factory, Synapse, Storage, Key Vault, and others.
- Proficiency in Databricks: Proficiency in Databricks, including Spark, notebooks, and Delta Lake.
- Knowledge of Linux: Strong Linux knowledge, including shell scripting, basic administration, and troubleshooting.
- Familiarity with Kubernetes: Experience with Kubernetes for container orchestration.
- CI/CD for data projects: Experience with CI/CD applied to data projects (GitHub Actions, Azure DevOps, etc.).
- Interest in Microsoft Fabric: Knowledge of or interest in Microsoft Fabric.
Benefits
- Meal allowance or meal voucher
- Discounts on courses, universities, and language schools
- Stefanini Academy — platform with free, up-to-date online courses and certificates
- Mentoring
- Benefits club for medical consultations and exams
- Health insurance
- Dental insurance
- Discounts and perks at top establishments
- Travel club
- Pet care agreement
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipelinesAzure CloudDatabricksSparknotebooksDelta LakeLinuxshell scriptingKubernetesCI/CD
Soft skills
collaboration