Minsait

ETL Analyst/Developer

Minsait

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AzurePySparkPythonSparkSQLUnity

About the role

  • Develop and maintain data ingestion and transformation pipelines in Azure Data Lakehouse.
  • Work with Azure Databricks using PySpark and SQL for data processing and modeling.
  • Implement integration and orchestration processes using Azure Data Factory.
  • Ensure governance and version control using Azure DevOps, Git, and CI/CD.
  • Perform audits, validations, and data reconciliation using SQL queries.
  • Monitor jobs and ingestion logs, and propose continuous improvements (performance, architecture).
  • Document pipelines, processes, and data architecture.
  • Collaborate with product and business teams to understand technical requirements.

Requirements

  • Bachelor's degree in IT or a related field.
  • Experience with Azure Data Lakehouse, Azure Databricks (PySpark/SQL), and Azure Synapse Analytics.
  • Proficiency in PySpark, SQL (Spark SQL/T-SQL), and Python.
  • Knowledge of Data Lakehouse architecture, Delta Lake, and Unity Catalog.
  • Experience with Azure Data Factory for ingestion and orchestration.
  • Experience with Git, Azure DevOps, CI/CD, and pipeline versioning.
  • Experience with Delta Sharing, SFTP, and SQL-based auditing.
  • Preferred: Deep experience with Unity Catalog and data governance on Azure.
  • Experience in projects integrating multiple Data Lakes via Delta Sharing.
  • Experience in audited projects (compliance, logging, controlled versioning).
Benefits
  • Company-subsidized health insurance for the employee.
  • Option to include dependents on the health plan with payroll deduction.
  • Dental assistance (optional).
  • Option to include dependents on the dental plan with payroll deduction.
  • Meal allowance or food allowance.
  • Transportation voucher (optional).
  • Impact & Care – Personal guidance program providing confidential emotional support and counseling in psychological, legal, financial, social, and pet-related areas at no cost for the employee and legal dependents.
  • Gympass - Wellhub (Access to over 700 gyms across Brazil with plans starting at R$29.90, payroll-deducted).
  • Option to include dependents in Gympass - Wellhub (up to 3 dependents – paid via credit card).
  • Access to Udemy via our intranet.
  • Partnerships with major consumer brands.
  • SESC partnership for employee and dependents.
  • Discount agreements with educational institutions (undergraduate and postgraduate) and language/certification schools.
  • Group life insurance.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PySparkSQLPythonData Lakehouse architectureDelta LakeUnity CatalogData FactoryCI/CDdata governanceauditing
Soft skills
collaborationcommunicationdocumentationcontinuous improvement
Certifications
Bachelor's degree in IT