Minsait

Senior Data Engineer – Specialist

Minsait

full-time

Posted on:

Location Type: Hybrid

Location: São Paulo • Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowApacheAWSJenkinsPySparkSparkSQLTerraform

About the role

  • Develop and maintain batch data pipelines using PySpark (SQL-focused)
  • Write and optimize complex SQL queries to support business logic and reporting needs
  • Independently understand requirements and translate them into code
  • Transform and integrate data from various sources into Iceberg tables and Snowflake
  • Contribute to the development of data marts and organized datasets for business consumption
  • Collaborate with business analysts to understand data requirements
  • Monitor and manage data jobs running on AWS EMR, orchestrated by Airflow, using S3, Glue and other AWS services
  • Ensure data quality, consistency and performance across the pipeline

Requirements

  • Fluency in English is mandatory
  • Minimum of 10 years of hands-on experience in data engineering, writing complex SQL queries
  • Proven expertise in SQL including joins, aggregations, window functions and performance optimization
  • Hands-on experience with PySpark, especially Spark SQL
  • Familiarity with AWS data services (e.g., EMR, S3, Glue)
  • Understanding of data modeling frameworks, including the Kimball methodology
  • Experience working with Snowflake or similar cloud data warehouses
  • Knowledge of Apache Iceberg or similar table formats (e.g., Delta Lake, Hudi)
  • Experience building and managing data marts
  • Familiarity with Airflow or other orchestration tools
  • Familiarity with infrastructure-as-code tools such as Terraform
  • Understanding of ODS (Operational Data Store) patterns and data lake architecture
  • Experience with Bitbucket (or any similar git tool)
  • Experience/understanding of Jenkins
Benefits
  • Company-subsidized health plan for the employee
  • Option to include dependents in the health plan with payroll deduction
  • Dental assistance (optional)
  • Option to include dependents in the dental assistance plan with payroll deduction
  • Meal voucher or food allowance
  • Transportation voucher (optional)
  • Impact & Care - Personal Guidance Program providing confidential emotional and counseling support in psychological, legal, financial, social and pet-related areas at no cost for the employee and legal dependents
  • Gympass - Wellhub (access to over 700 gyms across Brazil with plans starting at R$ 29.90 via payroll deduction)
  • Option to include dependents in Gympass - Wellhub (up to 3 dependents - paid via credit card)
  • Access to Udemy through our intranet
  • Partnerships with major consumer brands
  • Partnership with SESC for employee and dependents
  • Discount agreements with educational institutions (undergraduate and postgraduate) and language schools/certification bodies
  • Group life insurance
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PySparkSQLdata engineeringdata modelingperformance optimizationdata transformationdata integrationdata martsdata qualitydata pipeline
Soft Skills
collaborationindependencecommunicationproblem-solvinganalytical thinking