Minsait

Senior Data Engineer

Minsait

full-time

Posted on:

Location Type: Hybrid

Location: Goiânia • Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowGroovyHBaseHDFSJavaKafkaMySQLOraclePySparkPythonRedisScalaSparkSQL

About the role

  • Planning, scheduling and deploying data pipelines (large volumes of data) to be ingested into the Big Data environment (Data Lake).
  • Monitoring and resolving issues in data pipelines.
  • Planning and executing data cleansing and remediation activities.
  • Developing, building, testing and maintaining database architectures and/or data processing systems for real-time and/or distributed processing.
  • Designing and implementing methods and techniques to improve data efficiency, quality and reliability.
  • Proposing improvements, adjustments and optimizations to processes through new methodologies or tools.
  • Documenting, describing and modeling data and metadata.
  • Data administration and security.
  • Intermediate knowledge of Git/GitLab.
  • Advanced knowledge of Java/Groovy.
  • Advanced knowledge of Python.
  • Desired: Intermediate to advanced knowledge of Spark (streaming and batch) - PySpark/Scala.
  • Experience with Big Data tools such as NiFi, Kafka, Airflow, HDFS, Hive, HBase, Iceberg, Kudu, Impala, Trino, Redis.
  • Intermediate to advanced knowledge of SQL.
  • Intermediate to advanced knowledge of Oracle and/or MySQL.

Requirements

  • Bachelor's degree in Computer Science, Information Technology or a related field.
  • Availability to work in a hybrid (onsite/remote) model.
  • Proven experience in the role.
  • Plus: experience working on public administration/government projects.
Benefits
  • Company-subsidized health insurance for the employee.
  • Option to include dependents on the health plan with payroll-deduction.
  • Optional dental care plan.
  • Option to include dependents on the dental care plan with payroll-deduction.
  • Meal allowance or grocery allowance.
  • Optional transportation voucher.
  • Impact & Care - a personal guidance program offering confidential emotional support and counseling in psychological, legal, financial, social and pet care areas at no cost for the employee and legal dependents.
  • Gympass - Wellhub (access to over 700 gyms across Brazil with plans starting from R$29.90 deducted via payroll).
  • Option to include dependents on Gympass - Wellhub (up to 3 dependents - paid via credit card).
  • Access to Udemy via the company intranet.
  • Partnerships with major consumer brands.
  • Partnership with SESC for employee and dependents.
  • Discount agreements with educational institutions (undergraduate and graduate) and language schools/certification bodies.
  • Group life insurance.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data pipelinesdata cleansingdatabase architecturesdata processing systemsdata efficiencyGitJavaPythonSQLOracle
Certifications
Bachelor's degree in Computer ScienceBachelor's degree in Information Technology