Minerva Foods

Senior Data Engineer

Minerva Foods

full-time

Posted on:

Location Type: Remote

Location: Brasil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowApacheAzureETLPythonSparkSQL

About the role

  • Serve as technical lead in data engineering (tech lead);
  • Produce technical documentation that complements business scope;
  • Ability to negotiate deadlines;
  • Develop and maintain scalable data architectures, including the creation and maintenance of pipelines;
  • Ensure data integrity, quality and consistency by implementing cleansing and validation procedures (code review);
  • Improve performance of ETL processes, databases and infrastructure to enhance operational efficiency and fast access to data;
  • Collaborate with multidisciplinary teams, guiding requirement definition and delivering data solutions aligned with business needs;
  • Design and implement advanced data models, promoting governance best practices for effective data management and organization;
  • Ensure data security and compliance, adhering to regulations and best practices for privacy and protection of sensitive information;
  • Identify and support resolution of technical and operational challenges related to data pipelines, optimizing processes and data availability;
  • Research and implement new technologies and approaches to improve the efficiency and quality of the data ecosystem.

Requirements

  • Bachelor’s degree in Data Science or Computer Science, Computer Engineering, Information Systems, Systems Analysis and Development (ADS) or related fields;
  • English – Level: Advanced;
  • Strong experience with SQL;
  • Solid experience developing ETLs and pipelines for data collection and processing (Pentaho, Airflow, Synapse and Databricks);
  • Experience with Microsoft Azure cloud;
  • Strong experience processing data with Databricks;
  • Desirable certifications: AZ-900 and DP-203/DP-700;
  • Knowledge of Apache Hop and dbt is desirable;
  • Knowledge of relational and non-relational databases;
  • Strong experience with Spark;
  • Strong experience with Python;
  • Experience with Big Data;
  • Data modeling skills (dimensional modeling or normalization);
  • Clean Code practices and technical documentation;
  • Experience identifying and resolving issues related to data integrity, quality and performance;
  • Experience in automation/transformation projects with a focus on data.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
SQLETLdata pipelinesDatabricksMicrosoft AzureSparkPythonBig Datadata modelingClean Code
Soft Skills
technical leadnegotiationcollaborationguiding requirement definitionproblem solvingcommunicationdata governanceoperational efficiencydata integrityquality assurance
Certifications
AZ-900DP-203DP-700