Memed

Data Engineer

Memed

full-time

Posted on:

Location Type: Hybrid

Location: São Paulo • Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AirflowApacheAWSCloudETLPythonSparkSQL

About the role

  • Lead the evolution of Memed's data architecture (Data Lakehouse/Mesh), ensuring a resilient, scalable infrastructure prepared for growing data volumes.
  • Develop and optimize ingestion and transformation frameworks (ETL/ELT) using Databricks, establishing code standards that prioritize performance and reuse.
  • Establish and promote software engineering best practices in the data context and solution productionization, including CI/CD, code versioning, automated quality tests and infrastructure as code.
  • Drive the FinOps strategy, monitoring compute and storage costs in the Cloud (AWS).
  • Develop data governance mechanisms (lineage, catalog and metadata) and ensure compliance with LGPD (Brazil's General Data Protection Law), applying strict access controls, encryption and anonymization policies.
  • Act as a technical bridge between Engineering, Analytics and stakeholders, translating business challenges into robust data solutions and mentoring the team in adopting modern architectural standards.

Requirements

  • Bachelor's degree in Computer Science, Engineering, Information Systems, Statistics or related fields.
  • Experience with modern data architectures such as data lakes, data streaming and cloud computing (preferably AWS).
  • Experience developing, maintaining and versioning data pipelines (ETL/ELT), ensuring scalability, performance and security.
  • Proficiency in Apache Spark, Databricks, Delta Lake and orchestration tools such as Apache Airflow.
  • Advanced SQL skills and proficiency in Python for data manipulation and automation.
  • Experience with Git, CI/CD pipelines and deployment best practices in cloud environments.
  • Solid understanding of cloud data architecture, information security and data governance.
  • Knowledge of FinOps and strategies for optimizing cloud costs.
  • Analytical and structured thinking with a focus on solving complex problems.
  • Ability to work autonomously to propose technical solutions and lead improvements to the data architecture.
  • Curiosity and continuous interest in learning and applying new technologies and best practices.
Benefits
  • This position is also open to candidates with disabilities (PwD).
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data architecturedata lakehousedata meshETLELTDatabricksApache SparkDelta LakeSQLPython
Soft Skills
analytical thinkingstructured thinkingproblem solvingautonomymentoringcommunicationcollaborationcuriositycontinuous learningleadership