Leega

Data Engineer – Azure, Databricks, Mid-level

Leega

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

AI Apply
Apply

About the role

  • Perform data modeling by analyzing and structuring datasets to ensure proper relationships and adherence to industry best practices.
  • Handle special data by creating and managing equivalence tables, including specific cases such as “verticals”, aiming for greater standardization and efficiency.
  • Build pipelines that ensure full traceability from client file delivery through to loading into the Gold layer in Azure Databricks.
  • Identify opportunities for source-side automation to reduce reliance on manual files and increase efficiency.
  • Propose and implement efficient migration strategies, such as incremental loads, to avoid high costs from daily full loads.
  • Familiarity with code documentation.
  • Experience with agile methodologies.
  • Familiarity with developing process monitoring and alerts.
  • Ability to communicate technical solutions in a simple, pragmatic manner.
  • Proactive in supporting the team.

Requirements

  • Experience with Azure Databricks, PySpark, Workflows, and SQL Warehouse.
  • Experience with Python for data engineering (file reading, transformations, and data ingestion).
  • Knowledge of relational and non-relational databases.
  • Databricks certification.
  • Experience with low-code ETL tools.
  • Experience with PySpark.
Benefits
  • 🏥 Porto Seguro Health Insurance
  • 🦷 Porto Seguro Dental Insurance
  • 💰 Profit Sharing (PLR)
  • 👶 Childcare Assistance
  • 🍽️ Alelo Meal and Food Vouchers
  • 💻 Home Office Allowance
  • 📚 Partnerships with Educational Institutions
  • 🚀 Support for Certifications, including Cloud
  • 🎁 Livelo Points
  • 🏋️‍♂️ TotalPass
  • 🧘‍♂️ Mindself

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data modelingPySparkSQL WarehousePythonETLrelational databasesnon-relational databasesdata ingestiondata transformationsincremental loads
Soft skills
communicationproactiveteam support
Certifications
Databricks certification