
Data Engineer – Azure, Databricks, Mid-level
Leega
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
About the role
- Perform data modeling by analyzing and structuring datasets to ensure proper relationships and adherence to industry best practices.
- Handle special data by creating and managing equivalence tables, including specific cases such as “verticals”, aiming for greater standardization and efficiency.
- Build pipelines that ensure full traceability from client file delivery through to loading into the Gold layer in Azure Databricks.
- Identify opportunities for source-side automation to reduce reliance on manual files and increase efficiency.
- Propose and implement efficient migration strategies, such as incremental loads, to avoid high costs from daily full loads.
- Familiarity with code documentation.
- Experience with agile methodologies.
- Familiarity with developing process monitoring and alerts.
- Ability to communicate technical solutions in a simple, pragmatic manner.
- Proactive in supporting the team.
Requirements
- Experience with Azure Databricks, PySpark, Workflows, and SQL Warehouse.
- Experience with Python for data engineering (file reading, transformations, and data ingestion).
- Knowledge of relational and non-relational databases.
- Databricks certification.
- Experience with low-code ETL tools.
- Experience with PySpark.
Benefits
- 🏥 Porto Seguro Health Insurance
- 🦷 Porto Seguro Dental Insurance
- 💰 Profit Sharing (PLR)
- 👶 Childcare Assistance
- 🍽️ Alelo Meal and Food Vouchers
- 💻 Home Office Allowance
- 📚 Partnerships with Educational Institutions
- 🚀 Support for Certifications, including Cloud
- 🎁 Livelo Points
- 🏋️♂️ TotalPass
- 🧘♂️ Mindself
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data modelingPySparkSQL WarehousePythonETLrelational databasesnon-relational databasesdata ingestiondata transformationsincremental loads
Soft skills
communicationproactiveteam support
Certifications
Databricks certification