
Data Engineer, GCP, Mid-level
Leega
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
About the role
- Organization and Structuring of Data Repositories
- Perform data modeling, analyzing and structuring datasets to ensure proper relationships and adherence to market best practices
- Handle special data cases by creating and managing equivalence/mapping tables, including specific cases such as “verticals,” aiming for greater standardization and efficiency
- Development of Data Pipelines and Flows
- Build pipelines that ensure full traceability, from client file delivery through to loading into the Gold layer on Google Cloud Platform (GCP)
- Identify opportunities for source-side automation to reduce dependence on manual files and increase efficiency
- Migration and Optimization of Databases
- Propose and implement efficient migration strategies, such as incremental loads, avoiding high costs associated with daily full loads
- Familiarity with code documentation (desirable)
- Experience with agile methodologies (desirable)
- Skills in developing and optimizing APIs for data consumption (desirable)
- Familiarity with developing monitoring and alerts for processes implemented on GCP (desirable)
- Ability to communicate technical solutions in a simple and pragmatic way (soft skill)
- Proactive in supporting the team (soft skill)
Requirements
- Experience with Google Cloud Platform (BigQuery, Cloud Storage, Cloud Composer)
- Experience with Python in a data context (file reading, transformations, and data ingestion)
- Knowledge of relational and non-relational databases
- GCP certification (preferred)
- Experience with low-code ETL tools (preferred)
- Experience with PySpark (preferred)
Benefits
- 🏥 Porto Seguro Health Plan
- 🦷 Porto Seguro Dental Plan
- 💰 Profit Sharing (PLR)
- 👶 Childcare Assistance
- 🍽️ Alelo Meal and Food Allowance
- 💻 Home Office Allowance
- 📚 Partnerships with Educational Institutions
- 🚀 Support for certifications, including Cloud
- 🎁 Livelo Points
- 🏋️♂️ TotalPass
- 🧘♂️ Mindself
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data modelingdata structuringdata pipelinesdata flowsAPI developmentdatabase migrationdatabase optimizationPythonPySparkETL
Soft skills
communicationproactive support
Certifications
GCP certification