
Mid-level Data Engineer
Reply
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
About the role
- Build and manage reliable data pipelines involving ingestion/collection, processing, integration, storage, and provisioning of data across the organization
- Work within a distributed systems architecture for massively parallel (MPP) data processing, combining multiple heterogeneous data sources and collaborating with analytics and data science teams to build solutions and generate data-driven value
Requirements
- Hands-on experience with ingestion, integration, processing, and storage of large volumes of data
- Experience working on Big Data projects
- Behavior Driven Development (BDD)
- Data extraction in Python and data processing with PySpark
- Experience with ETL tools
- Knowledge of relational and dimensional data modeling (Data Warehouse)
- Experience with SQL databases
- Experience with AWS Big Data toolset such as: EMR, Kinesis, Redshift, S3, Glue, Elasticsearch
- Knowledge of Kafka
- Knowledge of Data Lake and DataOps
- Preferred: AWS certifications
- Experience with infrastructure-as-code cloud provisioning tools such as Terraform and CloudFormation
Benefits
- Swile flexible benefit card to use as you wish (meal and food allowance)
- TotalPass or Gympass
- Mental health support – Psicologia Viva
- Bradesco Health Insurance
- Bradesco Dental Plan
- Profit sharing
- Childcare assistance
- Support for professional certifications
- Special talks and webinars
- RAF referral bonus program
- Life insurance
- Subsidy for English or Italian lessons
- Open English discount
- Birthday gift
- Possibility of relocation to another country
- Partnerships with universities
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data ingestiondata integrationdata processingdata storageBig DataBehavior Driven Developmentdata extraction in Pythondata processing with PySparkETL toolsSQL databases
Certifications
AWS certifications