Senior Data Engineer – GCP, DBT

Leega

Senior Data Engineer focusing on GCP and DBT in a data-driven consulting firm. Driving innovative solutions and improving data processes for business insights.

Posted 5/22/2026full-timeRemote • 🇧🇷 BrazilSeniorWebsite

Tech Stack

Tools & technologies

BigQueryCloudETLGoogle Cloud PlatformHadoopPySparkPythonShell ScriptingSparkSQLTerraform

About the role

Key responsibilities & impact

**Analysis and Planning of Loads/Pipelines:**
Evaluate the data warehouse architecture and requirements.
Map data, transformations and processes to GCP services (Cloud Storage, BigQuery, Dataproc).
Define data migration strategy (full load, incremental, CDC).
Develop a data architecture plan on GCP.
**Design and Data Modeling on GCP:**
Design table schemas in BigQuery, considering performance, cost and scalability.
Define partitioning and clustering strategies for BigQuery.
Model data zones in Cloud Storage (Bronze, Silver and Gold).
**ELT/ETL Pipeline Development:**
Create data transformation routines using Dataproc (Spark) or Dataflow to load data into BigQuery.
Translate business logic and existing transformations into GCP.
Implement data validation and data quality mechanisms.
**Provisioning and Infrastructure Management:**
Use IaC tools (Terraform) to provision and manage GCP resources (BigQuery datasets/tables, Cloud Storage buckets, Dataproc clusters).
Configure and optimize Dataproc clusters for different workloads.
Manage networking, security (IAM) and access on GCP.
**Performance and Cost Optimization:**
Optimize queries in BigQuery to reduce costs and improve performance.
Tune and optimize Spark jobs on Dataproc.
Monitor and optimize GCP resource usage to control costs.
**Data Security and Governance:**
Implement and ensure data security in transit and at rest.
Define and apply IAM policies to control access to data and resources.
Ensure compliance with data governance policies.
**Monitoring and Support:**
Troubleshoot performance and functional issues of data pipelines and GCP resources.
**Documentation:**
Document the architecture, data pipelines, data models and operational procedures.
**Communication:**
Communicate effectively with team members, stakeholders and other business areas.
Ensure clear communication between architecture definitions and software components, and support the evolution and quality of the team's developments.
**Jira / Agile Methodologies:**
Familiarity with agile methodologies, ceremonies and proficiency with the Jira tool.

Requirements

What you’ll need

**Google Cloud Platform (GCP):**
**BigQuery:** Deep knowledge in data modeling, query optimization, partitioning, clustering, data loading (streaming and batch), security and data governance.
**Cloud Storage:** Experience managing buckets, storage classes, lifecycle policies, access control (IAM) and data security.
**Dataproc:** Skills in provisioning, configuring and managing Spark/Hadoop clusters, job optimization, and integration with other GCP services.
**Dataflow/Composer/DBT:** Knowledge of orchestration and data-processing tools for ELT/ETL pipelines.
Proven minimum of 3 years of experience in GCP.
Proven minimum of 3 years of experience in DBT (preferred).
Proven minimum of 3 years of experience in PySpark.
Proven experience with GitFlow.
**Cloud IAM (Identity and Access Management):** Implementation of security policies and fine-grained access control.
**VPC, Networking and Security:** Understanding of networks, subnets, firewall rules and cloud security best practices.
**Programming Languages:**
**Python and PySpark:** Essential for automation scripts, pipeline development and integration with GCP APIs.
**SQL (advanced):** For BigQuery, DBT and data transformations.
**Shell Scripting:** For task automation.
**Version Control:**
Git / GitHub / Bitbucket.

Benefits

Comp & perks

🏥 Porto Seguro Health Plan
🦷 Porto Seguro Dental Plan
💰 Profit Sharing (PLR)
👶 Childcare Assistance
🍽️ Alelo Meal and Food Vouchers
💻 Home Office Allowance
📚 Partnerships with Educational Institutions
🚀 Support for Certifications, including Cloud
🎁 Livelo Points
🏋️‍♂️ TotalPass
🧘‍♂️ Mindself

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Google Cloud Platform (GCP)BigQueryCloud StorageDataprocDataflowDBTPythonPySparkSQLShell Scripting

Soft Skills

communicationtroubleshootingdocumentationteam collaborationstakeholder engagement