
Data Engineering Specialist
Rox Partner
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
Tech Stack
About the role
- Design and deploy robust, scalable, and efficient cloud-based data architectures, specializing in data warehousing, data lakes, and real-time (or near real-time) data pipelines on GCP (with familiarity with AWS and Azure).
- Define and enforce architectural standards for data modeling (e.g., Medallion/Lakehouse), data governance, and data quality across multiple domains.
- Apply advanced architectural concepts such as Data Mesh, microservices, Event-Driven Architecture, and Complex Event Processing in modern data systems.
- Lead the development and implementation of batch and streaming data pipelines using core GCP services like BigQuery, Dataflow, Pub/Sub, and potentially Dataproc.
- Use and mentor the team in orchestration tools such as Airflow (Composer) for workflow management.
- Implement data transformation logic using tools like Dataform and advanced SQL, ensuring data quality and enrichment from raw to curated layers.
- Manage and utilize a variety of data storage technologies, including BigQuery, Cloud Storage, Spark, Snowflake, and NoSQL/distributed databases such as Cassandra, HBase, and Elasticsearch.
- Act as the primary technical lead and subject-matter expert for the data engineering team, guiding development practices and design decisions.
- Oversee the entire project delivery lifecycle (planning, design, development, operation), translating business requirements into technical designs.
- Drive the modernization of legacy data platforms to a multi-cloud, scalable, and automated architecture, focusing on performance, cost reduction, and regulatory compliance.
Requirements
- Extensive experience in Software Engineering, Big Data, and Data Architecture.
- Deep knowledge of GCP (BigQuery, Dataflow, Cloud Storage, Pub/Sub, Dataform, Dataproc).
- Expertise in Big Data technologies including Apache Spark, Hadoop/Cloudera, and experience with modern data platforms such as Snowflake or Databricks.
- Strong proficiency in programming languages such as Python, Scala, Java, and expert-level SQL.
- Experience with Data Governance, Data Cataloging (Dataplex/Data Catalog), and data masking concepts.
- Hands-on experience with Infrastructure as Code (IaC) and CI/CD practices (e.g., GitLab, Cloud Build).
- Familiarity with advanced analytics and machine learning concepts (AI, Generative AI, Vertex AI) to enable data science workloads.
- Knowledge of TOGAF or similar architecture frameworks is a plus.
Benefits
- Remote work – Monday to Friday (09:00 to 18:00);
- Home-office allowance – Ifood card credit for Meals/Food worth R$300.00 per month;
- Birthday – On your special day, Rox provides a gift card and a day off so you can enjoy your day;
- Courses – Full access to RoxSchool, Alura platform, Pluralsight, and O'Reilly for books and talks;
- Certifications – Certification reimbursement up to R$300.00 (TECHNOLOGY) + a R$300.00 bonus per certification achieved from these brands;
- Psychological support – Two psychotherapy sessions covered monthly by ROX with partner psychologists;
- Feedz partnership – Gamified platform to stay connected, improve communication, and track sentiments, engagement, feedback, IDP (Individual Development Plan), and performance;
- WellHub (Gympass) – Partnership with gyms and health & wellness apps;
- Work equipment provided.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data architecturedata warehousingdata lakesreal-time data pipelinesdata modelingdata governancedata qualitydata transformationprogramming languagesSQL
Soft Skills
leadershipmentoringproject managementcommunicationcollaboration
Certifications
TOGAF