Porto

Senior Data Engineer – Cards

Porto

full-time

Posted on:

Location Type: Hybrid

Location: São Paulo • Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AWSAzurePySparkPythonSQL

About the role

  • Develop a robust, scalable Data Architecture that supports data teams (Analytics, BI, Data Science, Machine Learning and other verticals) and the business, democratizing access to data in a secure, simple, structured and high-quality manner;
  • Design, build and integrate monitoring mechanisms and observability for the data ecosystem;
  • Design/build development standards and best practices, and document the environment and deliverables;
  • Document, monitor and ensure data quality;
  • Design and ensure the application of best practices for pipeline development, focusing on performance and scalability;
  • Ensure and maintain a vision capable of relating/integrating areas (Data Products and MLOps) and data solutions;
  • Ensure knowledge is shared across the team;
  • Identify, manage and address risks related to the activities under your and your team's responsibility;
  • Ensure and implement the data architecture design;
  • Ensure correct understanding of business needs and strategic vision;
  • Ensure that all identified requirements to be developed are delivered with quality, scalability and within the deadline;

Requirements

  • Degree in Engineering, Computer Science or related fields;
  • Experience with Azure and/or AWS;
  • Experience with Databricks;
  • Experience with Delta Lake / Lakehouse;
  • Experience with Cosmos DB, Azure Synapse and Analysis Services;
  • Experience with programming languages Python, SQL and PySpark;
  • Experience with distributed data processing;
  • Experience with continuous integration and continuous delivery pipelines (CI/CD) and/or Azure DevOps;
  • Experience developing APIs and/or Azure Functions;
Benefits
  • Flexible food and meal vouchers;
  • Health insurance;
  • Dental insurance;
  • Wellhub and TotalPass;
  • Exclusive Bio Ritmo gym for employees: at the Headquarters complex;
  • Profit Sharing (PLR);
  • Share Program: "Porto em Ação" — complementary to PLR until 2025;
  • Sand and multi-sport courts: at the Headquarters complex;
  • Transportation voucher;
  • Van transportation services: available at the main access stations to Porto (Luz, Barra Funda, Santa Cecília and Júlio Prestes);
  • Extended Parental Leave: up to 40 days for all family configurations;
  • Extended Maternity Leave of 6 months;
  • Medical clinic with specialties: at the Headquarters complex and Barra Funda;
  • Childcare or nanny assistance;
  • Life insurance;
  • Private pension plan - PortoPrev;
  • Discounts on products and services;
  • Tuition assistance: reimbursement for undergraduate, postgraduate or MBA programs;
  • Monthly races: subsidy for major street races in São Paulo;
  • Language course reimbursement (English or Spanish);
  • Porto Theater: exclusive sessions for employees;
  • Library;
  • Rest area: at the Headquarters complex;
  • Game room: at the Headquarters complex;
  • Massage and podiatry services: at the Headquarters complex;
  • Work location: On-site (we operate hybrid models, which will be explored during the selection process);
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
Data ArchitectureData QualityPipeline DevelopmentProgramming LanguagesPythonSQLPySparkDistributed Data ProcessingAPIsCI/CD
Soft Skills
Team CollaborationRisk ManagementDocumentationKnowledge SharingBusiness UnderstandingStrategic Vision