
Senior Data Engineer, Hybrid
Extractta
full-time
Posted on:
Location Type: Hybrid
Location: São Paulo • Brazil
Visit company websiteExplore more
Job Level
About the role
- Design, develop and support robust data infrastructure solutions with a focus on scalability, security and efficiency.
- Lead the implementation and maintenance of ecosystems such as Trino, AWS Glue, Redshift, Airflow, Kafka and Spark on Kubernetes (K8s).
- Collaborate with engineering, data science and product teams to ensure smooth integration across systems.
- Diagnose and resolve performance, scalability and reliability incidents.
- Apply and promote best practices in architecture, governance and data monitoring.
Requirements
- Strong experience with data infrastructure ecosystems: Trino, AWS Glue, Terraform, CI/CD, Apache Airflow, Kafka and Spark on Kubernetes.
- Proven experience with cloud computing (AWS).
- Advanced proficiency in Python (including PySpark) and object-oriented programming.
- Demonstrated experience with distributed systems, data warehouses and large-scale ETL/ELT pipelines.
- Practical knowledge of data governance, security and storage (e.g., S3, Redshift).
- Analytical skills and problem-solving with a focus on operational efficiency.
- Good communication skills and experience working collaboratively.
- Certifications such as AWS Certified Solutions Architect or similar (preferred).
- Familiarity with Trino for ad-hoc analysis (preferred).
- Experience with monitoring tools like Datadog or New Relic (preferred).
- Knowledge of data-applied AI, particularly RAG (Retrieval-Augmented Generation) (preferred).
Benefits
- Competitive compensation based on experience;
- Opportunities for growth within the company and participation in strategic projects;
- Dynamic and challenging work environment;
- Opportunity to work at a growing company in the market.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonPySparkTerraformCI/CDApache AirflowKafkaSparkdata warehousesETLELT
Soft Skills
analytical skillsproblem-solvingcommunication skillscollaboration
Certifications
AWS Certified Solutions Architect