
Senior Data Engineer
Extractta
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
Job Level
About the role
- Design, develop and support robust data infrastructure solutions with a focus on scalability, security and efficiency.
- Lead the implementation and maintenance of ecosystems such as Trino, AWS Glue, Redshift, Airflow, Kafka and Spark on Kubernetes (K8s).
- Collaborate with engineering, data science and product teams to ensure seamless integration between systems.
- Diagnose and resolve performance, scalability and reliability incidents.
- Apply and promote best practices for data architecture, governance and monitoring.
Requirements
- Strong experience with data infrastructure ecosystems: Trino, AWS Glue, Terraform, CI/CD, Apache Airflow, Kafka and Spark on Kubernetes.
- Advanced proficiency in Python (including PySpark) and object-oriented programming.
- Proven experience with distributed systems, data warehouses and large-scale ETL/ELT pipelines.
- Practical experience or working knowledge of Databricks (workspaces, jobs, notebooks and Spark integration).
- Hands-on knowledge of data governance, security and storage (e.g., S3, Redshift).
- Strong analytical and problem-solving skills with a focus on operational efficiency.
- Good communication skills and experience working collaboratively.
- **Preferred:**
- Certifications such as AWS Certified Solutions Architect or similar
- Familiarity with Trino for ad-hoc analytics.
- Experience with monitoring tools such as Datadog or New Relic
- Knowledge of AI applied to data, especially RAG (Retrieval-Augmented Generation), for analytics and intelligent insight generation projects.
Benefits
- Competitive compensation based on experience;
- Opportunities for growth within the company and participation in strategic projects;
- Dynamic and challenging work environment;
- Opportunity to work at a fast-growing company in the market.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonPySparkTerraformCI/CDApache AirflowKafkaSparkTrinodata warehousesETL/ELT pipelines
Soft Skills
analytical skillsproblem-solving skillsoperational efficiencycommunication skillscollaboration
Certifications
AWS Certified Solutions Architect