
Senior AWS Data Engineer
Compass
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
Job Level
About the role
- Develop and maintain scalable data pipelines on AWS;
- Migrate data and workloads from GCP and on-premises to AWS, ensuring security and data integrity;
- Orchestrate and validate data with Apache Airflow (DAGs);
- Implement real-time streaming pipelines with Apache Kafka;
- Perform data transformations and modeling with DBT, ensuring quality and governance;
- Work with Snowflake for analytical modeling and optimization;
- Monitor performance, driving cost optimization and efficiency;
- Work in containerized environments with Kubernetes;
- Collaborate with technical and business teams to meet requirements and compliance;
- Apply DevSecOps best practices, information security, and data governance.
Requirements
- Strong experience with Apache Airflow;
- Experience with Apache Kafka;
- Experience with DBT;
- Experience with Kubernetes;
- Experience with Snowflake;
- Strong SQL skills (modeling, querying, and optimization);
- Experience in data migration projects to AWS;
- Experience working with large-scale, high-criticality data environments.
- Nice-to-have: Experience with EC2, EKS, and S3 on AWS; knowledge of CloudWatch and IAM; experience with AWS Lambda; familiarity with Docker and containerized environments; experience with GitHub and GitLab; experience working in agile methodologies; knowledge of data security; experience with Terraform (Infrastructure as Code).
Benefits
- Don't meet all the requirements for this role?
- That's okay! At Compass UOL, we encourage continuous development of new talent and turn challenges into opportunities.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Apache AirflowApache KafkaDBTKubernetesSnowflakeSQLdata migrationTerraformDevSecOpsdata transformations
Soft skills
collaborationcommunicationproblem-solvingorganizational skills