Compass

Senior AWS Data Engineer

Compass

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

AI Apply
Apply

Job Level

About the role

  • Develop and maintain scalable data pipelines on AWS;
  • Migrate data and workloads from GCP and on-premises to AWS, ensuring security and data integrity;
  • Orchestrate and validate data with Apache Airflow (DAGs);
  • Implement real-time streaming pipelines with Apache Kafka;
  • Perform data transformations and modeling with DBT, ensuring quality and governance;
  • Work with Snowflake for analytical modeling and optimization;
  • Monitor performance, driving cost optimization and efficiency;
  • Work in containerized environments with Kubernetes;
  • Collaborate with technical and business teams to meet requirements and compliance;
  • Apply DevSecOps best practices, information security, and data governance.

Requirements

  • Strong experience with Apache Airflow;
  • Experience with Apache Kafka;
  • Experience with DBT;
  • Experience with Kubernetes;
  • Experience with Snowflake;
  • Strong SQL skills (modeling, querying, and optimization);
  • Experience in data migration projects to AWS;
  • Experience working with large-scale, high-criticality data environments.
  • Nice-to-have: Experience with EC2, EKS, and S3 on AWS; knowledge of CloudWatch and IAM; experience with AWS Lambda; familiarity with Docker and containerized environments; experience with GitHub and GitLab; experience working in agile methodologies; knowledge of data security; experience with Terraform (Infrastructure as Code).
Benefits
  • Don't meet all the requirements for this role?
  • That's okay! At Compass UOL, we encourage continuous development of new talent and turn challenges into opportunities.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Apache AirflowApache KafkaDBTKubernetesSnowflakeSQLdata migrationTerraformDevSecOpsdata transformations
Soft skills
collaborationcommunicationproblem-solvingorganizational skills