Compass

AWS Data Engineer

Compass

full-time

Posted on:

Location Type: Remote

Location: Brasil

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AirflowAWSBigQueryGoogle Cloud PlatformKafkaKubernetesMongoDBOracleSQL

About the role

  • Integration and ingestion of new data into the Data Lake and improvement of existing pipelines;
  • Responsible for understanding the needs of client teams;
  • Defining solutions within the client's processes and tools;
  • Negotiating priorities and deadlines and managing assigned activities (schedule and quality).

Requirements

  • Education: Degree (or in progress) in Computer Science, Computer Engineering, Information Systems, Software Engineering, Data Science or a similar field;
  • Experience with GCP (Google Cloud Platform);
  • Strong proficiency in Python;
  • Proficiency in SQL/MQL (mainly for Oracle, MongoDB, BigQuery);
  • Experience integrating data from multiple sources;
  • Databases (structured and semi-structured); Kafka; APIs; files (CSV, JSON);
  • Airflow for workflow orchestration;
  • Proficient in using Git for code versioning;
  • Practical experience using AI agents for process automation (desirable);
  • Knowledge of Kubernetes;
  • Experience with DBT and data modeling;
  • Data engineering experience in an AWS environment.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonSQLMQLGCPKafkaAPIsAirflowGitDBTdata modeling
Soft Skills
negotiating prioritiesmanaging activitiesunderstanding client needs