Compass

AWS Data Engineer – Tech Lead

Compass

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

ApacheAWSCloudCyber SecurityDockerJavaScriptJenkinsKafkaNode.jsNoSQLPySparkPythonScalaSparkSQL

About the role

  • Design and implement scalable, cloud-native data architectures, including batch and streaming processing engines;
  • Develop, maintain and evolve data pipelines using Python, PySpark, Scala and Apache Spark;
  • Ensure information security and compliance from solution inception (Security by Design), applying DevSecOps practices and Data Governance;
  • Work in agile environments (Scrum, Kanban or SAFe), collaborating closely with Product Owners, Architects and other developers;
  • Implement and manage infrastructure as code (Infrastructure as Code – IaC), ensuring standardization, traceability and scalability of environments.

Requirements

  • Advanced proficiency in Python, Node.js, Scala and SQL/NoSQL, with experience in event-driven architectures (Event-Driven Architecture);
  • Experience with Apache Spark and Apache Kafka; knowledge of Talend will be considered a plus;
  • Strong experience with AWS; platform certifications are considered a valuable differentiator;
  • Familiarity with Docker, Git, Jenkins and Infrastructure as Code (IaC) practices;
  • Knowledge of Cyber Security, with an understanding of information security best practices applied to data and cloud environments.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonPySparkScalaApache SparkSQLNoSQLEvent-Driven ArchitectureAWSDockerInfrastructure as Code
Soft Skills
collaborationagile methodologiescommunication
Certifications
AWS certifications