Keyrus

Senior Data Engineer – AWS

Keyrus

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAmazon RedshiftApacheAWSDynamoDBETLMongoDBMySQLNoSQLPostgresPySparkPythonScalaSparkSQL

About the role

  • Develop, maintain and optimize data pipelines (ETL/ELT)
  • Design and evolve modern data architectures
  • Process large volumes of data with Spark/PySpark
  • Ensure data quality, governance and security
  • Orchestrate pipelines using Airflow
  • Collaborate with data scientists, analysts and business stakeholders
  • Document solutions and share best practices
  • Perform troubleshooting, debugging and performance optimization

Requirements

  • Fluent English
  • AWS: experience with S3, Glue, Redshift, Athena and Kinesis
  • Databricks: advanced experience
  • Experience with distributed data environments
  • Apache Spark / PySpark
  • Python and/or Scala
  • Advanced SQL
  • Apache Airflow
  • Git / GitHub
  • CI/CD
  • Relational databases: PostgreSQL, MySQL
  • NoSQL: DynamoDB, MongoDB
Benefits
  • Culture of equality
  • Diversity and inclusion
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
ETLELTApache SparkPySparkPythonScalaAdvanced SQLApache AirflowCI/CDRelational databases
Soft Skills
collaborationcommunicationtroubleshootingdebuggingperformance optimization