Compass

Senior Data Engineer, Apache Airflow – MWAA

Compass

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAmazon RedshiftApacheAWSSparkTerraform

About the role

  • Provide technical leadership (hands-on) for delivering the functional pipeline for three priority workloads;
  • Ensure alignment with the MDIC/Proserv reference architecture and with dependencies between services;
  • Design and implement data modeling in the final layer (BI Serving Layer / Gold) using a dimensional approach for consumption in Redshift;
  • Define and implement standards for quality, traceability, and governance, including versioning via metadata in Glue Data Catalog and access policies via Lake Formation (row/column-level, where applicable);
  • Deliver with disciplined execution (short PoC) and strong troubleshooting ability in AWS environments.

Requirements

  • Solid experience with AWS Data & Analytics;
  • Hands-on experience with Amazon S3 and Lakehouse architecture;
  • Experience with Apache Iceberg (schema evolution, versioning);
  • Pipeline orchestration with MWAA / Apache Airflow;
  • Development of transformations with AWS Glue (Spark);
  • Experience with Terraform (IaC);
  • Use of AWS Glue Data Catalog;
  • Data governance with AWS Lake Formation;
  • Analytical consumption via Amazon Athena and/or Amazon Redshift;
  • Dimensional data modeling (Star Schema);
  • Ability to work autonomously in AWS environments;
  • Desired: Snowflake, Data Model Management / Data Modeling.
Benefits
  • 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
AWS Data & AnalyticsAmazon S3Lakehouse architectureApache IcebergMWAAApache AirflowAWS GlueTerraformAWS Glue Data CatalogAmazon Athena
Soft Skills
technical leadershiptroubleshootingautonomydisciplined execution