Senior AWS Data Engineer

Compass

AWS Data Engineer responsible for developing and evolving data integrations. Collaborating on AWS services like Databricks, Glue ETL, and Lambda for a leading AI-driven company.

Posted 7/14/2026full-timeRemote • 🇧🇷 BrazilSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and maintaining AWS-based integrations, focusing on data consumption engines and event-driven architectures. Proficient in Python and Java for API development, with a strong understanding of data governance and security in multi-account environments.

Highest-signal resume keywords

AWS S3AWS GluePython API DevelopmentDatabricks IntegrationEvent-Driven Architecture

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AWS IAMREST API DevelopmentAdvanced SQLDistributed Query EnginesInfrastructure as CodeJavaData VirtualizationData ContractsAWS LambdaAWS Lake Formation

Soft Skills

Team MentoringTechnical Documentation

Tools & Technologies

DatabricksTerraformCloudFormationAWS EMRAmazon Bedrock

Industry Keywords

Data MeshData ProductsFederated GovernanceOpen Data Contract StandardCross-Account Access Policies

Tech Stack

Tools & technologies

AWSEC2ETLJavaPostgresPythonSparkSQLTerraformUnity

About the role

Key responsibilities & impact

Develop new platform integrations with data consumption engines, focusing on Databricks, Glue ETL, and AWS Lambda;
Evolve proprietary APIs and event-driven workflows that support the platform;
Implement and automate provisioning of resources and permissions in a multi-account AWS environment;
Enhance the data virtualization and sharing mechanism between producers and consumers, based on data contracts;
Ensure observability, governance, and security of the platform;
Support producer and consumer teams in using the solution;
Participate in architecture decisions, technical documentation, and team mentoring.

Requirements

What you’ll need

Strong experience with AWS, particularly S3, Glue, Lake Formation, and IAM;
Experience with Databricks, including Unity Catalog and integration with Glue Catalog and Lake Formation;
Proficiency in Python for API development and automation;
Solid knowledge of Java for maintaining APIs and backend services;
Experience developing and maintaining REST APIs in production;
Experience with event-driven architectures using SNS and SQS;
Advanced SQL and experience with distributed query engines (Athena, Presto, Trino, and Spark);
Experience with multi-account AWS environments and cross-account access policies;
Nice-to-haves: knowledge of Data Mesh concepts, Data Products, and federated governance; experience with the Open Data Contract Standard; knowledge of PostgreSQL; experience with Infrastructure as Code (Terraform, CloudFormation, or CDK); experience with EMR (EC2 and Serverless) and Spark workload optimization; familiarity with AWS Lambda for event-driven pipelines; experience with Amazon Bedrock or other generative AI services on AWS.

Benefits

Comp & perks

Position also open to candidates with disabilities (PwD)