Mid/Senior Data Engineer
Compass
AirflowAmazon RedshiftApacheAWSETLHadoopKafkaPythonSparkSQL
Senior Data Engineer
GFT Technologies
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇧🇷 Brazil
Visit company websiteJob Level
Senior
Tech Stack
Amazon RedshiftAWSDynamoDBETLGrafanaJavaKafkaMongoDBMySQLNoSQLPrometheusPySparkPythonSQL
About the role
- Ability to interact with customers to represent AWS within the client environment, participating in discussions with experienced teams about best practices, trade-offs, project management and risk management;
- Solution design focused on data projects;
- Provide visibility into the cost/consumption of the designed solution;
- Demonstrated ability to think strategically about business, product or technical challenges;
- Perform modeling, analysis and compilation of quantitative data;
- Provide guidance and lead problem resolution to develop recommendations based on data interpretation and analysis to influence behaviors and techniques.
Requirements
- Experience in Data Architecture (Medallion Architecture, batch and real-time data ingestion);
- Experience in data collection, transformation and loading (ETL tools);
- Experience working with large volumes of data;
- Advanced knowledge of SQL and programming languages such as Python (PySpark, SparkSQL) or Java;
- Experience with NoSQL databases (MongoDB, DynamoDB);
- Database modeling (Star Schema, Snowflake, etc.);
- Experience with Data Lake and Data Mesh architectures;
- Experience integrating data with other systems;
- Experience with observability tools (Datadog, Grafana, Prometheus);
- Ability to translate problems into scalable architectures;
- Experience with cloud/platform services and tools: API Gateway; Kafka; Kinesis; AWS Lambda; AWS Lake Formation; AWS databases (Redshift, MySQL, DynamoDB, etc.); AWS Athena; AWS Glue (Crawlers, Jobs, Workflows); AWS QuickSight; AWS EMR; AWS Step Functions; AWS SageMaker and Bedrock.
Benefits
- Multi-benefits card – you choose how and where to use it.
- Scholarships for undergraduate, graduate, MBA and language courses.
- Certification incentive programs.
- Flexible working hours.
- Competitive salaries.
- Annual performance review with a structured career plan.
- Opportunity for international career progression.
- Wellhub and TotalPass.
- Private pension plan.
- Childcare allowance.
- Health insurance.
- Dental insurance.
- Life insurance.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Data ArchitectureMedallion ArchitectureETL toolsSQLPythonPySparkSparkSQLNoSQL databasesDatabase modelingData Lake
Soft skills
customer interactionstrategic thinkingproblem resolutiondata interpretationinfluencing behaviors
