Tech Stack
AirflowAWSCloudDynamoDBETLPythonSparkSQL
About the role
- Developing, designing and maintaining data and BI solutions
- Upgrading existing technical solutions
- Optimizing existing ETL
- Creating code in line with the defined engineering standard
- Working in a SCRUM based environment
Requirements
- 5+ years of relevant Data and BI Experience
- 4+ years of experience with any cloud platform (preferable AWS)
- A proven track record of working with a tech or similar business team
- A proven track record of designing and detailed understanding of industry standards and norms across data and BI, including but not limited to ETL, data & dimensional modelling, performance tuning, reporting and visualization
- Experience with SQL and Python
- Experience in managing big datasets (either through MPP databases or data lake architecture)
- Experience in large-scale solution design and architecture
- English C1+
- Will be a plus: Experience with Serverless development
- Experience with python, SQL, spark, lambda, step functions, DynamoDB, S3, API gateway, SQS/SNS, event bridge, Dremio
- Data lake or any other experience with ETL design and big data
- Experience in data mesh concept
- Experience with Airflow
- Experience with unit/integration and performance testing
- Experience with IAC