Tech Stack
AirflowApacheAWSAzureCloudDockerETLGoogle Cloud PlatformNoSQLPythonRedisSQL
About the role
- Build shippable software following Engineering standards in place
- Build and maintain key Engineering blocks that other teams can rely upon (such as APIs and Big Data implementations)
- Support the current stack and be able to extend it with new features
- Work on ad-hoc R&D projects
- Work closely with the client’s business intelligence users, operations and development teams on projects and CR’s, encouraging a data driven and pragmatic approach to tackling challenges
- Ensure the deliveries are on time and of the required quality
- Maintain the company’s data assets at required quality levels
- Help to design and build solid, efficient, stable APIs
- Help to maintain our high standard of code
- Keep up to date with the latest technologies and methodologies
- Ensure a globally robust and highly scalable approach to development to support our growing number of global users and services
- Enforce best practices in terms of code quality and design of processes
Requirements
- Python development skills
- Ability to implement ETL data pipelines in Python
- Creating REST APIs
- Advanced SQL scripting knowledge
- Experience with Google Cloud Platform, AWS or Azure
- 2+ years of experience in data or software development
- Knowledge of big data platforms
- Knowledge of relational databases
- Knowledge of technologies: Git, Docker, Bash
- Ability to propose, design and implement simple ETL solutions in batch and real-time
- Understanding of continuous delivery pipelines and ability to design processes
- Ability to pick the correct technology for the correct task
- Desirable: Experience with DBT (Data Build Tool)
- Desirable: Experience with Data streams in Google Dataflow or Apache Beam
- Desirable: Experience using Airflow
- Desirable: Experience with NoSQL databases like Redis, Elastic Search