Lead Backend Engineer, Cloud Heavy
ClanX
AirflowApacheAWSAzureCloudDockerETLGoogle Cloud PlatformKafkaKubernetesMicroservicesNoSQL+2 more
Job Level
Senior
Tech Stack
AirflowApacheAWSAzureCloudDockerETLGoogle Cloud PlatformNoSQLPythonRedisSQL
About the role
- Build shippable software following Engineering standards
- Build and maintain key Engineering blocks (APIs, Big Data implementations)
- Support and extend current stack with new features
- Work on ad-hoc R&D projects
- Collaborate with client’s BI users, operations and development teams
- Ensure deliveries are on time and of required quality
- Maintain company’s data assets quality
- Design and build solid, efficient, stable APIs
- Maintain high standard of code
- Keep up to date with latest technologies and methodologies
- Ensure globally robust and scalable development practices
- Enforce best practices in code quality and process design
Requirements
- Python development skills
- Ability to implement ETL data pipelines in Python
- Creating REST APIs
- Advanced SQL scripting knowledge
- Experience with Google Cloud Platform, AWS or Azure
- 2+ years of experience in data or software development
- Knowledge of big data platforms
- Knowledge of relational databases
- Knowledge of technologies: Git, Docker, Bash language
- Ability to propose, design and implement a simple ETL solutions both in batch and real-time
- Understanding of continuous delivery pipeline and ability to design a process
- Ability to pick the correct technology for the correct task
- Desirable: Experience with DBT, Google Dataflow or Apache Beam, Airflow, NoSQL databases like Redis and Elastic Search
Similar jobs on JobTailor
Senior Data Engineer, Snowflake
Data Ideology, LLC
AirflowAWSAzureCloudETLGoogle Cloud PlatformInformaticaPythonSQL
Senior Data Engineer
KEENFOLKS
AirflowAmazon RedshiftApacheAWSAzureBigQueryDockerETLFlaskJavaJenkinsKafka+11 more
Senior Data Developer
CI&T
AirflowApacheAzureCloudETLPythonSparkSQL
Senior Data Engineer
Rearc
AirflowAmazon RedshiftApacheAWSCloudDynamoDBETLKafkaKubernetesNoSQLNumpyPandas+6 more