Tech Stack
AirflowApacheDjangoElasticSearchGrafanaJenkinsKafkaKubernetesPostgresPrometheusPythonTerraform
About the role
- Design, build, and maintain a scalable and reliable data platform for company-wide use.
- Implement and enforce data governance policies to ensure data quality, security, and consistency.
- Develop observability frameworks (monitoring, alerting, logging) to ensure system reliability and performance.
- Automate and maintain infrastructure (data warehouses, pipelines, real-time systems) using Infrastructure as Code (IaC).
- Promote best practices across data engineering, governance, and platform operations.
- Create internal tools and libraries to streamline development of data-driven applications.
- Work closely with engineers and stakeholders to ensure data is accessible and well-structured within the platform.
Requirements
- Expert in Python, with experience using FastAPI or Django.
- Proficient in working with databases like Snowflake and PostgreSQL.
- Hands-on experience with Kubernetes and Terraform (IaC).
- Skilled in workflow orchestration (e.g., Airflow, Metaflow) and real-time data tools like Kafka.
- Familiar with container orchestration, GitOps tools (ArgoCD), and CI/CD pipelines (e.g., Jenkins).
- Strong knowledge of observability tools such as Datadog, Grafana, and Prometheus.
- A collaborative team player with excellent communication skills, who thrives in fast-paced, international environments.
- Proactive, driven, and fluent in professional English.
- It would be a plus if you Collaborate effectively in a multidisciplinary team, interacting with roles like data analysts, data scientists, marketing, and product managers to meet project goals and deliver actionable insights.
- Use ClickHouse or TinyBird for real-time analytics.
- Have experience with stream processing frameworks like Apache Flink for real-time data processing and analytics.
- Understand event-driven architectures and their implementation in large-scale data systems.
- Have experience with OpenSearch (or Elasticsearch) for log management, search, and analytics.
- Use BI tools such as Metabase or Superset for data visualization and reporting to support decision-making processes.