Alpheya

Lead Data Engineer

Alpheya

full-time

Posted on:

Location Type: Hybrid

Location: Abu Dhabi • 🇦🇪 United Arab Emirates

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowDjangoDockerETLGrafanaGraphQLKafkaKubernetesPostgresPrometheusPythonRabbitMQTerraform

About the role

  • Leadership: Lead a team of 2-3 Data Engineers to deliver production ready ETL pipelines and APIs exposing RAG and Agents capabilities.
  • Market-Data ETL Pipelines: Implement, test, and improve scalable ETL workflows that handle large volumes of data.
  • Async Orchestration & Scheduling: Develop and maintain task queues with Async tools, helping the team meet SLAs and surface operational metrics.
  • API Implementation: Build REST endpoints with FastAPI Framework, providing clean CRUD access to market data and configuration entities.
  • Observability & Reliability: Add structured logs, traces, and metrics; contribute alerts and dashboards (Prometheus/Grafana, OpenTelemetry) that keep services at 99.9 % + availability.
  • Code Quality & Best Practices: Write type-safe, well-tested code, participate in code reviews, and help maintain CI/CD workflows.
  • Cross-Functional Collaboration: Work closely with data scientists, and product managers to translate data requirements into robust backend capabilities.

Requirements

  • Education - Master's degree in Computer Science, Software Engineering, or a related field (or equivalent practical experience).
  • Experience - 5+ years building production Python backends for data-intensive applications.
  • Python Mastery - Modern Python (3.10 +) with asyncio, typing, dependency injection, and packaging best practices.
  • ETL Skills - Experience designing batch or streaming pipelines; comfort with Kafka, RabbitMQ, or similar tools.
  • Database Skills - Strong Postgres knowledge: migrations (Alembic, Django ORM), query tuning, partitioning, backup/restore.
  • Async Orchestration - Hands-on with async tools like Airflow, Dagster, or Celery for scheduling and monitoring jobs.
  • API Engineering - Proven ability to implement secure, versioned REST/GraphQL APIs with auth, rate-limiting, and RBAC.
  • Testing & DevOps - Familiarity with Pytest, Docker, Kubernetes, Terraform, and GitHub Actions (or similar).
  • Soft Skills - Clear written and verbal communication; collaborative mindset.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
ETLPythonasynciotypingdependency injectionPostgresAPI EngineeringtestingDevOpsscalable workflows
Soft skills
leadershipcollaborationcommunicationcode reviewsproblem-solvingteamworkadaptabilitycritical thinkingmentorshiporganizational skills
Certifications
Master's degree in Computer ScienceMaster's degree in Software Engineering