Tech Stack
CloudKubernetesOpen SourcePythonSQLTerraform
About the role
- Design and build a scalable AI platform that helps users solve real business problems with LLMs
- Develop infrastructure to support thousands of LLM applications, processing millions of documents and handling 100s of user requests per second
- Own backend features end to end—from architecture and CI/CD to testing, monitoring, and customer feedback
- Collaborate with the Open Source team to improve and contribute to Haystack
- Partner with the infrastructure team on performance, observability, and debugging
- Help resolve high-priority production issues with customer-facing impact
- Improve reliability by maintaining strong debugging tools and processes
- Mentor other engineers and support their technical growth
Requirements
- 5+ years of backend development experience, ideally in Python
- Strong knowledge of REST APIs, SQL databases, CI/CD, Kubernetes, and cloud services
- Experience with Infrastructure-as-Code tools (e.g., Terraform or Crossplane)
- Proven ability to write clean, testable, observable, and maintainable code
- Skilled at fast troubleshooting in high-pressure, cross-functional settings
- Comfortable dealing with customer-facing production issues
- Proactive, collaborative, and aligned with team-wide decisions
- (Nice to have) Experience in early-stage or high-growth startups
- (Nice to have) Familiarity with open-source development
- (Nice to have) Background in NLP, machine learning, or LLM technologies
- (Nice to have) Exposure to building or scaling B2B SaaS products