Quantiphi

Senior Backend Engineer – AI, LLM Integration

Quantiphi

full-time

Posted on:

Location Type: Remote

Location: Canada

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzureCloudDjangoDockerFlaskJavaKubernetesNoSQLPythonSpringSpring BootSpringBootSQL

About the role

  • Design and implement complex, multi-step LLM workflows and "chains" to automate business logic.
  • Build and maintain high-performance backend services using either Java or Python.
  • Containerize and deploy services to Kubernetes (AKS), ensuring they are resilient and scalable.
  • Connect backend services with various AI providers (OpenAI, Azure AI, Anthropic, etc.) and Vector Databases.
  • Implement monitoring and logging specifically for AI workloads to track model performance, latency, and "hallucination" rates.

Requirements

  • 7+ years of professional experience in Java (Spring Boot) or Python (FastAPI/Flask/Django).
  • Proven experience integrating LLMs into production environments.
  • Hands-on experience with LangChain, LangGraph, LlamaIndex, or similar frameworks for managing multi-step AI prompts and state.
  • Strong experience with Kubernetes (Azure Kubernetes Service / AKS preferred).
  • Comfortable with Docker, CI/CD pipelines, and cloud-native architecture.
  • Familiarity with Vector Databases (e.g., Pinecone, Weaviate, Milvus) and traditional SQL/NoSQL databases.
  • Experience with LLM Observability tools (e.g., LangSmith, Arize Phoenix, Weights & Biases).
  • Knowledge of RAG (Retrieval-Augmented Generation) patterns and optimization.
  • Understanding of prompt engineering best practices and model evaluation techniques.
Benefits
  • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.
  • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.
  • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.
  • Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
JavaSpring BootPythonFastAPIFlaskDjangoKubernetesDockerCI/CDLLM integration