FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Senior Software Engineer – AI Build and Deployment
Compliance & RisksSenior Software Engineer responsible for building and deploying AI solutions into applications. Collaborating with team on production-grade pipelines and engineering excellence practices.
Tech Stack
Tools & technologiesAWSDistributed SystemsKubernetesNode.jsPythonTerraformTypeScript
About the role
Key responsibilities & impact- Design and build production-grade AI/LLM processing pipelines with a focus on reliability, throughput, and unit economics
- Own observability for AI workloads end-to-end
- Build and maintain the deployment and runtime infrastructure for these pipelines on AWS
- Establish CI/CD for AI services and models: automated testing, regression evals, safe rollouts and rollback paths
- Drive engineering excellence in the AI team — pipeline architecture patterns, versioning of prompts/models/datasets, reproducibility
- Partner with SRE, Platform, and Product Engineering to harden shared services
- Mentor engineers on building maintainable, testable AI systems; raise the bar on code review, design documents
Requirements
What you’ll need- 7+ years building production distributed systems
- at least 2+ years operating AI/ML or LLM-based pipelines at scale
- Deep experience with AWS (EKS/Kubernetes, Lambda, Step Functions, event-driven patterns)
- Terraform or AWS CDK as a primary delivery mechanism
- Strong proficiency in Python (and ideally TypeScript/Node) with production patterns for async processing, backpressure, retries, and idempotency
- Proven track record with observability stacks (especially LGTM) applied specifically to probabilistic/LLM systems — evals, drift, hallucination detection, cost/latency SLOs
- Experience integrating with foundation model providers (Anthropic, OpenAI, Gemini) and/or self-hosted inference, including prompt management, caching, and guardrails
- Experience with vector stores, embeddings pipelines, and retrieval evaluation
- Helpful to have experience with workflow tools like Argo or Dagster
Benefits
Comp & perks- flexible working hours
- time to take care of your physical and emotional well-being
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI processing pipelinesLLM processing pipelinesproduction distributed systemsAWSTerraformAWS CDKPythonTypeScriptobservability stacksvector stores
Soft Skills
mentoringengineering excellencecode reviewdesign documentation