FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates strong capabilities in Python programming, clean coding practices, and debugging within service codebases. Proficient in LLM applications, agent frameworks, and observability tools, with a focus on evaluation and optimization.
Highest-signal resume keywords
Python ProgrammingLLM Application BasicsAgent Framework ExperienceEvaluation FrameworksObservability Tools
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonClean CodingDebuggingTestingAsync ProgrammingTool/Function CallingRAGIntent RoutingIntegration TestingQuery Rewrite
Soft Skills
Eager to Iterate on FeedbackReasoning about Correctness
Tools & Technologies
AgentScopeLangChainLlamaIndexOpikKafkaRedisS3DockerK8sApollo
Industry Keywords
Agent RuntimeTool/Skill OrchestrationEvaluationObservabilityGuardrailsLatency Optimization
Tech Stack
Tools & technologiesApolloDockerKafkaKubernetesPythonRedis
About the role
Key responsibilities & impact- Build and improve pieces of the agent runtime: intent routing, query rewrite, RAG/FAQ answering, tool/skill orchestration (L0–L6 loop).
- Extend the Tool Server — add and optimize tools (web search, market data, report APIs), improve tool-call efficiency and output quality.
- Strengthen evaluation: write eval datasets and harnesses, measure intent-routing accuracy and answer quality, catch regressions before release
- Improve observability: traces, metrics, logging (Opik/Pinpoint), production dashboards and alerts.
- Fix bugs across the pipeline (routing, skill loading, guardrail false-triggers) and write integration tests with mock-LLM cassette replay.
Requirements
What you’ll need- Solid Python and clean coding habits; comfortable in a real service codebase with CI, code review, and typing.
- Understanding of LLM application basics — prompting, RAG, tool/function calling, or agent frameworks (from coursework, projects, or internships).
- Able to reason about correctness and write tests; debug across async/services.
- Available for a sustained internship and eager to iterate quickly on feedback.
- Experience with an agent framework (AgentScope / LangChain / LlamaIndex or similar).
- Familiarity with vector search / embeddings, evaluation frameworks (Opik, ragas), or LLM observability.
- Exposure to Kafka, Redis/Lindorm, S3, config systems (Apollo), or Docker/K8s.
- Interest in evaluation, guardrails/safety (prompt-attack defense), or latency/cost optimization.
Benefits
Comp & perks- Competitive salary and company benefits
- Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
