LLM Engineer
Vyro
full-time
Posted on:
Location Type: Office
Location: Islamabad • 🇵🇰 Pakistan
Visit company websiteJob Level
Mid-LevelSenior
About the role
- Designing, developing, and fine-tuning LLMs
- Building agentic AI workloads
- Implementing data-driven algorithms
- Deploying scalable solutions
- Collaborating closely with cross-functional teams to integrate machine learning capabilities into products
- Exploring new methods to enhance performance, reliability, and efficiency
Requirements
- 4+ years of industry experience in Machine Learning or NLP
- Bachelor’s degree in Computer Science (BSCS) or a related field
- Frontier Model Orchestration
- Deep experience leveraging closed-source SOTA models from OpenAI, Anthropic, Google, and xAI
- Strong understanding of complex reasoning, tool-use, and multi-step AI pipelines
- Advanced Architectures
- Expert grasp of transformer variants and Mixture-of-Experts (MoE) architectures
- Proven hands-on experience with open-weight SOTA models such as Llama 3.x, Mistral Large, Qwen 2.5, Phi-4, etc.
- Agentic Frameworks
- Mastery of multi-agent orchestration using frameworks like LangGraph (stateful agents), AutoGen, or CrewAI
- Experience implementing DSPy for declarative, self-optimizing prompt pipelines
- Production RAG & Memory Systems
- Implementation experience with GraphRAG and hybrid retrieval strategies
- Expertise with vector stores (Qdrant, Milvus, Weaviate) and semantic caching for long-term agent memory
- Inference Optimization
- Experience deploying high-throughput models using vLLM, TensorRT-LLM, or SGLang
- Familiarity with FlashAttention-2, KV caching, and quantization techniques (AWQ, EXL2)
Benefits
- Competitive salary and benefits package
- A growth-driven culture that encourages learning, ownership, and continuous improvement
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
machine learningnatural language processingdata-driven algorithmsLLMstransformer variantsMixture-of-Experts architecturesmulti-agent orchestrationinference optimizationDSPyhybrid retrieval strategies
Soft skills
collaborationcross-functional teamwork