NVIDIA

Deep Learning Engineer, LLM Accuracy Evaluation

NVIDIA

full-time

Posted on:

Location Type: Remote

Location: Switzerland

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

SeniorLead

Tech Stack

DockerLinuxMicroservices

About the role

  • Collaborate closely with our partners and the open-source community to deliver their flagship models as highly optimized NVIDIA Inference Microservices (NIM).
  • Research and develop innovative deep learning methodologies to accurately evaluate new model families across diverse domains.
  • Analyze, influence, and enhance AI/DL libraries, frameworks, and APIs, ensuring consistency with the best engineering practices.
  • Research, prototype, and build robust tools and infrastructure pipelines to support our ground-breaking AI initiatives.

Requirements

  • BS, MS, or PhD in Computer Science, AI, Applied Math, or a related field, or equivalent experience.
  • 10+ years of hands-on experience in AI for natural language processing (NLP) and large language models (LLMs).
  • Strong problem-solving, debugging, performance analysis, test design, and documentation skills.
  • Solid mathematical foundations and expertise in AI/DL algorithms.
  • Excellent written and verbal communication skills, with the ability to work both independently and collaboratively in a fast-paced environment.
  • Experience in accuracy evaluation of LLMs (OpenLLM Leaderboard or HELM).
  • Hands-on experience with inference and deployment environments like TensorRT, ONNX, or Triton.
  • Passion for DevOps/MLOps practices in deep learning product development.
  • Experience running large-scale workloads in high-performance computing (HPC) clusters.
  • Strong understanding of Linux environments and containerization technologies like Docker.
Benefits
  • NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
deep learning methodologiesnatural language processinglarge language modelsAI/DL algorithmsperformance analysistest designdebuggingmathematical foundationsinference and deployment environmentsaccuracy evaluation
Soft Skills
problem-solvingdocumentation skillswritten communicationverbal communicationcollaborationindependenceadaptabilityfast-paced environment
Certifications
BS in Computer ScienceMS in Computer SciencePhD in Computer Scienceequivalent experience