С++ / СUDA developer
Eqvilent
Linux
Software Engineer, Compute Architecture
NVIDIA
full-time
Posted on:
Origin: • 🇨🇳 China
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
Python
About the role
- Work on the TRTLLM project to accelerate LLM inference using GPU technology
- Develop and optimize software solutions to accelerate LLM inference on GPUs
- Collaborate closely with a world-class team of engineers to implement and refine GPU-based algorithms
- Analyze and determine the most effective methods to improve performance across diverse computing environments
- Influence deployments from single PCs to clusters with thousands of GPUs
- Engage in individual and team projects and implement groundbreaking AI solutions in an empowering and inclusive environment
Requirements
- 5+ working years' experience in software engineering, particularly in GPU programming and LLM inference
- Strong proficiency in Python, C++, and CUDA
- Solid understanding of deep learning frameworks and techniques
- Outstanding problem-solving skills and the ability to work collaboratively in a team setting
- Ambitious approach with a proven track record of taking initiative and delivering results
- BS or above degree in Computer Science, Engineering, or a related field, or equivalent experience
