Senior Machine Learning Engineer, vLLM

Red Hat

. Contribute to the design, development, and testing of various inference optimization algorithms .

Posted 4/21/2026full-timeRemote • 🇨🇦 CanadaSeniorWebsite

Tech Stack

Tools & technologies

NumpyOpen SourcePythonPyTorch

About the role

Key responsibilities & impact

Contribute to the design, development, and testing of various inference optimization algorithms
Create and manage inference serving deployment pipelines
Benchmark, profile, and evaluate different parallelizations, quantization and sparsification approaches
Stay up-to-date with the latest advancements in the open source LLM model architecture
Stay up-to-date of latest CPU and GPU hardware architecture and features
Give thoughtful and prompt code reviews
Continuous collaboration with internal and external open source comitters and contributors

Requirements

What you’ll need

Strong understanding of machine learning and deep learning fundamentals
Experience in LLM Inference Optimizations, Computer Vision, NLP, and reinforcement learning
Experience with tensor math libraries such as PyTorch and NumPy
Strong programming skills implementing Python based machine learning solutions
Ability to develop and implement research ideas and algorithms
Experience with mathematical software, especially linear algebra
Understanding of Linear Algebra, Gradients, Probability, and Graph Theory
BS, MS, or PhD in computer science or computer engineering or a related field.

Benefits

Comp & perks

Flexible work arrangements
Professional development opportunities

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

inference optimization algorithmsLLM inference optimizationscomputer visionnatural language processingreinforcement learningtensor math librariesPythonlinear algebragradientsgraph theory

Soft Skills

code reviewscollaboration

Certifications

BS in computer scienceMS in computer sciencePhD in computer scienceBS in computer engineeringMS in computer engineeringPhD in computer engineering