Red Hat

Senior Software Engineer – AI Eval, Safety

Red Hat

full-time

Posted on:

Location Type: Remote

Location: United States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $133,650 - $220,680 per year

Job Level

About the role

  • Lead the architecture and implementation of MLOps/LLMOps systems within OpenShift AI, establishing best practices for scalability, reliability, and maintainability while actively contributing to relevant open source communities
  • Design and develop robust, production-grade features focused on AI trustworthiness, including model monitoring, bias detection, and explainability frameworks that integrate seamlessly with OpenShift AI
  • Drive technical decision-making around system architecture, technology selection, and implementation strategies for key MLOps components, with a focus on open source technologies like KServe and TrustyAI
  • Define and implement technical standards for model deployment, monitoring, and validation pipelines, while mentoring team members on MLOps best practices and engineering excellence
  • Collaborate with product management to translate customer requirements into technical specifications, architect solutions that address scalability and performance challenges, and provide technical leadership in customer-facing discussions
  • Lead code reviews, architectural reviews, and technical documentation efforts to ensure high code quality and maintainable systems across distributed engineering teams
  • Identify and resolve complex technical challenges in production environments, particularly around model serving, scaling, and reliability in enterprise Kubernetes deployments
  • Partner with cross-functional teams to establish technical roadmaps, evaluate build-vs-buy decisions, and ensure alignment between engineering capabilities and product vision
  • Provide technical mentorship to team members, including code review feedback, architecture guidance, and career development support while fostering a culture of engineering excellence
  • Responsible for the safe, auditable, and reliable release of Kubernetes-native AI platform components, with strong emphasis on progressive delivery, operational resilience, and supply-chain integrity.

Requirements

  • 5+ years of software engineering experience, with at least 4 years focusing on ML/AI systems in production environments
  • Strong expertise in Python, with demonstrated experience building and deploying production ML systems
  • Deep understanding of Kubernetes and container orchestration, particularly in ML workload contexts
  • Extensive experience with MLOps tools and frameworks (e.g., KServe, Kubeflow, MLflow, or similar)
  • Track record of technical leadership in open source projects, including significant contributions and community engagement
  • Proven experience architecting and implementing large-scale distributed systems
  • Strong background in software engineering best practices, including CI/CD, testing, and monitoring
  • Experience mentoring engineers and driving technical decisions in a team environment
Benefits
  • Comprehensive medical, dental, and vision coverage
  • Flexible Spending Account - healthcare and dependent care
  • Health Savings Account - high deductible medical plan
  • Retirement 401(k) with employer match
  • Paid time off and holidays
  • Paid parental leave plans for all new parents
  • Leave benefits including disability, paid family medical leave, and paid military leave
  • Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonMLOpsKubernetesKServeKubeflowMLflowmodel monitoringbias detectionexplainability frameworksCI/CD
Soft Skills
technical leadershipmentoringcollaborationcommunicationproblem-solvingdecision-makingcode reviewarchitectural reviewtechnical documentationengineering excellence