Anyscale

Full-stack Engineer

• Leading cross-team projects while mentoring junior team members
• Develop high quality open source software to simplify distributed programming (Ray)
• Identify, implement, and evaluate architectural improvements to Ray core
• Improve the testing process for Ray to make releases as smooth as possible
• Communicate your work to a broader audience through talks, tutorials, and blog posts

Software Engineer – Ray Core

Engineer

• Iterate very quickly with product teams to ship the end to end solutions for Batch and Online inference at high scale which will be used by open-source Ray users and customers of Anyscale
• Work across the stack integrating Ray Data and LLM engine providing optimizations achieving low cost solutions for large scale ML inference
• Integrate with Open source software like vLLM, work closely with the community to adopt these techniques in Anyscale solutions, and also contribute improvements to open source
• Follow the latest state-of-the-art in the open source and the research community, implementing and extending best practices

Distributed LLM Inference Engineer

Security Engineer

• Partner with product and engineering teams to architect secure products, providing security guidance, requirements, and guardrails throughout the development process
• Own product and infrastructure security, including secure architecture design, cloud provider configuration, threat modeling, and incident response planning
• Work closely with engineering teams to integrate security into the development lifecycle and provide the context needed to avoid introducing security risks
• Oversee corporate security fundamentals, including endpoint protection, access management, and tool security
• Support compliance certification efforts from a security and risk perspective (e.g., SOC 2, HIPAA, ISO 27001)