Gcore

Software Engineer, Python, Kubernetes, AI/ML

Gcore

full-time

Posted on:

Location Type: Remote

Location: Cyprus

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

CloudDistributed SystemsDockerGoKubernetesPythonPyTorchTensorflow

About the role

  • Contribute to the development of the Everywhere Inference platform - a Kubernetes-based solution enabling scalable and portable AI inference across a wide range of environments.
  • Design and implement APIs and developer tools to simplify deployment, management, and monitoring of AI applications.
  • Focus on packaging and integrating new ML models into the platform, using Python and common ML frameworks.
  • Optimize serverless container workflows for AI workloads, ensuring performance, scalability, and seamless autoscaling.
  • Collaborate with customers to fine-tune ML model performance and support their unique use cases.
  • Work with cross-functional teams to improve the AI applications marketplace and ensure smooth model onboarding and lifecycle management.
  • Stay current with trends in Kubernetes, machine learning, and MLOps, and help drive innovation within the platform.

Requirements

  • Proficiency with Python, especially in the context of ML tooling or backend development.
  • Experience with AI/ML pipelines or integrating machine learning frameworks like TensorFlow or PyTorch into production environments.
  • Hands-on experience with vLLM and SGLang
  • Familiarity with cloud-native tooling such as Docker, Helm, and related CNCF technologies.
  • A problem-solving mindset and genuine interest in working on distributed systems and platform-level challenges.
  • Clear communication skills and a collaborative attitude - you enjoy working closely with others to build great solutions.
  • Solid experience with Go programming, particularly in the context of Kubernetes - including building controllers, operators, and working with custom resources (CRDs). (Nice to Have)
  • Strong understanding of Kubernetes architecture, container orchestration, and resource management at scale. (Nice to Have)
  • Understanding of GPU scheduling and performance optimization in Kubernetes. (Nice to Have)
  • Awareness of Kubernetes security practices, including RBAC and container hardening. (Nice to Have)
  • Contributions to open-source projects or involvement in cloud-native or MLOps communities. (Nice to Have)
Benefits
  • Competitive compensation
  • Flexible working hours and hybrid or remote options, depending on your role
  • Work from anywhere in the world for up to 45 days per year
  • Private medical insurance for you and your family*
  • Extra paid vacation and sick leave days*
  • Support for life’s important moments and celebrations
  • Language courses to help you connect and grow
  • Modern, welcoming offices with snacks, drinks, and entertainment*
  • Team sports and social activities*
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonTensorFlowPyTorchvLLMSGLangGo programmingKubernetescontainer orchestrationGPU schedulingperformance optimization
Soft Skills
problem-solvingcollaborative attitudeclear communication