AI Platform Engineer

DATAGROUP

AI Platform Engineer building DATAGROUP’s sovereign LLM platform, RAG services, and cloud-native infrastructure. Operating Kubernetes, CI/CD, Linux, databases, and AI services.

Posted 9/3/2026full-timeRemote • 🇩🇪 GermanyMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and operating LLM platforms, with a strong focus on containerization, CI/CD processes, and cloud infrastructure management. Proficient in ensuring data protection and compliance while enhancing platform architecture and performance monitoring.

Highest-signal resume keywords

LLM Platform DevelopmentKubernetes ExpertiseCI/CD Pipeline ManagementDocker ProficiencyCloud Infrastructure Management

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonPostgreSQLVector DatabasesModel ServingRAG ArchitecturesContainer-Based ApplicationsInfrastructure as CodeMonitoring SolutionsData Protection ComplianceAI Services

Soft Skills

Independent Working StyleStructured ApproachHigh OwnershipSecurity Awareness

Tools & Technologies

AzureLinuxCoolifyDockerKubernetes

Industry Keywords

DevOpsPlatform EngineeringCloud EnvironmentsAI ServicesTenant Isolation

Tech Stack

Tools & technologies

AzureCloudDockerKubernetesLinuxPostgresPython

About the role

Key responsibilities & impact

Develop and operate a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure
Implement customer-specific knowledge integrations (RAG) using vector databases, embeddings, and reranking
Ensure cost control, tenant isolation, data protection, and guardrails
Establish monitoring and observability for the performance, quality, and usage of AI services
Further develop the container-based platform using Docker, Coolify, and Kubernetes
Automate deployments and take ownership of CI/CD processes
Manage Linux, cloud, and database infrastructure while ensuring stability, security, and availability
Build and enhance monitoring, logging, and alerting solutions
Actively shape the architecture of platform and AI services
Establish Infrastructure as Code and standardized deployment processes
Ensure data protection-compliant and tenant-secure operating models
Document solutions, share knowledge across the team, and evaluate new technologies in platform engineering and AI

Requirements

What you’ll need

Degree in Computer Science, Business Informatics, or a comparable qualification
Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments
Strong hands-on experience operating container-based applications and modern platforms
Experience building and running LLM and AI services in production, ideally in self-hosted environments
Advanced knowledge of Kubernetes, Docker, and Linux
Experience with CI/CD pipelines, cloud platforms—particularly Azure—and PostgreSQL
Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions
Solid Python skills for automation and integrations
Independent and structured working style, with a high degree of ownership and strong awareness of security and data protection
Strong understanding of architecture and platform engineering

Benefits

Comp & perks

Open and collaborative company culture
Trust-based working environment
Comprehensive onboarding with support from the entire AIS team
Flat hierarchies, short decision-making processes, and a high degree of freedom to shape your work
Strategic role with significant influence over the future platform landscape
Opportunity to work on sovereign LLM hosting and AI infrastructure
Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies
Opportunity to actively shape standards, processes, and architectural decisions
Individual professional development budget for conferences, certifications, and specialist training
Clear career and development paths
Opportunity to specialize as an AI Platform Engineer or LLMOps expert
Small, focused, and agile team
Open feedback culture with regular one-on-one meetings and retrospectives