Data Engineer

• Define and drive the technical vision for data platforms that support AI-powered features in Crossplane and Upbound Spaces
• Lead the design of data pipelines that transform infrastructure and data into training datasets for ML models
• Architect vector search and RAG systems that leverage Crossplane Control Planes & Upbound Marketplace as a knowledge store
• Build data infrastructure that processes resources, extensions, and compositions for semantic search
• Establish frameworks for collecting, processing, and analyzing infrastructure configuration data
• Design data pipelines that handle Crossplane-specific data
• Create infrastructure for indexing and searching Upbound Marketplace content, documentation, and community patterns
• Develop metrics and monitoring for AI features integrated with Upbound's control plane architecture
• Design data systems that power AI agents for infrastructure provisioning & operations, helping users generate and optimize Crossplane compositions
• Create feature engineering platforms that extract signals from control plane operations, resource status, and reconciliation patterns
• Implement data infrastructure for training models that predict infrastructure failures, optimize resource allocation, and suggest configuration improvements
• Drive the development of knowledge graph representations of infrastructure dependencies and relationships

Data Engineer · North America Jobs