Guild.ai

AI Engineer

• Create Task Evaluations That Matter: Design and implement task-specific evaluations that measure and improve agent quality. Each eval should both drive concrete iteration on our agents and spark broader innovation around the task itself.
• Define Tasks, Datasets, and Harnesses: Clearly specify tasks, collect and curate balanced datasets, and build robust evaluation harnesses that can be used across agents and modeling approaches. There is ample room for architectural design and systems thinking here.
• Build and Use a Reusable Evaluation Framework: Develop frameworks and tools for running evaluations at scale. Use these frameworks to tune existing agents and to guide the development of new ones in our environment.
• Explore Agent Orchestration Strategies: Investigate and implement orchestration patterns (tooling, routing, decomposition, multi-agent setups, etc.) that allow agents to tackle increasingly complex, multi-step, and long-horizon tasks.
• Apply Post-Training Techniques: Experiment with post-training approaches (e.g., fine-tuning, preference optimization, reward shaping, distillation) to produce high-performance models tailored to specific tasks and workflows.
• Run Experiments End-to-End: Design, run, and analyze experiments with rigor. Turn experimental results into clear recommendations and concrete changes to model configurations, prompts, and system design.
• Collaborate Deeply Across the Stack: Work closely with founders, product, and infrastructure engineers to ensure evaluations, agents, and platform primitives all reinforce each other.

AI Engineer, Agents – Evaluation

Data Scientist

• Define What “Good” Means: Partner with founders, engineering, and design to define product KPIs and quality metrics—especially around AI behaviors (helpfulness, correctness, reliability, latency, cost, user trust).
• Build the Measurement Foundation: Establish event taxonomy, instrumentation standards, and core datasets. Ensure we can answer product questions quickly and confidently.
• Create AI Evaluation & Monitoring Systems: Develop offline/online evaluation approaches for agentic workflows (e.g., golden sets, human review loops, heuristic + model-based scoring, regression detection, error taxonomies).
• Run Experiments That Change Decisions: Design and analyze A/B tests and quasi-experiments; bring statistical rigor to iteration speed.
• Turn Insight into Action: Produce analyses, narratives, and recommendations that directly shape roadmap tradeoffs and product direction.
• Enable Self-Serve Analytics: Build dashboards and lightweight tooling that help the entire team understand usage, performance, and customer outcomes.
• Be a Cross-Functional Glue Layer: Work tightly with engineering on logging/telemetry, with PM on prioritization, and with GTM/customer conversations to connect product behavior to real-world impact.
• Define Data Science at Guild.ai: Establish best practices for metrics, experimentation, and decision-making frameworks that scale as the team grows.

• Build the First Production Agents: Design, implement, and ship some of the earliest agents built on the Guild.ai platform—agents that developers will use to understand, debug, and evolve complex software systems.
• Push the Platform by Using It: Act as both power user and core contributor: use our platform to build agents, then feed your experience back into the platform’s APIs, abstractions, and UX.
• Own Agent Workflows End-to-End: Take agents from idea → prototype → production: task scoping, architecture, prompts, tools, integrations, logging, and iteration based on real-world behavior.
• Integrate Deeply with Real Developer Environments: Connect agents to source control, CI/CD, observability, and other components of modern engineering stacks so they can operate on real code and real systems.
• Make Agents Reliable, Safe, and Observable: Implement guardrails, monitoring, and debugging tooling so we can understand what agents are doing, why they’re doing it, and how to improve them.
• Collaborate Closely with Product & Evaluation: Work with PMs and evaluation/ML teammates to define agent behaviors, success metrics, and iteration loops. Use evaluation harnesses and telemetry to guide improvements.
• Shape the Agent Engineering Practice at Guild.ai: Help define patterns, libraries, and best practices for building agents on our platform—to be used by future engineers, customers, and partners.

AI Engineer, Production Agents

Developer Relations

• Champion the developer experience where AI meets engineering
• Plan and produce user-focused content: videos, workshops, demos, tutorials
• Engage with developers to aid their success with Guild.ai
• Build advocacy programs and initiatives
• Define Guild.ai’s presence in public forums and events

Developer Advocate

Software Engineer

• You will build core infrastructure that enables:
• Systems for running and managing autonomous agents
• Multi-agent coordination and lifecycle management
• Observability, tracing, evaluation, and reliability tooling
• State management and memory systems
• Secure execution of agent tools (e.g., GitHub, Slack, internal APIs)
• Tool abstraction layers and permission boundaries
• Sandboxed and policy-controlled tool invocation
• Extensible plugin systems
• Fine-grained, role-based access control (RBAC) and policy systems
• Enterprise-grade auth (OAuth, SAML, SCIM, API keys)
• Multi-tenant architecture
• Secure identity propagation between users, agents, and tools
• Agent permission scoping and guardrails
• Data isolation and tenant separation
• Audit logging and traceability
• SOC2-minded system design
• Secure execution environments
• Deploying and operating systems on GCP, AWS, and Azure
• Kubernetes-native systems (GKE today)
• Infrastructure as Code
• Scalable, resilient backend services
• Deep integration with foundation models from OpenAI, Anthropic, and Google
• Model routing and abstraction layers
• Cost control and performance optimization
• Structured tool calling and agent frameworks

Founding Engineer – Agent Control Plane

Product Manager

• Own the Product Surface: Drive the end-to-end direction of core areas of the Guild.ai platform. Define product vision, strategy, and positioning while keeping an uncompromising focus on developer experience and workflow impact.
• Be the Voice of the Customer: Establish and lead customer discovery and research. Spend time with engineers, tech leads, and CTOs to deeply understand their pain points, mental models, and daily challenges—and turn those insights into product clarity.
• Translate Ambiguity into Action: Craft clear problem definitions, write thoughtful product narratives, and create specifications that align engineering, design, and GTM around what matters most.
• Collaborate, Build, and Ship: Partner with a world-class engineering and design team in a tight, fast-moving environment. You’ll help shepherd features from concept to launch, with a bias toward iteration and learning.
• Define Product at Guild.ai: You won’t just run a backlog—you’ll help build our entire product muscle. From process to metrics to decision frameworks, your work will set the standard for how Guild.ai builds, learns, and scales.
• Influence Company Strategy: Your insights will play a critical role in shaping our long-term roadmap, go-to-market strategy, and vision, ensuring that customer-driven thinking is at the core of our direction.

AI Engineer, Agents – Evaluation

Data Scientist

AI Engineer, Production Agents

Developer Advocate

Founding Engineer – Agent Control Plane

Founding Product Manager