Galileo 🔭

Full-stack Engineer

• Build and scale core infrastructure – design and optimize distributed systems and APIs that handle millions of real-time queries with low latency and high reliability
• Develop data-intensive systems – work across SQL, NoSQL, time-series, and object stores, ensuring data pipelines and lookups are optimized for throughput and efficiency
• Optimize performance at scale – profile and tune systems for latency, throughput, and cost
• Work on real-time serving systems – design high-throughput caching layers and data lookup services
• Build and extend pub-sub and orchestration frameworks – leverage and improve systems like Kafka, RabbitMQ, and Celery to coordinate workloads and streaming data pipelines
• Design internal developer tooling – create load testing, benchmarking, and performance analysis tools
• Collaborate cross-functionally – partner with product, research, and application engineering teams to support new capabilities, models, and workloads

Software Engineer, Platform and Data Infrastructure

• Design and scale inference infrastructure – architect and optimize distributed systems that serve LLMs at scale, ensuring low latency, high throughput, and cost efficiency.
• Push the limits of performance – apply techniques like dynamic batching, concurrency optimization, precision reduction, and GPU kernel tuning to maximize throughput while maintaining quality.
• Optimize model serving pipelines – work with TensorRT, layer fusion, kernel auto-tuning, and other advanced optimizations.
• Build robust inference microservices – design runtime services (similar to NVIDIA Triton) to support multi-tenant, real-time inference workloads in production.
• Experiment with cutting-edge frameworks – explore and integrate technologies like Apache Ray and distributed PyTorch/TensorFlow inference.
• Collaborate with research & product teams to translate models into reliable, efficient, and observable services.
• Shape best practices for running LLM workloads safely, reliably, and cost-effectively across diverse hardware.

Software Engineer, LLM Inference

Marketing Operations

We're looking for an experienced and driven Marketing Operations Manager to help our go-to-market team grow qualified pipeline.
This role will be responsible for building a cutting-edge tech stack, architecting our lead lifecycle, monitoring key business KPIs with reports and dashboards, and assisting with campaign execution.
Reporting to the Head of Growth, you’ll work closely with all Marketing and Sales leaders and our GTM Engineer(s).
Main Responsibilities:
Build our go-to-market tech stack: Build and manage a cutting-edge tech stack to support prospecting, lead nurture (including PLG leads), and attribution. Go beyond CRM and marketing automation to incorporate LLMs and AI-powered orchestration.
Oversee the lead lifecycle: Work with Sales Development to rack, enrich, and score quality leads
Surface insights: Empower stakeholders with reports and dashboards to track KPIs and inform go-to-market strategy
Enforce database hygiene: Maintain a clean CRM database while ensuring compliance with GDPR, CCPA, and other privacy regulations
Manage vendor relationships: Negotiated tech vendor contracts, manage to a budget, and track contracts for proactive renewal negotiations
Enable Marketing and Sales: Help execute impactful cross-functional campaigns, working with our field marketers and content/campaigns team

Marketing Operations Manager

• As an early engineer at Galileo, you will play a foundational role in designing, building, and scaling our products and team.
• We’re looking for an exceptional Senior Software Engineer, interested in solving complex problems at the intersection of Data and ML and passionate about the opportunities in Observability and Reliability for GenAI.
• Design, build, and scale Galileo's products and team.
• Collaborate cross-functionally with product, design, user research, and data science teams.
• Build APIs and large-scale distributed systems using Python and modern frameworks.
• Contribute to testing and quality through PyTest/PyUnit and robust engineering practices.

Senior Software Engineer, Product

Developer Relations

Create and moderate Galileo’s developer forum (whether Discourse, Discord or Slack) and facilitate our engagement in other online developer forums. Foster discussions and collaboration between developers who are learning to build AI agents and applications that work reliably. Prioritize and execute community programs such as learning courses, hackathons, and a brand ambassador program. Organize virtual and occasional in-person events that help developers connect and learn. Coordinate with our Developer Advocates and Educators to secure compelling technical content for our community. Collect and synthesize feedback from the community, sharing it with our product teams. Send regular updates to our community about both industry news and Galileo product updates.

Developer Community Manager

• Build, document, and share sample AI agents and applications using the latest models and frameworks, demonstrating how Galileo improves performance quickly.
• Create deep-dive technical posts, videos, and tutorials that illustrate practical use cases for developers.
• Develop and maintain sample code, reference apps, and SDK enhancements that help developers get started quickly.
• Represent Galileo at conferences and virtual events, showcasing demos and connecting with developers in authentic conversation.
• Build relationships with AI thought leaders, influencers, and open-source communities to strengthen Galileo’s community.
• Partner with product, engineering, and growth teams to launch new products & features to developer communities.
• Synthesize user ideas to shape our product requirements and roadmap.
• Stay current with the latest in AI research, LLM models, and developer tooling.

Developer Advocate

Software Engineer

• Role Description We’re looking for an expert Developer Educator / Technical Writer to help AI builders learn faster, solve problems, and bring their ideas to life.
• As part of our Developer Awareness team, you’ll design and deliver materials that simplify AI workflows, answer questions quickly, and make it easy to get started.
• The ideal candidate has hands-on experience building AI agents and applications with modern frameworks, APIs, and tools. That experience should shine through in our docs and tutorials.
• Most of your time will be spent producing technical resources, with occasional opportunities to present your work in webinars or at events.
• You’ll work closely with our product & engineering teams to ensure our docs, examples, and code samples are up-to-date and aligned with how developers are actually building.
• Your work will directly shape the onboarding experience and long-term success of Galileo’s developer community.
• Main Responsibilities Write clear, concise, and consistent documentation ( https://v2docs.galileo.ai/ ) and tutorials that help developers use Galileo in their AI agents and applications.
• QA every tutorial and example to validate accuracy.
• Build and maintain working code examples, reference implementations, and sample projects that demonstrate best practices.
• Produce regular communications about new features for our developer community.
• Collaborate with engineering to keep documentation in sync with product updates.
• Author deep-dive technical blog posts and occasional learning courses.
• Ensure content showcases popular approaches including LLM orchestration, agent frameworks, and toolchains.
• Tooling and process improvement : Work closely with the engineering team to improve the documentation system, incorporating automation to streamline and enhance the documentation process.
• Collect and incorporate user feedback for continuous improvements to the docs experience and efficacy.