Company Watch

Software Engineer

• Develop scalable, low-latency and cost effective inference pipelines
• Optimize model performance: memory usage, throughput, and latency, using advanced techniques like distributed computing, model compression, quantization and caching mechanisms
• Develop specialized GPU kernels for performance-critical tasks like attention mechanisms, matrix multiplications, etc.
• Collaborate with H research teams on model architectures to enhance efficiency during inference
• Review state-of-the-art papers to improve memory usage, throughput and latency (Flash attention, Paged Attention, Continuous batching, etc.)
• Prioritize and implement state-of-the-art inference techniques

Member of Technical Staff – Inference

• Designing and managing the infrastructure to support
• Research efforts in Model and Agent development incl. training infrastructure, data pipelines and inference.
• Product Engineering efforts on H Company’s agent platform including client-facing APIs and agent runtimes within various deployment scenarios (multi-tenant and on-prem).
• Setup and maintain observability and monitoring strategies.

Technical Staff Member – Infrastructure

• Develop and train advanced LLMs and VLMs, including multimodal architectures
• Research and implement training methods for enhanced capabilities like instruction following and tool use
• Design and optimize data pipelines and training systems for large-scale distributed training
• Collaborate with cross-functional teams to integrate models into agentic AI systems
• Evaluate model performance and communicate findings to stakeholders
• Stay current with advancements in LLMs, VLMs, and related fields

Member of Technical Staff – Research – Model

• Designing and managing the infrastructure to support
• Research efforts in Model and Agent development incl. training infrastructure, data pipelines and inference.
• Product Engineering efforts on H Company’s agent platform including client-facing APIs and agent runtimes within various deployment scenarios (multi-tenant and on-prem).
• Setup and maintain observability and monitoring strategies.
• Mentor and grow other engineers in infrastructure-related topics as well as general engineering practices.

Member of Technical Staff – Inference

Technical Staff Member – Infrastructure

Member of Technical Staff – Research – Model

Senior Technical Staff, Infrastructure