Plentiful.ai

Staff Backend Engineer

Plentiful.ai

full-time

Posted on:

Location Type: Hybrid

Location: San Francisco • California • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Job Level

Lead

Tech Stack

Distributed SystemsSQL

About the role

  • Maintain and evolve our workflow orchestration system that runs across serverless and containerized environments, processing millions of tasks each month.
  • Design scheduling, queuing, rate limiting, and retry logic for reliable and fair resource allocation.
  • Build mechanisms for state tracking, error handling, timeouts, and cleanup across distributed tasks.
  • Partner with DevOps on observability, structured logging, tracing, and deployment automation.
  • Design and optimize schemas for flexible data storage and user-defined structures.
  • Improve performance across large datasets (100M+ rows) using indexing, replication, and connection pooling.
  • Ensure ACID compliance, concurrency control, and referential integrity.
  • Implement audit logging, data lineage tracking, and compliant data retention policies.
  • Collaborate with DevOps on replication, backups, and disaster recovery.
  • Manage integrations with SFTP, email, databases, spreadsheets, and REST APIs, with secure credential and failure recovery handling.
  • Build and maintain file processing pipelines that handle millions of files per month.
  • Work with healthcare data formats (HL7, X12, EDI) and standard file types (PDF, Excel, CSV, JSON).
  • Develop webhook handlers, polling services, and event-driven workflows to ensure data consistency.
  • Collaborate with ML/AI teams on data pipelines for model training and inference.
  • Lead technical projects and set quality and reliability standards for the backend team.
  • Identify and reduce technical debt; plan and execute major system improvements and migrations.
  • Mentor engineers through code reviews, design sessions, and pair programming.
  • Participate in incident response and postmortems, focusing on long-term reliability.
  • Write and review RFCs to document and guide key architectural decisions.

Requirements

  • 8+ years of professional software engineering experience.
  • Strong background in distributed systems, workflow orchestration, and large-scale task processing.
  • Advanced database expertise: SQL, schema design, query tuning, and operations at scale.
  • Solid computer science fundamentals (data structures, algorithms, system design).
  • Experience building and maintaining large-scale data pipelines and external integrations.
  • 3+ years of technical leadership, guiding projects and mentoring engineers.
  • Proven experience leading re-architecture or modernization efforts.
  • Track record of improving reliability, managing incidents, and reducing technical debt.
  • Strong written and verbal communication skills for documentation and cross-team collaboration.
  • Experience working closely with DevOps, observability, and ML/AI teams.
Benefits
  • Unlimited PTO
  • Health insurance
  • Meal stipend
  • Health & wellness stipend
  • Team offsites
  • 401K matching
  • Stock options

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
workflow orchestrationdistributed systemslarge-scale task processingSQLschema designquery tuningdata pipelineswebhook handlersevent-driven workflowsACID compliance
Soft skills
technical leadershipmentoringcommunicationcollaborationincident responsedocumentationproject guidancecode reviewsdesign sessionsreducing technical debt