Design for Action: Build AI integrations that do more than just summarize text. Design systems that can securely read from and write back to our core platforms (e.g., updating a record in Salesforce or drafting a response in Zendesk).
Secure Data Flow: Architect the integration layer between external LLM providers (Google, Anthropic, OpenAI) and internal data. Ensure all data retrieval is governed by strict permissions so users are only able to access data they are authorized to see.
Scalability: Design a model-agnostic inference layer that allows us to switch between models based on performance and cost requirements.
Backend Engineering: Write production-ready code using modern agent frameworks (ADK, LangChain). This is a technical role that requires coding.
Retrieval Augmented Generation (RAG): Implement robust RAG pipelines to ground AI responses in company data. This includes managing vector databases and optimizing search strategies (hybrid search, reranking) to ensure accuracy.
Deployment: Set up the CI/CD pipelines and infrastructure required to deploy and maintain these services in a cloud environment.
Evaluation: Move beyond "eye-balling" results. Implement automated testing frameworks to measure response accuracy, latency, and costs before deploying changes.
Data Privacy: Ensure strict handling of PII and adherence to enterprise security standards. You will be the gatekeeper for how sensitive data is exposed to LLMs.
Requirements Gathering: Partner with leaders in Sales, Marketing, and Support to identify high-impact automation opportunities. Translate business needs into technical specifications.

Requirements

8+ years of experience in software development with strong proficiency in Python and API design (REST).
2+ years of experience building LLM-powered applications or agents (using libraries like LangChain or ADK).
Experience with Vector Databases (e.g., Pinecone, pgvector) and building pipelines to process unstructured text.
Hands-on experience deploying services on AWS, Azure, or GCP.
Proven experience integrating custom applications with SaaS platforms like Salesforce, NetSuite, or Zendesk. You understand their data models and API constraints.
Ability to explain technical concepts to non-technical stakeholders and collaborate effectively with product managers and business analysts.

Benefits

Offers Equity 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills

PythonAPI designLLM-powered applicationsLangChainADKVector DatabasesPineconepgvectorCI/CDautomated testing frameworks

Soft skills

collaborationcommunicationrequirements gatheringtechnical explanation