Kocho

AI Engineer

Kocho

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇿🇦 South Africa

Visit company website
✨ AI Apply
Apply

Job Level

Mid-LevelSenior

Tech Stack

AzurePostgresPythonPyTorchTensorflowVault

About the role

  • Design, build and ship production LLM features with clear prompts, tools and retrieval
  • Develop and maintain RAG pipelines, ideally with agentic patterns, including query rewriting, re ranking and citation integrity
  • Build data ingestion and indexing for trusted sources, manage chunking, metadata and vector stores
  • Own model evaluation and quality gates, with golden sets, regression tracking and live guardrails
  • Turn experiments into stable APIs with clear contracts, authentication, rate limits and versioning
  • Operate services in Azure, including Azure OpenAI, Azure AI Search, Functions or Container Apps, Key Vault and Application Insights
  • Monitor reliability, latency, accuracy and cost, and drive continuous tuning
  • Implement logging, observability and alerting, and keep audit trails for compliance
  • Apply responsible AI and GDPR principles, including safe refusals, privacy and data retention
  • Work closely with the CTO and product and legal stakeholders to translate requirements into testable behaviours and results
  • Write clear documentation for pipelines, APIs, runbooks and operational playbooks
  • Set up CI and automated evaluations so every change is tested before release, and support code reviews

Requirements

  • Strong background in machine learning, data science and applied AI
  • Proven experience shipping LLM applications to production with RAG pipelines, prompt design, re ranking and citation integrity
  • Solid Python, plus modern AI and ML libraries such as PyTorch, TensorFlow, Hugging Face, LangChain or LlamaIndex
  • Vector search in practice, for example Azure AI Search, Pinecone, Postgres with pgvector on Supabase, Weaviate or Qdrant
  • API design and integration, including secure REST and OAuth, and connecting to third party legal or content sources such as GOV.UK, ACAS, or commercial providers like Thomson Reuters Practical Law or Westlaw
  • Proficiency with Azure services such as Azure OpenAI, Azure AI Search, Functions or Container Apps, Key Vault and Application Insights
  • Experience building chatbots or copilots and automation in the Microsoft ecosystem, for example Copilot Studio or Teams apps
  • Data pipelines and dataset preparation, including ingestion, parsing, chunking, metadata and indexing
  • Model evaluation in practice, with golden sets, regression tracking and live guardrails for safety and privacy
  • Security minded with good knowledge of data protection and responsible AI in a UK setting
  • Ability to translate business needs into clear technical plans and explain complex ideas simply
  • Degree in a relevant field and about five years of related experience, or an equivalent track record
Benefits
  • Health insurance
  • Retirement plans
  • Professional development

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
machine learningdata scienceapplied AIPythonPyTorchTensorFlowHugging FaceLangChainLlamaIndexAPI design
Soft skills
ability to translate business needsexplain complex ideas simplystrong communicationcollaboration with stakeholdersattention to detailproblem-solvingadaptabilitycritical thinkingorganizational skillsresponsible AI principles
Certifications
degree in relevant field