Second Front Systems

Senior Data Scientist

Second Front Systems

full-time

Posted on:

Location Type: Remote

Location: ColoradoMarylandUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $137,000 - $180,000 per year

Job Level

About the role

  • Design, develop, and improve agentic AI systems using LangGraph and LangChain, with a focus on reliability, traceability, and measurable output quality.
  • Advance existing capabilities including the DAG driven AI and chatbots by improving reasoning, tool-calling accuracy, and inference confidence.
  • Develop and mature evaluation frameworks to assess AI-generated outputs across dimensions including groundedness, faithfulness, relevance, context precision, and context recall.
  • Improve and extend multi-LLM ensemble system including consensus scoring methods, model weighting, and aggregation strategies.
  • Design and implement fine-tuning and prompt optimization pipelines for domain-specific cybersecurity and compliance use cases.
  • Develop AI/ML components for RAG systems, including embedding strategies, retrieval optimization, chunking, and re-ranking.
  • Partner with Product and Engineering teams to identify high-leverage opportunities to introduce AI across onboarding, deployment, monitoring, configuration, and remediation workflows.
  • Develop and document reusable AI-native components, integration patterns, and deployment blueprints, including single-tenant and multi-tenant LLM serving architectures on AWS Bedrock, Cohere, Anthropic, and OpenAI-compatible providers.

Requirements

  • 5 years, or greater, experience in applied machine learning, data science, or AI engineering, with at least 2 years working with large language models in production.
  • Hands-on experience building agentic AI systems with tool-calling agents, multi-step reasoning pipelines, or DAG-based orchestration (LangGraph, LangChain, or equivalent).
  • Strong proficiency in Python and the modern ML/AI ecosystem.
  • Experience with Retrieval-Augmented Generation, including vector databases, embedding models, chunking strategies, and retrieval evaluation.
  • Experience with foundation model APIs across multiple providers: AWS Bedrock, OpenAI, Anthropic, Cohere, and Meta.
  • Proven ability to design and implement quantitative evaluation frameworks for LLM or agentic system outputs.
  • Demonstrated ability to communicate AI concepts and recommendations to non-technical stakeholders and cross-functional teams.
  • Strong command of statistical reasoning, probabilistic modeling, and experiment design.
Benefits
  • Competitive Salary
  • 100% Healthcare, vision and dental coverage
  • 401(k) + 3% company contribution
  • Equity incentive plan
  • Tech + office supplies stipend
  • Annual professional development stipend
  • Flexible paid time off + federal holidays off
  • Parental leave
  • Work from anywhere
  • Referral Bonus