Senior AI Engineer
Blue Orange Digital
full-time
Posted on:
Location Type: Remote
Location: New York • Washington • United States
Visit company websiteExplore more
Job Level
About the role
- Build production-grade agentic systems on Databricks and other lakehouse platforms, including orchestration frameworks, task runners, and monitoring layers
- Implement RAG pipelines, vector stores, and retrieval architectures that hold up under real-world load
- Stand up evals, observability, and guardrails for client-deployed AI systems
- Design and integrate MCP servers and tool-calling layers between LLMs and client systems
- Lead the AI engineering workstream on a client pod, partnering with the Architect on platform decisions and the Consultant on roadmap
- Coach client engineering teams on production AI patterns, including prompt management, model routing, and FinOps
- Contribute to BOD’s internal Edge product suite, including reference architectures and the Blueprint scan engine
Requirements
- 5+ years building production data and ML systems in Python; 2+ years specifically on LLM-based or agentic systems
- Hands-on experience with at least one major LLM orchestration framework (LangChain, LangGraph, Langflow, Databricks Agent Framework, or equivalent)
- Production experience with Databricks (Unity Catalog, Delta Live Tables, MLflow) or comparable lakehouse platforms such as Snowflake with dbt
- Deep knowledge of RAG architectures, vector databases, and embedding pipelines
- Proven track record taking AI systems from prototype to production, including evals, monitoring, and on-call ownership
- Comfortable working directly with client engineering teams as a peer and a coach
- Preferred qualifications: Databricks, AWS, or Azure certifications
- Experience with MCP, tool-calling protocols, or agentic protocol design
- Background in security-aware AI engineering (prompt injection, data leakage, access control)
- Multimodal AI experience across text, document, and image
- FinOps experience optimizing model and compute spend
Benefits
- Competitive compensation with performance bonuses
- Work on diverse, challenging projects across industries
- Direct access to cutting-edge tech stacks (Databricks, AWS, GCP, Azure)
- Builder culture where engineers lead and ship
- Professional development budget and certification support
- Flexible remote work environment
- Collaborative team that values production-grade craftsmanship
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonLLM orchestration frameworksRAG architecturesvector databasesembedding pipelinesproduction AI patternsMCP serversmonitoringFinOpsagentic systems
Soft Skills
coachingcollaborationleadershipcommunicationpeer support
Certifications
Databricks certificationAWS certificationAzure certification