Senior Software Engineer, AI
Binance.US
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $220,000 - $250,000 per year
Job Level
Senior
Tech Stack
Distributed SystemsGoJavaKafkaKotlinMicroservicesPython
About the role
- Partner with the Senior Product Manager, AI to translate AI product strategy into a clear technical roadmap, breaking initiatives into milestones and deliverables.
- Design and evolve the AI platform (LLM/model orchestration, context and prompt management, evaluation pipelines, observability, and cost controls).
- Evaluate, select, and integrate LLMs and other models (hosted APIs and self-hosted), balancing quality, latency, cost, privacy, and regulatory requirements.
- Define standards and best practices for how product and engineering teams build AI-powered features on top of the platform.
- Design, implement, and maintain backend services and APIs that power AI-enabled features for customers and internal users (e.g., support tooling, trading and risk insights, internal agents and automation).
- Collaborate with data/ML partners to productionize models, including feature pipelines, inference services, and online/offline evaluation.
- Ensure AI systems are reliable, observable, and scalable, with clear SLOs for performance, availability, and quality.
- Implement evaluation frameworks for AI systems, including regression suites, A/B experiments, human-in-the-loop review, and quality metrics.
- Work closely with Security, Compliance, Legal, and Risk to incorporate guardrails, access controls, and auditability into AI systems from design through deployment.
- Use secure tool-calling/orchestration patterns to connect models to internal tools and data while respecting data governance and customer privacy.
- Mentor and level up engineers (Senior and mid-level) in AI/ML best practices, distributed systems design, and platform thinking.
- Collaborate with engineering and talent partners on hiring for AI-related roles and help shape our AI engineering culture.
Requirements
- 8+ years of professional software engineering experience,
- 3+ years building production ML/AI systems.
- Backend & systems expertise.
- Strong proficiency in Java or a similar typed backend language (e.g., Kotlin, Go) and working proficiency in Python for ML/AI workflows.
- Deep understanding of distributed systems, microservices, and event-driven architectures (e.g., Kafka or similar).
- Hands-on experience building with LLMs and modern ML tooling (e.g., OpenAI/Anthropic APIs, Hugging Face, vector databases, RAG, prompt orchestration frameworks).
- Experience building platforms or internal tools that support multiple product teams, with an emphasis on reliability, observability, and developer experience.
- Familiarity with AI evaluation and safety techniques (offline/online eval, content filters, policy enforcement, guardrails).
- Experience in fintech, trading, payments, or other regulated industries is a strong plus.
- Proven ability to communicate clearly with cross-functional partners (Product, Data, Security, Compliance, and leadership) and to translate complex technical work into business impact.
Benefits
- Unlimited PTO (for salaried FTE roles);
- 12 weeks fully paid Parental Bonding Leave.
- Mental wellness benefits;
- free 1:1 virtual visits with a licensed mental wellness professional;
- comprehensive competitive health benefits.
- Fully remote, cameras-on culture with work-from-home equipment reimbursements available to new hires.
- Annual professional development budget;
- free 1:1 virtual visits with a career coach;
- 401k plan with employer match.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
JavaKotlinGoPythonML/AI systemsdistributed systemsmicroservicesevent-driven architecturesLLMsAI evaluation techniques
Soft skills
communicationmentoringcollaborationcross-functional teamworktechnical translation