AI / LLM Integration Engineer

Codvo.ai

AI/ML Engineer designing AI solutions for financial reconciliation. Integrating advanced language models to enhance exception resolution capabilities and insights.

Posted 5/12/2026full-timeRemote • 🇺🇸 United StatesMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Design and optimize prompts that accurately interpret flagged reconciliation exceptions and generate structured, actionable resolution suggestions with confidence scoring
Integrate LLM APIs (Anthropic Claude, OpenAI) into the exception resolution layer using Python, the Anthropic SDK, and async API patterns for production-grade reliability
Develop human-in-the-loop workflows that balance automation with human oversight, ensuring financial accuracy and auditability at every step
Build robust API integration code that handles edge cases, rate limiting, token management, and graceful error recovery in a financial context
Collaborate with backend developers to embed AI outputs cleanly into the reconciliation pipeline and ensure seamless data flow into final reports
Implement LLM evaluation and benchmarking frameworks to measure prompt effectiveness, accuracy, and consistency across diverse exception types
Document prompt strategies and model behavior to enable knowledge sharing and continuous improvement across the engineering team
Monitor and iterate on model performance, refining prompts and integration logic based on real-world exception data and user feedback

Requirements

What you’ll need

3+ years of professional software engineering experience, with at least 2+ years working directly with LLM APIs (Anthropic, OpenAI, or similar)
Strong proficiency in Python, including hands-on experience with the Anthropic SDK and async API calls
Demonstrated expertise in prompt engineering, particularly for structured outputs and domain-specific tasks
Solid understanding of confidence scoring, uncertainty quantification, and human-in-the-loop AI workflows
Experience writing clean, maintainable API integration code with attention to edge cases and error handling
Ability to work independently and communicate effectively with cross-functional teams
Familiarity with financial systems, reconciliation processes, or similar regulated domains is a plus

Benefits

Comp & perks

Flexible work environment: 100% remote with a collaborative, inclusive team culture
Meaningful impact: Work on cutting-edge AI solutions that directly improve financial operations for our clients
Professional growth: Opportunities to deepen expertise in LLMs, agentic AI, and financial technology
Competitive compensation: Commensurate with experience and market rates
Collaborative culture: Work alongside talented engineers and product teams who value innovation and continuous learning

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonLLM APIsAnthropic SDKasync APIprompt engineeringAPI integrationconfidence scoringerror handlingedge caseshuman-in-the-loop workflows

Soft Skills

communicationcollaborationindependenceattention to detail