Decision Intelligence Analyst
Rwazi
full-time
Posted on:
Location Type: Remote
Location: Anywhere in the World
Visit company websiteExplore more
About the role
- Evaluating decision outputs for logical integrity and sound reasoning
- Identifying patterns of judgment failure or inconsistency
- Designing structured feedback loops to improve AI reasoning
- Training and refining AI judgment frameworks
- Defining measurable standards for decision quality
- Review system outputs for logical coherence and reasoning rigor
- Assess signal interpretation accuracy
- Identify tradeoff miscalculations or flawed inference pathways
- Document recurring reasoning gaps
- Create structured examples to refine reasoning performance
- Develop edge-case libraries for training robustness
- Formalize evaluation rubrics for decision quality
- Collaborate with R&D to improve reasoning architecture
- Define measurable criteria for decision-grade output
- Track improvements in reasoning consistency
- Monitor drift in output quality over time
- Establish acceptance thresholds for release
- Identify systemic reasoning weaknesses
- Surface blind spots in signal modeling
- Propose structured adjustments to logic layers
- Escalate structural flaws early
- Partner with Product to align quality with roadmap goals
- Collaborate with R&D on advanced reasoning improvements
- Provide structured feedback to Engineering when system behavior deviates
Requirements
- Strong analytical and logical reasoning ability
- Experience evaluating AI systems, decision frameworks, or complex models
- Comfort dissecting multi-step reasoning chains
- Ability to formalize judgment criteria
- Strong written clarity and structured thinking
- Comfort working with ambiguity and edge cases
Benefits
- Flexible / Remote 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI systems evaluationdecision frameworkslogical reasoningsignal interpretationreasoning performance refinementevaluation rubricsedge-case librariesdecision quality standardsreasoning architecture improvementoutput quality monitoring
Soft Skills
analytical abilitylogical reasoning abilitystructured thinkingwritten claritycomfort with ambiguitydissecting reasoning chainsidentifying patternscollaborationfeedback provisionproblem-solving