Gramian Consulting

Backend Engineer

• Design and develop core platform features with a strong focus on **cloud services** and **platform architecture**
• Build and maintain scalable **Java-based backend systems**
• Contribute to the evolution of the platform's **API ecosystem** using GraphQL and REST
• Drive technical design, implementation, and production support activities
• Improve **code quality**, maintainability, and engineering standards through peer reviews
• Collaborate closely with Product, QA, and Engineering teams to deliver reliable solutions
• Troubleshoot and resolve complex production issues
• Contribute to architectural decisions and long-term platform evolution
• Help modernize cloud infrastructure, deployment workflows, and platform capabilities

Senior Software Engineer – Cloud Platform, Java

Artificial Intelligence

• Design and run short multi-turn conversations (typically 1–5 turns) intended to test AI personalization behavior
• Create prompts grounded in realistic personal scenarios to evaluate contextual understanding
• Review AI responses to determine whether personalization is correctly applied
• Check grounding quality to ensure the model does not invent unsupported claims about the user
• Evaluate integration quality — confirming personal signals are used naturally (not forced or robotic)
• Compare two responses side-by-side and determine which is more helpful, natural, and relevant
• Write clear, structured rationales explaining rankings and referencing specific conversation turns
• Verify debug information showing whether correct data sources were used
• Maintain strict workflow hygiene (including deleting evaluation conversations when required)

AI Evaluator, Polish

Medical Reviewer

• Lead senior-level clinical review of complex dermatology cases
• Provide structured clinical reasoning and guideline-aligned commentary
• Resolve clinical disagreements across reviewer groups
• Contribute to development of evaluation frameworks and methodologies
• Support AI model evaluation through expert advisory sessions
• Provide subspecialty input on complex or ambiguous cases
• Ensure high-quality, clinically defensible documentation
• Collaborate with peer reviewers and research stakeholders
• Maintain adherence to clinical and project protocols

Senior Clinical Reviewer – Dermatology AI

• Design realistic business and operational workflow scenarios for AI evaluation systems
• Create structured tasks involving analytics, reporting, operational reasoning, and process optimization
• Develop clear task specifications, expected outcomes, and validation logic
• Identify operational edge cases, bottlenecks, and workflow failure scenarios
• Evaluate AI-generated outputs for reasoning quality, usefulness, and accuracy
• Contribute expertise across business operations, analytics, automation, or operational systems
• Review and improve workflow complexity, clarity, and evaluation quality
• Collaborate with reviewers and researchers to refine AI benchmark scenarios
• Help create realistic multi-step business and operational problem-solving tasks

AI Evaluation Engineer – Business & Operations Domain

Full-stack Engineer

• Design realistic terminal-based benchmark tasks for AI evaluation systems
• Create technically deep debugging and investigation scenarios
• Develop task specifications involving infrastructure, workflows, pipelines, or operational failures
• Write clear solution approaches and deterministic evaluation criteria
• Identify realistic edge cases, failure modes, and system constraints
• Design multi-step reasoning challenges across complex technical environments
• Contribute expertise across one or more engineering or operational domains
• Review and refine benchmark quality, difficulty, and validation logic
• Collaborate with reviewers and researchers on AI evaluation workflows

AI Evaluation Engineer – Software Engineering Domain

• Review images and videos using predefined evaluation guidelines and scoring frameworks
• Assess realism, composition, lighting, motion, camera movement, and production quality
• Provide clear written justifications for evaluation decisions
• Maintain high consistency and accuracy across large annotation workloads
• Identify quality issues and inconsistencies in generated or real-world media
• Apply structured reasoning when following complex annotation instructions
• Incorporate feedback and guideline updates into ongoing annotation work
• Collaborate with remote teams working on AI training data and evaluation

Video Quality Evaluator – AI Training Data

• Create realistic prompts based on common small business situations and goals
• Interact with multiple AI chatbots and compare response quality
• Evaluate outputs based on **accuracy**, **clarity**, **usefulness**, and business relevance
• Review AI-generated visual and written business content
• Assess workflows involving spreadsheets, PDFs, images, and business documents
• Provide structured comparative feedback and scoring
• Submit completed evaluation reports and conversation transcripts
• Test AI handling of customer communication and operational scenarios
• Contribute business insights related to marketing, research, and financial planning
• Follow detailed evaluation guidelines and quality standards