AI Evaluation Engineer – Business & Operations Domain

Gramian Consulting

AI Evaluation Engineer designing and evaluating operational workflows for AI systems. Collaborating on advanced AI evaluation projects in a fully remote setting.

Posted 5/27/2026contractRemote • 🇪🇬 EgyptMid-LevelSeniorWebsite

About the role

Key responsibilities & impact

Design realistic business and operational workflow scenarios for AI evaluation systems
Create structured tasks involving analytics, reporting, operational reasoning, and process optimization
Develop clear task specifications, expected outcomes, and validation logic
Identify operational edge cases, bottlenecks, and workflow failure scenarios
Evaluate AI-generated outputs for reasoning quality, usefulness, and accuracy
Contribute expertise across business operations, analytics, automation, or operational systems
Review and improve workflow complexity, clarity, and evaluation quality
Collaborate with reviewers and researchers to refine AI benchmark scenarios
Help create realistic multi-step business and operational problem-solving tasks

Requirements

What you’ll need

3–10 years of experience in operations, analytics, consulting, business systems, or related domains
Strong analytical thinking and operational problem-solving skills
Experience working with operational workflows, reporting systems, CRM tools, or business analytics
Good understanding of cross-functional business processes and dependencies
Experience with spreadsheets, dashboards, operational reporting, or workflow automation
Strong written communication and documentation skills
Exposure to AI systems, automation platforms, or evaluation workflows is preferred
Ability to design realistic and structured operational scenarios for evaluation purposes

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Gramian Consulting Website LinkedIn All Job Openings 2 - 10 employees Founded 2025 🎯 Recruiter 🤖 Artificial Intelligence 📚 Education Recruitment
Artificial Intelligence
Education Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent. AI Evaluation Engineer – Business & Operations Domain 🔥 0 minutes ago 🇪🇬 Egypt – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Design realistic business and operational workflow scenarios for AI evaluation systems
Create structured tasks involving analytics, reporting, operational reasoning, and process optimization
Develop clear task specifications, expected outcomes, and validation logic
Identify operational edge cases, bottlenecks, and workflow failure scenarios
Evaluate AI-generated outputs for reasoning quality, usefulness, and accuracy
Contribute expertise across business operations, analytics, automation, or operational systems
Review and improve workflow complexity, clarity, and evaluation quality
Collaborate with reviewers and researchers to refine AI benchmark scenarios
Help create realistic multi-step business and operational problem-solving tasks 🎯 Requirements
3–10 years of experience in operations, analytics, consulting, business systems, or related domains
Strong analytical thinking and operational problem-solving skills
Experience working with operational workflows, reporting systems, CRM tools, or business analytics
Good understanding of cross-functional business processes and dependencies
Experience with spreadsheets, dashboards, operational reporting, or workflow automation
Strong written communication and documentation skills
Exposure to AI systems, automation platforms, or evaluation workflows is preferred
Ability to design realistic and structured operational scenarios for evaluation purposes Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs AI Automation Specialist 🕒 5 days ago Scale Army Careers 11 - 50 🎯 Recruiter 🤝 B2B Website LinkedIn All Job Openings AI Automation Specialist building and optimizing operational workflows at a rapidly scaling ecommerce company. Collaborating closely with leadership to drive automation initiatives and improve operational efficiency. 🇪🇬 Egypt – Remote 💵 $3k - $3.5k / month ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence AI Automation Specialist 🕒 6 days ago Scale Army Careers 11 - 50 🎯 Recruiter 🤝 B2B Website LinkedIn All Job Openings AI Automation Specialist optimizing AI-powered workflows and reporting for operational efficiency across finance, real estate, and retail. 🇪🇬 Egypt – Remote 💵 $2.5k - $2.7k / month ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence AI Filmmaker Team Lead 🕒 May 13 Scale Army Careers 11 - 50 🎯 Recruiter 🤝 B2B Website LinkedIn All Job Openings AI Filmmaker Team Lead at a Hollywood-backed entertainment company creating AI-assisted video content. Leading production workflows and overseeing AI models while maintaining creative quality across projects. 🇪🇬 Egypt – Remote 💵 $2.5k - $3.2k / month ⏳ Contract/Temporary 🟠 Senior 🤖 Artificial Intelligence AI Automation Specialist 🕒 May 13 Scale Army Careers 11 - 50 🎯 Recruiter 🤝 B2B Website LinkedIn All Job Openings AI Automation Specialist designing and optimizing AI-driven workflows in a medical aesthetics company. Focused on operational efficiency and automation initiatives across departments. 🇪🇬 Egypt – Remote 💵 $2k - $2.8k / month ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence AI Automation Specialist 🕒 May 6 Scale Army Careers 11 - 50 🎯 Recruiter 🤝 B2B Website LinkedIn All Job Openings AI Automation Specialist responsible for implementing AI-driven solutions to optimize operations. Focused on workflow efficiency in a fully remote role. 🇪🇬 Egypt – Remote 💵 $2.5k - $3k / month ⏳ Contract/Temporary 🟢 Junior 🟡 Mid-level 🤖 Artificial Intelligence 🚫👨‍🎓 No degree required View More Artificial Intelligence Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

analyticsreportingprocess optimizationtask specificationsvalidation logicoperational workflowsworkflow automationoperational reportingbusiness analyticsAI evaluation

Soft Skills

analytical thinkingoperational problem-solvingwritten communicationdocumentationcollaboration