
Domain Advisor Consultant – Subject Matter Expert
Invisible Technologies
contract
Posted on:
Location Type: Remote
Location: United States
Visit company websiteExplore more
About the role
- This engagement focuses on high-level advisory and specialized analysis. Consultants will operate under a Statement of Work (SOW) to provide the following deliverables:
- Rubric Architecture: Review and advise on the quality criteria used to evaluate AI outputs. You will determine if the AI’s logic holds up to professional scrutiny in your field.
- "Golden" Data Curation: Create, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model training.
- Expert Gap Analysis: Analyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of why the model failed and how a human expert would have approached the problem.
- Advisory on Complexity: Consult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenarios.
Requirements
- Elite Domain Mastery: Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative).
- Professional Autonomy: You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodology.
- Interest in Shaping Technology: While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the "gold standard" for how AI should operate within their specific profession.
- Articulate Reasoning: The ability to not just know the right answer, but to articulate the reasoning process clearly in writing.
Benefits
- Intellectual Challenge: This is rare, cerebral work that challenges you to deconstruct your own expertise to train a machine.
- High-Value Impact: Your input directly influences the safety and capability of models used by millions.
- Flexible Revenue Stream: Supplement your primary consulting business with flexible, high-value project work.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI evaluationdata curationgap analysisrubric architecturetechnical analysismodel trainingprompt engineeringlogical reasoning
Soft Skills
articulate reasoningprofessional autonomyconsultingindependent workflowcommunication
Certifications
PhDMDJDSenior Principal EngineerPublished Author