Domain Advisor Consultant (Subject Matter Expert)
Invisible Technologies
RemotePosted 20 days agoDiscoveredMatch locked
RemoteContractorData Science
Engagement Type
Business-to-Business (B2B) / Independent Contractor
Location
Remote
The Opportunity: Define the "Ground Truth" for Generative AI
We are looking to engage elite Subject Matter Experts (SMEs) to partner with us on high-impact AI evaluation and training projects. We are not looking for generalists; we are seeking established authorities—the top 1% in their respective fields—who are eager to apply their deep domain knowledge to shape the reasoning, accuracy, and safety of next-generation Large Language Models (LLMs).
This is a consulting engagement for independent professionals who want to help define what "perfection" looks like in their industry. You will not just be grading AI; you will be architecting the
"Gold Standard"
rubrics that teach models how to think like an expert.
Scope of Services & Deliverables
This engagement focuses on high-level advisory and specialized analysis. Consultants will operate under a Statement of Work (SOW) to provide the following deliverables:
•
Rubric Architecture
Review and advise on the quality criteria used to evaluate AI outputs. You will determine if the AI’s logic holds up to professional scrutiny in your field.
•
"Golden" Data Curation
Create, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model training.
•
Expert Gap Analysis
Analyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of why the model failed and how a human expert would have approached the problem.
•
Advisory on Complexity
Consult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenarios.
Consultant Profile: Who We Are Looking To Partner With
We are seeking independent business owners, freelancers, and academic leaders who possess:
•
Elite Domain Mastery
Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative).
•
Professional Autonomy
You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodology.
•
Interest in Shaping Technology
While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the "gold standard" for how AI should operate within their specific profession.
•
Articulate Reasoning
The ability to not just know the right answer, but to articulate the reasoning process clearly in writing.
Engagement Structure & Compliance
This is a strictly non-employee, independent contractor opportunity designed for professionals who manage their own business operations.
- Engagements are
project-based and non-exclusive
, allowing you to continue working with other clients
- You have flexibility in
how you complete deliverables
, in alignment with project requirements
- Scope, timelines, and compensation are
defined in advance
for each assignment
•
Remote & Independent
You provide your own workspace and equipment.
•
Global Compliance
Candidates must be properly registered to operate as independent contractors in their country of residence.
Why Top-Tier Consultants Partner With Us
•
Intellectual Challenge
This is rare, cerebral work that challenges you to deconstruct your own expertise to train a machine.
•
High-Value Impact
Your input directly influences the safety and capability of models used by millions.
•
Flexible Revenue Stream
Supplement your primary consulting business with flexible, high-value project work.
Originally posted on Himalayas
Not included in the source posting: what you'll do, qualifications, benefits.
Skills
artificial-intelligencegenerative-aillm
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.