AI Safety Specialist - Evaluation Expert
mercor
EstoniaPosted 20 days agoDiscoveredMatch locked
RemoteContractor
Mercor
connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark
,
General Catalyst
,
Peter Thiel
,
Adam D'Angelo
,
Larry Summers
, and
Jack Dorsey
.
Position
AI Safety Practitioner
Role Responsibilities
- Evaluate
AI-generated responses
for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for
RLHF
,
SFT
, and
AI safety benchmarking
.
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with
AI researchers
and safety teams on ongoing evaluation initiatives.
Must-Have
•
Bachelor's degree
or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
•
5+ years
of professional experience in
AI Safety
, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
•
Excellent written English
, critical thinking, and analytical reasoning skills.
•
Preferred
•
Experience with AI Safety
,
RLHF
,
SFT
, Trust & Safety, or AI evaluation.
•
Familiarity with safety policies, content moderation, or evaluation rubric development.
•
Application Process (Takes 20–30 mins to complete)
•
Upload resume
•
AI interview based on your resume
•
Resources & Support
•
For details about the interview process and platform information, please check
•
For any help or support, reach out to
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Not included in the source posting: benefits.
Skills
artificial-intelligence
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.