DevOps Engineer - AI Model Evaluator
mercor
PortugalPosted about 1 month agoDiscoveredMatch locked
RemoteFull Time2+ years expDeveloper
Mercor
connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark
,
General Catalyst
,
Peter Thiel
,
Adam D'Angelo
,
Larry Summers
, and
Jack Dorsey
.
Position
DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Role Responsibilities
- Use frontier
AI coding agents
to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving
cloud platforms
,
Kubernetes
,
CI/CD systems
,
observability
, and
infrastructure automation
.
- Identify bugs, edge cases, reliability issues, and failure modes.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
- Work
independently and asynchronously
to meet sprint-based project deadlines.
Must-Have
•
2+ years
of professional
DevOps
,
SRE
, or
Cloud Engineering
experience.
•
Experience with AWS
,
Azure
,
GCP
,
Kubernetes
,
Terraform
,
CI/CD pipelines
, or
observability tooling
.
•
Regular use of AI coding agents
such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
•
Preferred
•
Compensation & Legal
•
$400 per accepted task
.
•
Application Process (Takes 20–30 mins to complete)
•
Upload resume
•
AI interview based on your resume
•
Resources & Support
•
For details about the interview process and platform information, please check
•
For any help or support, reach out to
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Skills
artificial-intelligencedevopsci-cdkubernetessreawsazuregcpterraform
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.