Mercor

AI Evaluator - Software Expert

United States full-time Senior $80 - $120
full-time Senior level Technology & IT Salary listed Curated
Sign in to apply Free account — we bring you straight back to this role.

About the role

About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Software / AI / IT / data Evaluator
Type:Contract
Compensation:$80–$120/hour
Location:Remote
Role Responsibilities

Evaluate AI-generated artifacts against domain-specific quality rubrics.

Identify factual, aesthetic, and presentation errors in outputs.

Provide clear, structured written feedback to improve quality.

Work independently and asynchronously to meet deadlines.

Utilize expertise in Microsoft Office and Google Workspace, especially Slides.

Qualifications

Must-Have

5+ years of relevant professional experience in Software / AI / IT / data.

Native or professional fluency in English.

Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred
Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)

Upload resume

AI interview based on your resume

Submit form

Resources & Support

For details about the interview process and platform information, please check:

For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas

Interview prep

Walk in with sharper answers.

Use these suggested prompts to prepare. They are not questions supplied by the employer.

Senior
Technology & IT Remote Collaboration Senior level full-time

Practice questions

  1. Tell us about work you have done that is close to the AI Evaluator - Software Expert role.
  2. How would you approach your first 30 days at Mercor?
  3. Which of Remote Collaboration have you used recently, and what did it help you achieve?
  4. How have you led people, improved a process, or made a hard decision in a previous role?
  5. How do you handle busy days, changing priorities, or pressure at work?

Prepare before the call

  • A recent example that proves your experience with Remote Collaboration.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the AI Evaluator - Software Expert role at Mercor. My relevant experience is [your example], where I [your action] and achieved [your result].

Related jobs.

More roles from this company or category.