Test Engineer - Fully Remote Job at Mercor, Remote

  • Mercor
  • Remote

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: QA/Test Engineer

Type: Contract

Compensation: $60–$90/hour

Location: Remote

Commitment: 35 hours/week

Role Responsibilities

  • Design test cases to confirm task functionality, including edge cases.
  • Review tasks and reference solutions to catch ambiguities and gaps early.
  • Debug using Python when tasks or checks misbehave.
  • Build quality checklists and provide actionable feedback to authors.
  • Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.

Qualifications

Must-Have

  • MSc or PhD in a STEM field or equivalent practical experience.
  • 1+ years in test engineering, quality assurance, or a related role.
  • Experience designing test cases and debugging complex systems.
  • Proficiency in Python and Git .
  • Exceptional attention to detail and clear documentation habits.

Preferred

  • Experience in AI training , model evaluation, or quality review of AI-generated work.
  • A perfectionist mindset and ability to work independently through ambiguous problems.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Full time, Contract work, Summer work, Remote work

Similar Jobs

Lennar

Purchasing Manager Job at Lennar

 ...Purchasing ManagerWe are Lennar. Lennar is one of the nation's leading homebuilders, dedicated to making an impact and creating an extraordinary experience for their Homeowners, Communities, and Associates by building quality homes and providing exceptional customer service... 

Cimarron Pointe Care Center

Weekend Registered Nurse Job at Cimarron Pointe Care Center

 ...Shift: Weekends - Sat, SunJob Location: Mannford, OklahomaJoin Our Team!Join a team committed to excellence in resident care. Cimarron Pointe Care Center is seeking dedicated Registered Nurses who are ready to make ameaningful difference in the lives of our residents... 

Sofar Sounds

Audio Engineer Job at Sofar Sounds

 ...Audio Engineer Sofar Sounds is a global community that connects artists and audiences through unique and intimate experiences. Sofar shows transform everyday spaces from living rooms and rooftops, to boutiques and museums into captivating venues for intimate gigs... 

Ascension St. John Rehabilitation Hospital, an affiliate of ...

LPN Job at Ascension St. John Rehabilitation Hospital, an affiliate of ...

 ...Job Description Job Description LPN/LVN Career Opportunity Walk in Wednesday Interviews are held every Wednesday, 9am-5pm, no...  ...year of experience in an inpatient medical-surgical or general hospital setting is preferred. Rehabilitation experience is preferred.... 

Team Carney

Supervisory Program Manager - Homeland Security Job at Team Carney

 ...This Supervisory Program Manager position supports the Department of Homeland Security (DHS), Customs and Border Protection (CBP) in the area of Support Services. The mission-critical program provides comprehensive training, safety, standards, curriculum development, and...