Skip to main content

Terac

Subject Matter Experts: Machine Learning Model Evaluation

United States

Location
United States
Work
Remote
Employment
Contract
Level
Not stated
Function
Data & AI
Pay
From $75.00 an hour (read from the ad)
Posted
Yesterday

Pay and the market here

The top of this role’s range, $156K a year, is 27% below the median of $214K for data jobs in United States (middle half $165K – $270K, 5,272 jobs that state pay).

7,024 data jobs open in United States: 25% remote, 1,736 posted in the last 30 days.

Wondering how well you fit this one? OptiTalent Career checks each requirement against your own record, privately. About OptiTalent Career →

About the role

What We're Researching

We are running a paid study to evaluate the quality and accuracy of machine learning model outputs. This work directly informs how AI systems handle complex research tasks and domain-specific prompts. By analyzing these generated responses, we can better understand where current models succeed and where they require further refinement.

How It Works

Participants will review a series of machine learning model outputs generated in response to specific research prompts. You will evaluate these responses for accuracy, relevance, and overall quality using a structured rating system. The project involves approximately five hours of independent work, which you can complete asynchronously. You will also provide brief written justifications for your ratings to help us understand your evaluation process.

Who This Is For

We are looking for subject matter experts across various academic and professional domains with a strong eye for detail. We welcome researchers, data analysts, technical writers, and domain specialists who can critically assess complex information. If you have experience evaluating technical content or research data, you will be a great fit for this project.

What You'll Do

  • Review machine learning model outputs across a variety of research tasks
  • Rate AI-generated responses for accuracy, relevance, and factual correctness
  • Provide clear written justifications for your evaluation scores
  • Complete approximately five hours of asynchronous evaluation work

Who Should Apply

  • Professional or academic expertise in a specialized domain
  • Strong critical thinking and analytical skills
  • Comfortable reading and assessing complex technical or research-focused text
  • Ability to commit approximately five hours to complete the evaluation tasks

Compensation

$75 per hour

Ready to participate?

Start your paid interview now

About Terac

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Learn more at terac.com or on YouTube at @jointerac.

Source

Posted by Terac on their own hiring page, jobs.ashbyhq.com. OptiTalent shows it as published, read 13 Nov 2026 01:12 UTC; the original is the reference.

View the original ad ↗

More at Terac

  • Terac · Canada

    RemoteContractFrom CA$100.00 an hourPeople & HR

    Translate real economic analysis into structured tasks for AI training; Evaluate model outputs for accuracy in forecasting, policy, and trade; Create detailed prompts based on economic impact studies; Commit 20+ hours per week to asynchronous remote work

  • Terac · United States

    RemoteContractFrom $100.00 an hourOperations

    Translate real-world insurance scenarios into structured training tasks; Document complex underwriting, pricing, and claims workflows; Review and validate AI-generated outputs for accuracy; Commit 20+ hours per week to remote project work

  • Terac · United States

    RemoteContractFrom $35.00 an hourPeople & HR

    Complete a 35-minute remote survey regarding your travel habits; Answer multiple-choice questions about resort and theme park preferences; Record clear voice responses detailing specific vacation experiences; Provide honest feedback on what makes a trip successful or…

  • Terac · United Kingdom

    RemoteContractFrom $5.00 an hourPeople & HR

    Answer a series of questions about your daily digital habits.; Complete a few simple navigation tasks on your device.; Share your honest thoughts and experiences openly during the session.; Provide feedback on what makes an interface easy or difficult to use.