Human data for AI training and evaluation

Skilled teams that create and check your AI training data.

Image and video editing, model evaluation and STEM reasoning data, made by trained specialists. We add 10–20 people to your project within a week, and every engagement starts with a paid pilot.

  • 50,000+ tasks delivered
  • Since Sep 2024
  • 10–20 people in a week
  • NDA before any work
Delivery pipelineEnd to end
  1. Source
  2. Produce
  3. Review
  4. Grade
  5. Deliver

Matching domain experts to the brief

Task coverage

Task types we staff and scale.

Image and video editing, preference rating, expert reasoning and multimodal QA. Coding and agent benchmarks are available on request through our expert network.

Visual & creative

Image editing, illustration, video, design critique, and recorded workflows in Photoshop, Figma and Canva.

Image editingIllustrationVideoDesignCreative tools

Physics & chemistry

Quantitative reasoning, lab protocol review, and derivation checking.

DerivationsLab protocolsThermodynamics

Software & agents (on request)

Repo-level engineering, terminal workflows, and tool-use traces captured from real debugging sessions.

Repo-levelTerminalTool useDebuggingCode reviewTest authoring

Humanities & writing

History, economics and long-form writing and review in English.

HistoryEconomicsWritingEditing

Mathematics

Proof reasoning, symbolic manipulation, and competition-level problem sets graded against worked solutions.

ProofsSymbolicOlympiadStatisticsNumber theory

Life sciences

Biology, medicine, and interpretation of primary research literature.

GenomicsClinicalLiterature reviewPharmacology

Law & economics

Statutory analysis, contract review, and applied economic reasoning.

StatutoryContractsApplied econ

Domain coverage

Depth across the fields your model is judged on.

We recruit against the subject matter, so a chemistry eval is graded by chemists and a repo-level coding task (on request) by engineers who ship.

Coverage spans STEM and the humanities, and we build new domain benches when a project needs one that doesn't exist yet.

Why teams choose us

Precision that compounds across every batch.

Four operating principles turn complex AI work into dependable, repeatable delivery.

01

Domain-vetted experts

Qualified specialists are screened for the subject matter, then calibrated on your rubric, not pulled from a generalist crowd.

PhD / practitionerDomain matchedCalibrated
02

Benchmark-grade rigor

Pipelines are modeled on the standards used by leading evaluation suites and research teams.

03

Secure by default

NDA-first engagements, controlled access, and clear audit trails protect every project.

04

Flexible scale

Start with a 200-task paid pilot. We add 10–20 trained people within a week and keep the same rubrics as volume grows.

200-task pilot50,000+ tasks

One pipeline, same rubrics

FAQ

Questions before a first project.

The details teams usually want settled before scoping, from who does the work to how your data is handled.

Four areas: image and video training data (editing, illustration, captions and preference ratings), model evaluation and RLHF, expert STEM reasoning data, and dataset QA and annotation. Coding, agent and red-teaming work is available on request.

Credential-verified specialists (PhDs, practising engineers, and domain professionals) recruited against your project's subject matter, then put through task-specific onboarding and calibration rounds before they touch production data.

Multi-pass review with inter-annotator agreement tracking, rubrics calibrated against gold answers, and QA reporting that documents error taxonomies rather than just a pass rate. You get the failure modes, not only the score. For grading and RL tasks we also run an adversarial pass that tries to break each rubric or grader before delivery.

Yes. Alongside the public formats in our catalog we design bespoke pipelines for specialised domains, custom schemas, and internal evaluation needs that off-the-shelf benchmarks don't cover.

We scale from small pilot batches through to multi-thousand-task datasets. A pilot is usually the right way to calibrate rubrics and confirm fit before committing to volume.

Usually within a week. We add 10–20 trained people from a network of around 100 vetted specialists, run calibration rounds on your spec, then move to volume.

Every engagement starts with a signed confidentiality agreement. Access is role-scoped and revoked at project end, data moves over encrypted channels into controlled environments with audit logging, and retention is defined per project.

Ready to scope a project?

Turn your next AI data or evaluation challenge into a clear delivery plan.

Tell us what you are building, where quality is breaking down, and what a successful result needs to prove.