Our researchers come from
I.Quality first.
Environments
Quality is our strongest focus. The best data requires the best experts, and the toughest QC in the business decides what ships.
| Expert data you can buy | Synthia environments | |
|---|---|---|
| Experts | vetted contractors | only from top companies and top 5 schools |
| Reward | not reliably indicative of model performance | verifiable and reproducible: tracks real progress toward a solution, no random or non-deterministic checks |
| Difficulty | some evaluation against frontier models | calibrated by reward variance to target capability gaps |
| Quality control | some quality control | rigorous checks for contamination, provenance, coherence, exploit resistance, etc. |
II.Research.
Publications
We write up what we learn building environments: which task designs separate frontier models, where reward hacking shows up, and what our QC actually catches.
- September 2026 · Benchmark
Goldilocks Bench
A double-sided benchmark that measures whether coding agents take agency at the right times, in the right situations. 13 models from 7 providers scored, no LLM judges.
