We're sharing one of our latest eval environments.
Introducing the Parallel Games Eval (PGEval), an eval built by Synthia Research. This long-horizon eval is the first of its kind and we’re excited to share more at the eval’s dedicated site: pgeval.com
At Synthia Research, we work on evals and benchmarks like this to measure and improve model performance across fields such as coding and ML research. If you’re looking to work more with high quality evals like this one, feel free to reach out to us.