Model and Agent Benchmarks
Benchmark suites, leaderboards, datasets, and challenge environments for comparing models or agents; it excludes evaluation orchestration software that only runs externally supplied tests.
| Project | What it does | Stars | Language | License | Latest release |
|---|---|---|---|---|---|
| qwenlm/blenderworld | 223-task Blender benchmark with 2,651 checks evaluates agents creating editable 3D scenes from text, images and video. | ★ 124 | Python | MIT | — |
| composo-ai/dishwasherbench | Benchmarks language-model agents on goal completion in a physics simulation of a real dishwasher. | ★ 70 | TypeScript | MIT | — |
| cmu-l3/reuf2f | A benchmark where coding agents prove theorems or counterexamples in Lean-formalized undergraduate research problems. | ★ 9 | Lean | NOASSERTION | — |