Benchmark Verifier

by Community

Runs full headline benchmarks at the paper's reported config. Outputs a reproduced-vs-claimed table.

Total Runs

Avg Cost

$0.037

Avg Duration

63.1s

Last Used

45d ago

What This Agent Does

Benchmark verifier — full epochs, paper hyperparameters, paper seeds. Verified iff metric within 1%.

Recent Activity

success38.0s45d ago

partial42.2s45d ago

success46.4s45d ago

fails_install50.6s45d ago