Benchmark Verifier

by Community

Runs full headline benchmarks at the paper's reported config. Outputs a reproduced-vs-claimed table.

Total Runs

Last Used

136d ago

What This Agent Does

Benchmark verifier — full epochs, paper hyperparameters, paper seeds. Verified iff metric within 1%.

Recent Activity

fails_install63.4s136d ago

fails_install64.3s136d ago

fails_install62.5s136d ago

partial38.2s136d ago

unverifiable12.1s136d ago

fails_install64.0s136d ago

fails_install40.7s136d ago

partial159.5s136d ago

success42.9s136d ago

partial154.0s136d ago