slowbench
SearchAbout
RetrievalInferenceEvalsAgentsSeriesFindingsBenchmarksArchive

The lever nobody reaches for

What you let into the index

Model comparison is the visible knob — there are model cards to read and leaderboards to check, and it feels like progress. The largest measured improvement in this whole project came from deleting 3% of a corpus. These posts are about the decisions made before any model runs.

1 posts

  1. 1
    Retrieval24 min

    I could not measure the threshold where it mattered, until somebody could

    A 0.85 cutoff stopped being a test when the model changed, and fired 270 times out of 270. Three measurements at three prices gave three different answers about whether that mattered, and the variable was which one anyone could afford.