Topic
search-quality
3 posts
- Evals7 min
A tie at four hundred queries was a loss at fifteen hundred
Statistical significance and sample size in search tuning: four hundred queries said one parameter made no difference, and fifteen hundred turned that tie into seven lost answers.
- Evals6 min
Eighty-three percent of my zero-result searches had nothing to find
Zero-result searches, decomposed: only a small slice was a search defect. Most of the volume was asking for products that do not exist.
- Retrieval13 min
Three percent of my index was eating the top five results
Semantic code search crowded out by docs: 89 documentation files sank one repository, and removing them more than doubled MRR. The same fix on five other repositories moved nothing.