slowbench
SearchAbout
RetrievalInferenceEvalsAgentsSeriesFindingsBenchmarksArchive

Four wrong measurements, in order

The GPU investigation

An afternoon's work that took a week, because the first three measurements were of things I had set up badly. Read in order: the mistakes are more transferable than the result, and each one looked reasonable while I was making it.

1 posts

  1. 1
    Inference6 min

    I measured Metal wrong three times before it beat the CPU

    The GPU looked slower than the CPU in every early run. All three of those runs were measuring something I had set up badly.