Topic
apple-silicon
2 posts
- Inference8 min
The GPU was not slow, it was waiting
CoreML made indexing three times slower. Utilisation said the accelerator was idle, and the cause was one padding setting.
- Inference6 min
I measured Metal wrong three times before it beat the CPU
The GPU looked slower than the CPU in every early run. All three of those runs were measuring something I had set up badly.