An AMD GPU Beat My Mac on Llama 8B. The Same GPU Lost on Phi-3.
Same hardware. Same benchmark. Opposite winner depending on model size. Cross-platform inference numbers on Mac M2 Pro Metal, Linux RTX 2080 Ti CUDA, and Windows RX 6600 XT Vulkan, plus the hardware tier ceiling none of them clear.
Rob··6 min read