| 11 Nov 2025 |
Daniel Fahey | That CPU has also got Intel AMX (Advanced Matrix Extensions)
We don't yet compile specifically for "XPU" in the vLLM derivation, but apparently would make CPU inference attractive. Maybe for another system without the H100s | 20:29:16 |
Daniel Fahey | Next gen will have https://www.hwcooling.net/en/intel-and-amd-agree-on-future-of-x86-cpus-amx-and-ram-tagging/ (last time I checked) | 20:30:27 |
Daniel Fahey | Hopefully NVIDIA see some disruption and all this gets a bit more accessible for us normal people | 20:30:58 |
Ari Lotter | that's the dream :) | 20:31:05 |