NVMEs are much, much slower than RAM. Especially unified/soldered RAM.

To be fair, llama.cpp had this feature for over a year now. It just applies to GGUF.

I got an m3, I will test it on metal and check how it goes