Eh. Trading CUDA for 8 more gigs seems like bad deal, unless you know absolutely for certain what you want to run will run on it.
replyUntil NVidia prices get better, I’ll build out with the Intel stack and keep the cache (and prompt processing speeds) happy.
replyAs for software, anything that has a SYCL or Vulkan backend, and/or can be Intel optimized (especially to the same degree as llama.cpp) can run well.
[dead]
reply