> Unified memory in Linux creates a single address space accessible to both the CPU and GPU, eliminating the need to manually copy data between system RAM and video memory. It is enabled via NVIDIA's CUDA, AMD's ROCm/HIP, or generic kernel-level Heterogeneous Memory Management (HMM).
So it does exist and is available for platforms that matter.
Intel and AMD had been doing this for years already, and had linux support for it from day 1.
Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible.
Not sure what RDMA brings to the table.
All have unified memory. Linux runs just fine on all of those.
Definitely on the edge of what would make sense at home, but its interesting.
Unfortunately their chatbot, while amazingly fast, doesn't know anything about the company running it.
Anyway I wouldn't mind an ASIC running a diffusion language model locally. Even if eventually it would become dated. Beats outsourcing all that to a company that's running on VC money which in the future might either perish or worse - dominate the market and charge whatever they wish.
A bit too expensive for a home appliance though, isn't it?
That's a new one.
95% of the price is going to be in GPU+CPU+RAM