What is unified ram? RAM and VRAM as one thing?
replyBig ole pool of very fast ram that can be accessed by the CPU and GPU. Lets you run larger models. AMD does the same thing with Strix Halo. I have a 128gb machine at home, and have had difficulties running 120b models, but 70b and below run pretty well.
reply> Big ole pool of very fast ram
replyIt’s more that it’s a very parallel architecture than fast.
The LPDDR5X under the hood is slower than what you’d find in a graphics card vram of years ago
That’s why you get consumer macs with 512gb while GPU makers are reluctant to give you more than 16gb unless you pay dearly. It’s not the same kind of mem
AMD Strix Halo unified memory still requires allocating X to GPU, x to CPU at UEFI.
replySo not as flexible as apple's unified memory.
Not in Linux! See setting GTT: https://rocm.docs.amd.com/en/docs-7.2.0/how-to/system-optimi...
replydeleted
replyYep, exactly. It's just one shared pool of RAM with zero-copies necessary.
replydeleted
replyIn best case its also on-chip high speed ram.
reply