upvote
I try to always mention that AMD ROCm has come a long way. Like the B70 the Radeon AI Pro 9700 has 32GB of DDR6 640GB/s. Also $1300 a card. Very capable cards now in mid 2026. Great for dense models in the 30B range. I'd go strix halo or DGX spark if you want to run the 120B range of MOE models.
reply
A 3090 never came with 32gb of vram
reply
I got B70 few days ago. Running on CachyOS. 9070XT on PCIe x16 and B70 on the x4.

ROCm nightly was pretty easy to setup and get up running. The 9070XT has been a decent card for my use cases.

But the SYCL ecosystem versions. Absolutely horrendous and everything is hundred commits behind. Vulkan is probably the only way forward with this card.

reply
This is very interesting. I've only heard bad things about B70's performance with Vulkan, for example this Reddit link mentioning a Phoronix review: https://www.reddit.com/r/LocalLLaMA/comments/1sgdt7t/comment...
reply
Interesting that Intels latest consumer GPUs only have 10 and 12GB respectively for the B570 and B580.
reply