Strix Halo only supports 96gb of video memory then it goes to 32gb to the host system.
replyNo, I can go upto 112GB on my Strix Halo box running Linux. There are a few boot params to adjust, but it works.
replyyeah you are correct 2 bit quant won't be enough
replyguess we'll be paying $200/month for a while