If you could buy a 256GB you’d be claiming that 256GB is a sweet spot. But I agree with you. Crack-tokens are not the future.
replyno, the fact that MACs and x86 and soon ARM are all going to have 128GB models in every sector, yeah, sure.
replyBut watching everyone flounder because claude goes down or forcing you on API costs.
I'm programming things that'd take me days with a PC that, without OpenAI's VRAM shenagans, would cost you $2k.
It's more than just 'this is what I could do' it's definitely about 'this is what anyone could do with a new PC purchase'.
You must be unaware that System76 was already selling 192GB machines, mac studios used to be 512GB max. The only reason why we don’t have them anymore is that we are in RAM shortage.
replyThose 192GB aren't unified memory though. 128GB on Mac or 395 can be used by both CPU and GPU. It's the GPU + large memory that opens up fast local LLM inteference.
replyYeah, those aren’t. But if we had the ability to buy that much RAM in the laptop then everyone would be looking in that direction. Until this thing discussed here comes to the market, “we didn’t have computers with unified 128GB RAM either” (except of macs).
replyI'm aware you can have more. the term "SWEET SPOT" references a area that anyone/everyone can get to and isn't some magical expensive unicorn.
replyYou're doing what the IT industry has been addicted to for decades: number goes up.
> You're doing what the IT industry has been addicted to for decades: number goes up.
replyNo, I have a hands on experience with bigger models, and understand the advantages of using them.