>Yes a good phone can run a quantised 8B too.
replyMac expectations in a nutshell lmao
I already knew this because we tried doing it at an enterprise level, but it makes me well aware nothing has changed in the last year.
We are not talking about the same things. You are talking about "Teknickaly possible". I'm talking about useful.
If you are happy with 96GB of memory, nice for you.
replyI use my local AI, so: yes very much.
replyFancy RAM doesn't mean much when you are just using it for facebook. Oh I guess you can pretend to use Local LLMs on HN too.