This is why I'm personally waiting for M5/M6 to finally have some decent prompt processing performance, it makes a huge difference in all the agentic tools.
This is how I know something is fishy.
No one cares about this. This became a new benchmark when Apple couldn't compete anywhere else.
I understand if you already made the mistake of buying something that doesn't perform as well as you were expecting, you are going to look for ways to justify the purchase. "It runs with little power" is on 0 people's christmas list.
It’s also good value if you want a lot of memory.
What would you advice for people with a similar budget? It’s a real question.
There is novelty, but not practical use case.
My $700, 2023, 3060 laptop runs 8B models. At the enterprise level we got 2, A6000s.
Both are useful and were used for economic gain. I don't think you have gotten any gain.
Two A6000 is fast but quite limited in memory. It depends on the use case.
Mac expectations in a nutshell lmao
I already knew this because we tried doing it at an enterprise level, but it makes me well aware nothing has changed in the last year.
We are not talking about the same things. You are talking about "Teknickaly possible". I'm talking about useful.
Fancy RAM doesn't mean much when you are just using it for facebook. Oh I guess you can pretend to use Local LLMs on HN too.