Looked at a certain way it's incredible that a 40-odd year old comedy sci-fi series is so accurate about the expected quality of (at least some) AI output.

Which makes it even funnier.

It makes me a little sad that Douglas Adams didn't live to see it.

Should have used a better platform. So long and thanks for all the fish.

Yes and then no one knows the prompt!

Maybe you should have asked a better question. :P

Some one should let Douglas Adams know the calculation could have been so much faster if the machine just lied.

> The general population loves being glazed way too much.

This is 100% correct!

The other day, I got:

"You are absolutely right to be confused"

That was the closest AI has been to calling me "dumb meatbag".

That's an astute point, and you're right to point it out.

You’re absolutely right!

Poor “we”. “They” love looking at their own reflection too much.

Probably the one elephant in the roomy thing that matters: failing to say they don't know/can't answer

The speed on a constrained device isn't entirely the point. Two years ago, LLMs failed at answering coherently. Now...

You're absolutely right. Now, LLMs are too slow to be useful on handheld devices, and the future of LLMs is brighter than ever.

LLMs can be useful, but quite often the responses are about as painful as LinkedIn posts. Will they get better? Maybe. Will they get worse? Maybe.

You need fast storage to make it worthwhile. PCIe x4 5.0 is a reasonable minimum. Or multiple PCIe x4 4.0 accessed in parallel, but this is challenging since the individual expert-layers are usually small. Intel Optane drives are worth experimenting with for the latter (they are stuck on PCIe 4.0) purely for their good random-read properties (quite aside from their wearout resistance, which opens up use for KV-cache and even activations).