upvote
My experience with questions to LLM is that they mimic reddit a lot: ask them an apparently simple thing that is not possible, and they will bend backwards to tell you it's possible and give you tons of convoluted possible solutions. Ask them a thing that is possible but complicated, and they will be overly dismissive. The good thing however is that between those two banks there's a wide river of utility...more often than not they'll at least mention things I haven't considered before.
reply
shallow immediate confident authoritative answers; upon inspection falls apart immediately. sometimes can be beaten by repeat questioning into wisdom. by accident, beauty witnessing unfathomable NPC stupidity, but also invokes a hidden genius operating as though designed to troll first

ya, that is my experience as well

reply
I just did this test with Gemini Flash-Lite 3.1:

> Can you use a raspberry pi pico W as a USB WiFi adapter

> Yes, it is possible to use a Raspberry Pi Pico W as a USB Wi-Fi adapter, but it is a project that requires custom firmware and a clear understanding of your goals.

Then goes off and lists the things you’ll need which at a cursory glance seems like good starting points.

reply
Exactly, bit banging an 8-bit bus isn't that different from pushing the data out of the USB port. It would be great to try an LLM trained on pre-1900 documents and ask it if powered flight is possible.

Great work on PicoGUS.

reply
does the LLM speak old english ???
reply
English around 1800-1900 reads almost like modern English. At least if the author didn't write in an overly pretentious style, which was more common back then
reply
It's often good to approach what llm said as a guidance, and not as ground truth.

You can ask follow up questions or point to potential feasibility and it will change its answer.

reply
"Guidance" that's often wrong and that will change if I ask a follow-up question? Wow where can I send my money??
reply
I'm not sure even treating it as a guidance is the best approach, generally you should challenge it a lot (which is what CoT kind of emulates), you never know what it is confabulating and when it is correct.
reply
Yes, but. I asked Perplexity Pro the same fact question (sports) three days in a row after correcting its error the first day and having the correction acknowledged with a promise to get it right in the future. Same error on second day, same promise. Third day: correct. Perhaps it needs to be in the "Slow" classroom....
reply
I've never used Perplexity Pro, but I would expect the exact same outcome from Claude, as I don't have cross-session memory enabled.

If you do have cross-session memory enabled, I agree this is not glowing performance. If you don't, then I think it's working exactly as intended.

reply
I just asked if cross-session memory is enabled on my account: it replied that it's still being rolled out.
reply
perhaps we should stop personifying organized dirt
reply
It is "grounded in reality" and changes its answer like the weather.
reply
No, Claude, etm are for "Entertainment purposes only", as listed in their TOS.

You know, like the same for horoscopes and psychics.

reply
Perplexity still exists?

I just got major Dotcom vibes

reply
stopcitingai.com. Been trying to say this as much as possible.
reply
It was Gemini Flash, probably an even faster variant optimised for immediate response on search pages.
reply
> Interesting that Gemini said it was infeasible.

Unless there is a hardware limitation or the hardware does not support it, anything in software is possible.

Gemini and all these other LLMs are designed to convince you that they have "awareness" which they do not have any of the sort. They are neither sentient nor do they have consciousness

reply
Something doesn’t have to be sentient or have consciousness to answer a technical question like that.
reply
Bad take. Some things are feasible and some things are not, "anything is possible" is a useless framework. Example: go convert two smartphones to communicate p2p over their 4g radios - it's all software!

LLM "awareness" is similarly irrelevant. They process information usefully, in a way grounded in reality, and that's that.

reply
You seem to be all over the place, most of it by not reading the parent's comment. So let's break it all down.

> Bad take. Some things are feasible and some things are not, "anything is possible" is a useless framework.

It would help if you quoted the entire comment rather than removing the context and further giving a very bad example afterwards:

> Example: go convert two smartphones to communicate p2p over their 4g radios - it's all software!

Nice try. That is a hardware limitation in the 4G radio which is designed to connect to an operator mast. Even if you wanted to do it in software, the hardware does not support that P2P use-case which is what I already said.

> LLM "awareness" is similarly irrelevant.

Exactly. There is no such thing as awareness in LLMs.

The parent comment I replied to believed that an element of awareness had to be present to give an answer because this was done "several times over" in open source projects. Which that is inaccurate in the context of LLM research.

>> "It should be aware that using a Pico W as a transparent ethernet bridge has been done several times over in open source projects..."

> They process information usefully, in a way grounded in reality, and that's that.

Useful to those who know when it is either mostly correct or outright wrong.

Clearly in this example, Gemini doesn't even know if its own answers are grounded in reality and consequently people using them are unable to determine if the results they bring are true or not and there are countless examples of that.

So you know what you just said is not true.

reply
> That is a hardware limitation

Sounds like a intentional firmware (aka: software) limitation to me?

reply
If the hardware won't accept custom firmware without signed with a private key, I'd say that's hardware limitation
reply
[dead]
reply