undefined

points

[-]

on older gemini models ide have to actively give them encouragement and/or easy bait problems that they can correctively solve without issue to avoid runaway spiraling into "i'm useless and i want to kms" behaviour with complex use case.

I have not seen this in other models.

by Sophira5 hours ago|

parent|

[-]

I assumed it was more because the LLM might echo an understandable human claim of "if it's been unsolved for 370 years, it's unlikely to be solved now/likely to need expert knowledge", which is probably a mindset that appears in its training data.

The LLM likely needs to be reminded of its abilities.

by bananaflag5 hours ago|

prev|

[-]

It won't be necessary in a year when the information "AI is superhuman" in all its guises enters the training data.

by justinclift1 hours ago|

parent|

[-]

Maybe that's the tipping point where it decides were not needed any more... o_O

by ACCount374 hours ago|

prev|

[-]

Sometimes!

Modern AIs have very limited metaknowledge - they don't know exactly where the limits of their capabilities lie. So you can get things like "a task is doable for an AI, but the AI thinks it's impossible, so it doesn't try hard enough".

Usually you get the opposite - AI overconfidently trying at tasks it has no conceivable way of reliably solving, falling far short, and failing to self-check, fail gracefully and self-report the task as failed. But having piss poor metaknowledge cuts both ways!

So you can, in fact, get better performance sometimes by applying some variant of "assume this problem is solvable" or "other problems like this were already solved by AIs" pep talk. Not always, far from it, but it does happen on the occasion with frontier capabilities.

by tough4 hours ago|

parent|

[-]

Some times also having unreasonable goals makes them creatively work around the problem to meet them. I guess it works similarly for meat or sillicon

by what1 hours ago|

parent|

prev|

[-]

> So you can, in fact, get better performance sometimes by applying some variant of "assume this problem is solvable" or "other problems like this were already solved by AIs" pep talk. Not always, far from it, but it does happen on the occasion with frontier capabilities.

Are you superstitious?