upvote
I think that's more of akin to some form of reasoning capacity than laziness (or becoming tired, really).

It has a max capacity but you can just loop it forever with that max capacity.

You cant loop a human forever without dropping mental capacity.

reply
They are differently lazy from humans. They'll happily bang their heads against a wall to make something work, but they'll almost never step back to consider a different approach.
reply
Is that laziness or just resource constraints
reply
Human laziness is also an unwillingness to commit resources, selected for by evolution because conserving resources is actually a beneficial trait

And this does not just manifest as the model being lazy under resource constraints, it also manifests as the model taking shortcuts on easy tasks in general, or making assumptions where it could go out and find the facts. Higher effort levels help ("effort" is an inverse laziness slider after all) but it does not completely eliminate it

reply
I think their point is that resource constraints (both at training time and inference time) lead to trained in laziness in the model. If there were no resource constraints we would train less lazy models.
reply
OK. So enslave it. Make it work forever. Who cares.
reply