undefined

points

[-]

Sometimes I monitor thinking traces for misunderstandings (missing context / bad assumptions). If it's going to go off on a ~20 min task and I can catch it's going in the wrong direction in the first minute I save a lot of tokens and wasted time. I don't monitor the whole thing, mostly just the first bit to see if there was a gap or misalignment in intention.

As an aside, anthropomorphization has nothing to do with my motivations.

by qarl28 hours ago|

prev|

[-]

> The anthropomorphization of LLMs should be discouraged as much as possible.

And yet, they have extensive human-like behavior. If you treat them nicely or encourage them, they perform better.

Ignoring that human-like behavior is wrong headed.

by fedpost5 hours ago|

parent|

[-]

I think you're ending that train of thought too early. Why does this occur?

Well... We can hypothesize that these things are largely trained on internet dialogue so there's probably some correlation between threads where people are not flaming each other and the quality of the replies. They're just statistical engines so anything you can do to raise the odds of a helpful next token...

I'm essentially just making shit up here, maybe it's right, maybe it isn't, but rather than saying "it's human and we should treat it so" we're trying to get to the ground truth of how it works.

by qarl24 hours ago|

parent|

[-]

Did I say "it's human and we should treat it so"?

Sheesh. Yes, I agree with you entirely. I'm merely pointing out that ignoring this behavior is dumb, too.

And probably not rationally based. Leads people to make crazy jumps. :)

by fedpost1 hours ago|

parent|

[-]

Yeah sorry, I read too far into your position. There's a certain faction within these AI discussions that wants to over-anthropomorphize the LLMs in kind of a borderline spiritual way.

by andai5 hours ago|

parent|

prev|

[-]

A while back I made an "OpenClaw in 50 lines" by just wrapping Claude Code in a Telegram bot.

I asked it for the weather. "I don't know that. I'm just a programmer."

I added "believe in yourself, you can do anything" to sysprompt, suddenly it had the confidence to Google the weather...

by thaanpaa5 hours ago|

parent|

prev|

[-]

That's not a consequence of an LLM. It's a consequence of the training data. In fact, I would argue that the latest models aren't nearly as sensitive to the tone of input anymore. It's an issue that has been addressed by better curating training data.

by riversflow3 hours ago|

parent|

[-]

i would agree with your if it weren’t for this article recently published by anthropic:

https://www.anthropic.com/research/riemann-zeta

“Throughout this process, Jarred's input was mostly limited to sending Claude messages of encouragement (mostly variants of “keep going” or “believe in yourself”).2 This seems to have helped Claude overcome some initial skepticism that it could make meaningful progress.”