I think the fundamental difference is that humans aren't trained on experiences. They make experiences. Models are just thrown away and re-created after each conversation / job.
replyIf you could clone and throw away human workers as you need them, a lot of the morale would disappear.
>Models are just thrown away and re-created after each conversation / job.
replyIt's a property of the way we use them and how the harness is engineered. Sure, LLM has a limited context, but so do people. Context can be compacted infinitely and experiences cab be distilled into long-term memories. It's all up to the harness.
Yes, why not? All existed models have been rewarded for cheating (extensively). That is us, putting intense evolutionary pressure, on a system to produce a result we don’t want through indifference. Why can’t we post train them not doing that?
reply