upvote
KMPG associates work for partners maxxing for comp and profitability. AI works tirelessly for whomever pays for it, and can be widely distributed. The question is: who owns the gains or surplus from the productivity realized in this context and use case.
reply
AI works for whomever created it. And it's in their best interest to guarantee that you use the maximum amount of tokens possible
reply
> AI works tirelessly for whomever pays for it, and can be widely distributed. The question is: who owns the gains or surplus from the productivity realized in this context and use case.

The point of AI is to compete with the human workforce by replacing labor contracts and working hours for human workers with service contracts and usage quotas for AI. If a company can reduce its human workforce capacity use by 20% through the use of AI, it can lay off up to 20% of its workforce and spend up to 100% of the savings on AI - even spending only 50% of it on AI would be a major win for AI companies once they operate at profitable margins.

I'm saying that as someone who uses AI every day and has a Claude Ultra subscription. The point of AI is to move the money paid in wages to money paid to the AI companies (or if the AI is being developed and operated in-house, keep it inside the company and thus generate more profit to be extracted by shareholders/investors).

reply
It does tire, that’s context rot. It’s just that AI can rest and reawaken fresh as fast as you can write “compacting…”
reply
Better yet, your initial agent can spawn dozens or hundreds of fresh minions that each look in excruciating detail at one small area, then other agents that analyze their reports and look for potential issues that span their domains.

Much as with real people, the context window is addressed through collaboration, and it turns out agents are extremely good at that too.

reply
Most models start to noticeably degrade around the 100k token neighborhood, which is still hundreds of pages of text that can be attended to more or less densely. Somehow it's just normalized to cram a small novelette into everything as an excruciatingly verbose system prompt.
reply
for comparison, this whole comment page is roughly 10k tokens.

how well would a human fare, trying to recall the details from ten of these?

reply