upvote
> hand out free top end model coding access for a bit and you'll very rapidly have developer data

They tried this - grok was free on openrouter for a while

reply
It's more useful to have access your full code base compared to having access to only your input and the output they generate.
reply
Marketing push was there too, everyone was saying Grok had jumped Claude and Codex, yet I never got that when using all 3.
reply
Turns out that benchmaxxing doesn't help if it's not very good when people actually try it.
reply
But imagine if they handed out free access to Kimi or GLM-5. Actually, I still wouldn't use it, because I avoid APIs that say they hold on to data.
reply
And presumably they got data from it...
reply
and then released a model that didn't really leave a mark with code performance
reply
But if the developers are to presumably use the model you give out, what data are you going to get from them thats useful?
reply
I don't know - was GP speculating that there is value there on a scale to justify 60B no me
reply