law of diminishing returns? i.e. any reasonable frontier lab will have enough user logs...
replyMy theory is there is actual knowledge in the user logs.
replyWhen a user says "I'm struggling to undo a bolt on my 1952 Mustang" and the AI responds "try hitting it with a hammer" and the user replies with "that worked thanks" - that is a tiny piece of knowledge which exists nowhere else.
Future AI's can say with more confidence that hitting it with a hammer will probably work.
Across billions of conversations, that can add up to more knowledge than all books.