Hacker News
new
past
comments
ask
show
jobs
points
by
leothetechguy
12 hours ago
|
comments
by
ahmadyan
12 hours ago
|
[-]
even in pre-training, usually 30%-50% is code these days.
reply
by
leothetechguy
21 minutes ago
|
parent
|
[-]
That would be far too high in my opinion. But happy if anybody can give insights from their own experience with pretraining runs.
reply