upvote
Maybe Karpathy used an LLM too. The 44 TB number, happens to match exactly the currently largest available drives sold for Enterprise by Seagate, not 40 TB, not 50 TB but 44 TB...coincidence ? - [1]

For SSDs record seems to be 245 TB - [2]

[1] - https://www.seagate.com/stories/articles/seagate-delivers-in...

"Seagate’s Mozaic™ 4+ hard drives supporting capacities up to 44TB are now shipping in volume to two leading hyperscale cloud providers."

[2] - https://fudzilla.com/kioxia-showcases-245-76tb-lc9-enterpris...

reply
I agreed when I read your comment, but that turned out to be almost directly from the video https://youtu.be/7xTGNNLPyMI

From around the 2:20 mark he says:

“[…] actually ends up being only about 44 TB of disk space. You can get a USB stick for like a TB very easily, or I think this could fit on a single hard drive almost today”

So it’s just slightly altered from what was said in the original video. And the LLM rewritten version of it also says “roughly” where he said “almost”, and I guess 44 TB is pretty roughly or pretty almost 32 TB. Although I’d still personally probably put it as “can fit on a pair of decently sized hard drives today” (for example across two 24 TB drives).

Regardless, it’s close enough to what was said in the source video that it’s not something the LLM just made up out of nowhere.

reply
reply
That thing is like 10,000 bucks. That's not what I'd call a consumer hard drive. In fact there's already another one with 245TB. But you probably won't see these outside datacenters for a while.
reply
> But you probably won't see these outside datacenters for a while.

That's especially true now that Data centers spendings are crazy high.

reply
deleted
reply
Hard drives are currently scarce due to market factors, so it's not surprising that 32TB is the biggest in your local retailer, but 40tb+ ssds were a little more widely available a year or two ago.

Still obviously crazy to consider that any kind of "average" or common size, but certainly not outrageous, especially for someone working in that field.

reply
Yes claude is being dumb/hallucinating. Yes it does exist, there are much larger drives than that produced by the main manufacturers
reply
Even if those things are true, no reasonable person who knows what they're talking about, and who writes for an wider audience would say something like "you end up with about 44 terabytes — roughly what fits on a single hard drive" though.
reply
Thats what i said
reply
What you comment currently states, is basically "It's possible" which yeah, I guess I said too. But doesn't seem you said something like "no reasonable person would say something like that", which for me was the main point of my comment...
reply
You're probably hallucinating. The parent comment is quite clear.
reply
Seems we might be two then, I never said I think parent's comment wasn't clear :)
reply
My statement had two sentences. You chose to read only the second for some reason. We dont disagree, respect
reply
Sorry, we must be reading two completely comment threads. Hope you'll have a nice weekend regardless, take care! :)
reply