There's a shockingly unfathomable level of data compression that these local LLMs are able to remember in an encyclopedic way, so many obscure little things.
replyIs it? Compressed (text) Wikipedia is in ballpark of dozens of GBs.
replyDozens of GBs of compressed text is an unfathomable amount of information from a human POV.
reply