Anybody working in the field will be very familiar with these concepts.
reply…for years. Because it is so apparent if you actually try to look at the problem and what is being solved by it.
replyThe extraction of features from a corpus, the features significant to certain solution, is always and since day zero - compression. As this is the definition of compression - efficient and potentially lossless feature extraction.
common theory. see https://prize.hutter1.net/
replyAnd the Hutter Prize for AI which measures how good AI is by measuring how well it compresses data is over 20 years old now just to really drive the point home.
replyIt's basic information theory, which has been around since the end of WWII. It's a common topic today because some of its subtle insights are becoming increasingly relevant in our current era of AI, as we learn to understand these black boxes.
replydeleted
replyit was vaguely in my understanding of information & intelligence with compression; it was also brought up in several of the initial trials against AI companies where they discussed how the AI is akin to compression.
replySo they're both sourcing a bit broader zeitgeist.