The local inference is a product that came out of the data-center-driven AI.
replyThis is incorrect; the local model is a small dense neural network called BirdNET that would not have been referred to "AI" when it was published in 2021. The model outputs a bird species probability distribution and the web application displays an existing image file of the most probable bird on the screen. This is a lovely example of simple, offline, and fun project using a straightforward machine learning model.
replyOk, so why didn't this small dense model come up, say, 10 years back? Oh it needed all the AI evolution and concepts that were powered and evolved inside the data centers. But we still want to claim that it has nothing to do with the Big AI.
replyWhat a shame that we get a bird ckassifier by the samle technology we use to recognize cancer and other illnesses.
replyWhat a shame that you use that excuse to offset all other evils of AI, without even having a hint of how many patients were saved by AI. Just like how oil salesmen and nukes makers say that they solve some great problem of the world.
replyIncorrect. As others have pointed out, BirdNet is a “traditional” neural network. The amount of compute needed to train something like this is many orders of magnitude less than an LLM. Something like this could be trained on local hardware with enough juice, or by renting a handful of GPU’s
reply> came out of the data-center-driven
replyshould we tell them how hacker news gets onto their computer?
You assume that I assume that HN doesn't require data centers?
reply