And the end results is.....? What? A todo app that takes 16GB of RAM?
replyNothing that Mac and Windows users aren't already used to.
replyIt’s tempting to be flippant about MacOS/windows but in all seriousness, the resources required for an LLM to do the job of a typical lighter weight app/software is a serious consideration. No amount of bloat matches what an LLM needs.
reply> No amount of bloat matches what an LLM needs.
replyI don't think that's necessarily true. For instance, LinkedIn uses more memory than Gemma E2B inference does.
LinkedIn is an entirely different category and an extreme case at that. We’re not talking about LLM’s replacing LinkedIn either. It’s an entirely different comparison/discussion.
replyFinally, we've fully documented the Singularity-is-actually-just-bloated software.
reply