Or just.. download the books, and slap a search engine on top of them. It'll be like 10x smaller than the model. "Survival LLM" is absolutely a non-relevant use case.
replyWhen you’re living in an igloo trying to stay warm in the hollowed out belly of a cow having a few books around the place is probably more useful than some files on a laptop that ran out of battery just before it got morbidly damp. Plus you can burn them if you really need to.
replyOn the other hand, the laptop struggling to power a good-enough LLM will probably be a great heat source for you in that igloo... for about 45 minutes.
replyAs I said elsewhere, you can always burn the books! And eating a laptop is considerably crunchier and more fraught than chewing through some good old fashioned leather facings, horse glue and nice heavy 120gsm wove.
replyOn the other hand, if you know enough to build an igloo, you're probably going to be ok regardless.
reply"cow in an igloo" sounds like something an LLM would hallucinate.
replyYes I slightly mangled that one. But I’m sure there is a survival technique that involves crawling into the body cavity of a hollowed out cow. You probably wouldn’t want to do that in an igloo though. I’m not even sure you could get a cow into an igloo. If standard issue humans are this flawed it’s hardly surprising that top flight LLMs get things so wrong sometimes.
replyAnd/or install Kiwix and grab an offline copy of Wikipedia.
replydeleted
replyIf you have AI model there it can make any search engine for you as per your needs.
replyThe advantage of a turn-by-turn flow (honestly the chat interface was genius) is that with a little human intervention you can get much better results out of even silly models. The model of choice is strange, though. Not a particularly good one.
replyPeople apparently like Granite for RAG specifically. I'm not aware of any evaluations with numbers though, so I'm not sure if it's a real difference or just vibes.
replyEither it depends a lot on the model, or I’m bad at chat, or both, because in my experience once a chat starts going off the rails it’s pretty hard to correct the initial misconception. I find it works better to backtrack to just before the misconception and edit my previous response to head it off at the pass.
replyDefinitely agreed that it's better to not have some text in the context than to have some that needs to be opposed. I suppose I meant steering prompts are a non-obvious innovation to LLM interaction.
replyWhat is your favorite book on emergency appendectomies?
replyWe had a set called something like “How to do anything in an emergency” which had instructions for this and more. Alongside lots of creative uses of potassium permanganate.
replyI’m pretty sure it also told you how to butcher a sheep.
I used to be obsessed with it as a kid. The spectre of nuclear war and a three volume handbook on how to survive the impending apocalypse with nothing more than a plastic bucket, a packet of potassium permanganate, some charcoal and string. The late 80s and early 90s were a wild time to be a kid.
I have a bunch of military field manuals and survival guides, but they all implicitly presume the existence and contactability of civilization sooner or later. Realistically, some pocket computer(s) and solar charger(s) will store far more information, be far more portable, and give you more carrying capacity for things like medical supplies, rope, tools, and other hard-to-substitute items.
replyHave you re-read it recently? Some of those books were fun to read but not really something to use as a field manual. Then again some of them were great! I had a book that started with explaining how a battery and a light globe worked, went through how to make a DC motor out of copper wire and a cork, and ended with a crystal radio and I think a radio homing beacon (the latter might have been in another book.)
replyI have not, sadly. But I’m pretty sure I also had the book you mention. My brother and I made our own motor and many other things that would now be considered entirely unsuitable for 10 year olds to be doing. Copper sulfate crystals seem like a great idea until you have to explain why the playroom carpet has melted.
replyGranite is not great at any size. Wonder why they picked that.
replyGiven the whole thing reeks of vibe I don’t think anyone picked anything.
reply