It's perfectly safe to use LLMs to surface underlying data and knowledge without having to trust that it's giving you correct advice.
Use the LLM as search technology: string match -> semantic search -> search intelligence.
This is especially helpful when you don't know the right question to ask. Semantics only help you find text that is semantically near the input query. Semantics won't help you when what you are looking for is connected to what you have by something other than semantics, like causation, mechanism, or interpretation.
Trying to figure out why your crops aren't growing well will likely require you to read several articles across a range of sciences, probably scoped to the specific conditions you are dealing with. A semantic search is not going to surface those first.
Allowing an LLM to chain together several sources for you to read first does not require you to ask it for a conclusion.
They're amazingly useful tools, but they're nowhere the level believers want them to be, not yet.
I tried using dictation but I really disliked speaking to it.
You can write a really messed up sentence and it almost always worked out what I meant.
Quite amazing actually
How can I build a bow drill so I can start a fire?
It got it partially right: spindle, bow with string tied the correct way, and fire board. But then it flubbed by saying you put the spindle between both hands and move your hands back and forth to rotate the spindle and create the necessary friction… this totally ignores using the bow to rotate the spindle! It also mentioned “fanning the sparks” but there is absolutely no way your bow drill is going to create sparks.
I asked a frontier model to check the survival LLM’s conversation trace and it pointed out the errors.
I didn’t see obvious errors in the other 3 prompts I used, but this one seemed pretty egregious for a survival LLM.
I thank the creator for making this, but take it with a grain of salt.
its got a ton of useful options, preconfigured, integrates pretty easily, and can use any local LLM or data.
I have some property that doesn't really get cell reception in the summer, and even in the winter the reception is at-best spotty. I use granite and qwen together with a manually curated set of books, articles, etc. to get work done while disconnected. I tend to update the set of resources before leaving town because I'm generally intentionally disconnecting to focus on deep work. Building a workflow that makes that possible has helped me build out a setup that replaces a ton of my day-to-day anthropic/openai use even when I'm near fiber.
It is interesting how, even pre-llms, offline computers change the nature of a lot of activities. E.g., about once a year I'll walk do a random walk in the woods for a few days without paying much attention to maintaining a bearing. With maps and compasses it's a whole skill set to find your way back. With a phone and downloaded maps you just kinda press the power button and check your heading every hour or two.
The "survival" use-case is interesting. I fear a lot of the practical applications of that knowledge are either time-sensitive (e.g., RAG on a "Stop The Bleed" course won't help because by the time you learn the patient is dead) or require tools+skills that aren't easily improvised completely from scratch in high-stress situations (e.g., building shelter or even really simple stuff like building a fire when it's very cold out). And for other stuff common sense prevails (e.g., power out -> keep fridge closed).
This seems redundant and requiring more overhead while providing less reliability than something like Kiwix to me.
That way the tiny model isn't acting as a potentially incorrect interpreter but you still get semantic search to help you find the right documents quickly.
I suppose there is something to be said for a good summarization, I just worry that these tiny models aren't really GOOD summarizers.
I'm all up for using the better/simpler task for the job. That's been a thing lately also with the Jev/decision models hype, most of those things can either already be done by a pretrained classifier[0], or you can start with a bigger model and then train your smaller/adhoc one when you have some data (it doesn't even take much for most applications, you can get about 95% accuracy on email classification with 50-100 examples)
0: http://jeffyclassify.com/blog/when-llms-fail-at-classificati...
The bigger issue in this context would be canning, such as incorrectly explaining the mechanisms to avoid botulism (acid and/or pressure canning), or perhaps incorrectly wiring in repairs. However, again, it’s best to practice with these prior to emergencies anyway.
It should be noted though, that the model does source its claims, so you can fact check it and should review this information regularly.
Consider they won't have access to the plentiful practice opportunities we have now, most resources would have to be spent with a practical goal.
A field guide to foraging for edible mushrooms will probably be more practical than naïve use of an LLM: “can I eat this mushroom?” is an exercise in trust that I will maybe never be comfortable with.
But “how do I effectively forage for edible mushrooms” is a great stepping stone.
Kiwix is great, but I'd also like a language model to be able to deeply interrogate all of that information much faster than I can read.
Just arrange its harness so that its responses are grounded in the source material and require source citations for everything. Then read the citations to confirm it's not a hallucination.
You can run bonsai2 27b on basically any gaming GPU from the last 15 years including on game consoles.
Everyone has access to this stuff now if they bothered to look beyond the marketing from big labs trying to collect subscription revenue.
I work on compilers, kernels, and operating systems using exclusively consumer GPUs.
If things are so bad that you need to factor in the non-operability of any electronic devices, how many indestructible paper libraries are you planning to build and manage in advance, and at what budget?
If there's any place to get an answer it's here.
Bravo my friend. And I mean that in a good way. Love me some diversity.
That seems to have been mostly solved through scale. I was asking Opus 5.5 about some obscure stuff and it kept hedging "this is from memory since I don't have internet access" (it's sandboxed), "I'm reasonably sure about this but not about the numbers" etc.
Even though it was obscure enough that Google couldn't easily find the paper that Opus remembered (I couldn't find it at all with the traditional search results; the AI summary found it on my third try), it actually didn't hallucinate it.
In fact I can't remember Opus 5.5 ever hallucinating. They've clearly done some work on that.
Obviously this local LLM is going to hallucinate all over you though.
Undoubtedly useful in the right contexts, particularly for local repair or homesteading, but “survival” does imply that this would be more useful in an SHTF situation.
So on a regular consumer machine this is going to be wrong nearly half the time. Great! Let’s hope it’s only on the simple stuff and not the “how do I perform an emergency appendectomy”.
Honestly, just buy some books.
I’m pretty sure it also told you how to butcher a sheep.
I used to be obsessed with it as a kid. The spectre of nuclear war and a three volume handbook on how to survive the impending apocalypse with nothing more than a plastic bucket, a packet of potassium permanganate, some charcoal and string. The late 80s and early 90s were a wild time to be a kid.
>The app is the same everywhere. When it opens, it checks your computer's memory and downloads the AI model that fits. More memory means a smarter model.
first thing an emergency tool should require, internet access.
at first glance I figured it'd be an ultra small specialty trained survival model that'd be small and runnable anywhere, sorta like an emergency flavored version of those tiny tts models that have been all over recently.
Maybe that's an idea for someone.
I found Project Nomad (https://projectnomad.us) which looks more polished. Any other suggestions?
Some kid with the right prompt will supply chain attack a dependency of a dependency of firmware for border routers just to watch the world burn, or runaway AI swarms will saturate all bandwidth. Or a Linux kernel zero-click vuln. So many ways this can happen.
Better to prepare a bit and never need it.
I’m currently using https://kiwix.org for the offline access to Wikipedia, but your Survival LLM looks even better.
What about no power? You gonna run your generator for your local model? What are we doing here? Have we lost our way completely?
Solar panels and batteries are great for emergencies, and they're useful besides.
Solar panels? You can go down to Harbor Freight right now and pick up a setup that will run a laptop or tablet for a while, for a couple of hundred dollars. One wouldn't have to spend a ton more to get a setup that can run a decent PC with a GPU for at least a little while.
I mean, you're probably not going to run it all day, especially not in the part of year with fewer daylight hours, but anything's better than nothing. Plus the same solar setup can be used to power other useful things.
Edit: see project nomad.
Helps you download a local LLM and offline Wikipedia. Probably easier to just ask your favorite agent to glue something together yourself these days.
Apocalypse emergency I don't need help on. My crisis brain has collected more than enough info and capabilities over the decades.
The source (data collection) seems the most important feature here worth reusing.
From the command line: unsloth studio
Browse to the URL it gives you (eg http://127.0.0.1:8888/)
Download a good fast local model e.g. Gemma-4-12B (small machine) or Qwen3.6-35B-A3B (larger memory). Or a Nemotron model, if you prefer that.
Then you'll have both your backup/emergency assistant that runs on your own computer and be gaining skills in a common, frequently-updated, well-supported program.
Five minutes of clicking and a (small) power station is a small price to pay when survival could be at stake.
This project at least attempts to ground its answers with (presumably) human-vetted sources. That will make it much, MUCH more accurate and truthful than a bare model. But there is still a non-zero chance for it to hallucinate answers, especially when posed a question that it doesn't have any source material in its database.
As for why bother hooking up an LLM instead of a simple search engine, search engines don't synthesize data from multiple sources into a coherent answer for you, but LLMs are (mostly) great at that.
That said, while I like this pattern (LLM + knowledge base) for lots of things, this isn't necessarily something I'd trust with my own (or my family's) survival.
I think if I had to build an emergency LLM today, that had to run on modest hardware, I'd bet on Gemma 4 12B. It's got excellent reasoning and good vision/audio and speaks 140 languages.
But, I don't know about the "classic" knowledge base theory, though. Is there a high quality curated pile of survival information that could be bundled into a web UI and made searchable in a knowledge base? The LLMs aren't focused on that topic, so there's a lot of wasted space, but they know a little about a lot of things, including survival topics. Combined with Wikipedia, and maybe a few other sources, you're probably better off with one than without.
I guess one could use some huge models plus web search to compile/distill a focused survival knowledge base or LLM.
Edit: Project NOMAD seems to mostly be exactly that. It has authoritative sources in a searchable knowledge base and the tiny LLMs are an afterthought, which is probably what they should be. https://www.projectnomad.us/
tl;dr: Local LLMs are really really bad at offline navigation.
That said, pairing the survival guide with a library is totally the right move.
I'd put in this also a ton of software documentation, minimally for Rust.
And a bunch of scientific literature.
(It's helpful for shorter outages. But "survival assistant", I think not, unless you run a compound)
But kidding aside, this is an interesting reveal on the ease with which a custom LLM can be spun up to fit a particular niche application, especially for systems not meant to host an LLM.
In a theoretical scenario where the internet is gone and isn't coming back: If you can deal with a very low token/second rate there's no reason not to store 'offline' a much larger model like qwen 3.8-flash-next or deepseek v4 flash 1017 and use an inference engine which can stream-read it off disk to extract the information you want, albeit slowly. Of course also download and use things that'll fit in RAM, sure, like the qwen 3.8 27B in the linked page. But no need to restrict yourself to only smaller models.
Just look at those specs needed for accurate-ish results. You really think your 128GB Mac Studio or Framework desktop is going to be able to work in a real emergency situation? Even if it is, how long will it last? What about those precious seconds waiting for inference?
The danger here is less hallucinations and more, well, everything else about it. Instead of setting this up, take the time to make sure you have a restocked first aid kit and enough water for a week of use by your household. Stock up on meds and non-perishable food. Plan exit strategies and contingencies. Acquire and store little first aid booklets or manuals of common survival tasks in physical form (or hell, throw onto an eReader - infinitely more battery life than an LLM host in an emergency).
This is one of those “sounds good in my head” projects that folks with emergency experience would bristle at. This is a hindrance, not a helper.
Also: "Apple could not verify “Survival LLM” is free of malware that may harm your Mac or compromise your privacy." This is obviously some vibe coded trash from an inexperienced dev.
This is a great example of how Apple's "scare warnings" completely work to mislead folks about what they are actually warning you about.