>can run on anything now: (link to turbo fieldfare)

Except the build process there requires a specific recent version of swift. Hardly a good definition of "anything"

I like this "both / and" approach. Restructure this project to have the LLM source from local Kiwix data you've selected to make available offline, rather than a source of data you're unfamiliar with. References point directly to your Kiwix library.