At current prices you are also out about $4k for a Spark to actually run the inference on, if you want a full LLM in a low-power package.
In general, I'm not sure why one would want to pin your survival to an expensive, hallucination-prone data source, when an offline copy of wikipedia with a little vector search attached to a Raspberry Pi can fulfil the same role...
Sounds like the absolute worst time to rely on a crappy little model that will inevitably hallucinate.