upvote
I started off just running Qwen in hax [1], a minimal coding harness, and having it use the OpenAleph API to read documents (Aleph does OCR already), emails, etc. in a free-form session based on hypotheses I had -- kind of like a smart search engine, but context length was limited so these stalled early. I then used Claude to write a harness in Swift (CLI/menu bar app, see above) that uses one model session to queue a load of tasks for short follow-ups, followed by summarisation, which generated pretty useful Markdown reports on my queries, with links through to Aleph for the originals. These mostly related to the bank's involvement with the oil and gas industry (the focus of my research).

On the value prop of local models, it's very important with projects like these to have the data touch the absolute minimum number of machines, both for security against leaks and subpoenas as you say, but also to demonstrate responsible handling practices in case of legal pushback from the subject of the investigation.

https://github.com/OleksandrChekhovskyi/hax

reply