I wrote ann ext for sqlite, using tq, I do save a lot on space but 32f is still faster despite everything I have tried

code here https://github.com/netdur/munind/tree/main/src/tq

I guess need to dig into this and see if it’s faster and has more use cases! Thanks for publishing your work

- fork of a fork of a quantization technique

- Only contribution is...compiling JS to WASM by default?

- suspicious burst of ~nothing comments from new accounts

- 6 comments 7 hours in, 4 flagged/dead, other 2 also spammy, confused and making category errors at best, at worst, more spam.

- Demo shows it's worse: 800 ms instead of 2.6 ms for text embedding search

- "but it saves space" - yes! 1.2 MB in RAM instead of 7.2 MB to turn search into 1s on a MacBook Pro M4 Max, instead of sub-frame duration.

- It's not even wrong to do this with the output embeddings, there's way more obvious ways to save space that don’t affect retrieval time this much