In batches
replysqlite is really fast. I'm surprised it's only a million.
replydeleted
replyIt's running on an M1 mac with synchronous full. Wouldn't surprise me if it's possible to get higher numbers.
reply':memory:'
replyExcept this source code is not using :memory: The linked source code has
reply (defonce db
(d/init-db! "db/db.db"
{:pool-size 4 :pragma {:synchronous "FULL"}}))
Yes it's writing to disk (on a M1 mac which has terribly slow fsync). But, because of the transaction the fsync dance is done once per batch. Each row is the id + a 50 byte data blob.
replyThere's only one index so there's no real write amplification. The numbers will go down as you add more data and indexes.