upvote
In my first test, it filled 200k of its one-million-token window in 5 minutes. Right now at least, it seems to be fast.

Update: a second thread went down to a more reasonable ~80 tps.

reply