upvote
As the saying goes, POC or GTFO

I invented faster than light travel, it was obvious, just didn't write a paper yet either :)

reply
Can you take the time to write your methods? I’d be interested in reading it
reply
341 is two orders of magnitude faster than your 1 tok/s so it doesn’t seem like their stuff is all that obvious. I also have no baseline for training to know if 341tok/s is slow but it seems speedy for a 3090.
reply
OP said 1k, not 1
reply
:) Coffee is good
reply
1k tok/s = 1000 tok/s...
reply
OOM is log10
reply