upvote
I doubt it’s at full TDP if it’s running at 0.2 tokens per second.
reply
Actually I can't go full tdp with a 650w PSU, I got to upgrade it asap
reply
You can run a RTX3090 at 250w and still get a lot of its performance with nvidia-smi.
reply