You mean you were getting more than $130 per $20 before?
reply85% discount is actually a bit lower than I remember. I think it used to be closer to 90-95%. They're getting stingy ;)
I think it was around $400-$500 last year ($20 a day was fairly common) before they added the 7 day limits (and have since slashed the 4 hour limits).
replyNo parallel running; I would very consistently get tokens for over 3 hours then take a walk around the block and come back and be ready to go again.
I think it is worth noting that “what they charge for api access” != “marginal cost of inference”. So I don’t think getting i.e. $40 of api usage for $20 would be insane. $131 for $20 does probably mean somebody is losing money though.
reply