How is that a problem that's unique to openrouter? Who's to say when I query the Anthropic API directly, wanting to use Opus, but they determine it doesn' need Opus, route it to Sonnet instead and pocket the difference? The only difference with openrouter is that it's another layer where this type of fraud could occur.
replyOpenRouter's list of providers is very large and includes many little known and sketchy companies.
replyYes, it is awfully inconsistent today. They run some tests (accuracy table buried on model page) but they are sparse and only capture a single moment in time. I would love to see OpenRouter take this more seriously.
reply