I think the trouble is that Typesafe APIs don't fit into the normal OpenAI-style API that every other regular LLM provider users. You're not just providing unstructured text and getting unstructured text back. It would take a different request and response format than every other model on Open Router. Though you could shoe-horn it in some way, it'd be hacky.
replyBut agreed it'd be very useful to see it deployed on other hubs, and it seems worth it to provide the bespoke API format. Perhaps Typesafe's API will end up becoming the standard for a new type of structured model, the way OpenAI's API did.
It can be shoehorned to work with OpenAI's newer Responses format.
replydeleted
replyIsn't openrouter the exact opposite of caring about security and privacy?
replyI guess you can choose your provider still? But isn't the point that the lowest bidder is doing inference?
You can set privacy requirements and define an allow list. To me the main value prop is that I get one bill for all models and can quickly try new models without signing up anywhere or changing my code.
Oh! Also you can pass an array of models and if the first provider is down it automatically falls through to the next provider. More useful than it should be...
replyThat's still ultimately privacy by contract (where you have to trust the inference providers to uphold their end of the deal), rather than privacy by design.
replyI always setup guard rails so that only zdr providers are used.
replyThey don't like adding stealth startups :(
replyThe thing is, in this climate it's hard to believe such tech will remain secret for long.
replySo, assuming this is not vaporware, this would raise the tide for everyone because it shows what's possible.