Jev has 64k total token request budget and I do wonder how it will handle highly specialised inputs.
replyThis Jev waitlist that Typesafe AI are utilising is surely going to raise questions pretty soon - it's hard to sell this to bosses when it looks like a pop-up restaurant
It's already on Openrouter
replyIt's difficult to get 3rd party gateway approval.
replyAnd on Vercel AI gateway
replyI just got my invite so the waitlist doesn't seem to be particularly long
replyI am more curious about a 60k prompt... I haven't seen much discussion about large prompts, is it still < 500ms?
replyYeah, it's weird, considering ModernBERT, which the Laya models are based on, supports 8192 context window.
reply