They have various benchmarks, e.g. how much time it takes them to do wikipedia page -> page games. Jev seems to take the same or fewer hops but in ~10x less time and for ~10x less money.
replyIt's totally reasonable to compare against LLMs doing chain of thought if it gets comparable performance.
> If Jev is skipping generation entirely for a narrow structured task, of course it's faster
replyI think this is reasonable if people are actually using LLMs to solve this type of narrow structured task, which they are. The evidence is that every LLM provider has some method of forcing the output to conform to a json schema in their documentation.
love that you love the manifesto! letting the first batches off the waitlist now, but we do have some early users describing their experience (https://x.com/danshipper/status/2099947471518474522)
replyCongrats ! Really excited for the team.
replyIt's not an LLM though it's a frontier model on structured data
replyDid you see the video where it plays Doom, it made it click for me
replyi've seen it play minecraft as well, what im not sure here is what is the thing that produces the JSON and keeps track of the objects
replycan jev play battlefield six for example
BTW it was not multi model playing doom, it was passing structured input and getting structured output. Its not what I thought: frames of video passed and real time game play.
replyso what? put an LLM on Cerebras and get its responses faster, and put Jev on Cerebras and gets its responses even faster
reply> I really have to say that I like their manifesto
replyTheir manifesto: "you only build on top of it if it's trustworthy." - the irony of this while putting out the most misleading, dishonest marketing campaign I've seen in months for their first public appearance doesn't exactly scream "trustworthy" to me.
What do you find dishonest?
reply