you can try it out here: https://chatjimmy.ai/
replythat's so fast it feels fake
reply13,789 tok/s
replyWell I've gotten one of those "holy fuck this is the future" deeply unsettled anxious feelings in my gut again. It's been a week or 2, it was time.
i only found one discussion of the tech here on HN
replyIt's indeed super fast, but the output is complete BS hallucination. Not sure what's the value of this.
replyIt's a proof of concept that it's possible to etch a neural net into a chip and get massive performance (and efficiency) boost
reply