upvote
> NovitaAI is a low cost provider who's strategy seems to be to host as many models as possible for the lowest cost possible so that OpenRouter's routing algorithm will default to them as often as possible. The problem is that they clearly don't spend much time on actually testing and configuring all of the models they provide. There's a reason they are very often the first provider to host a new model. I also suspect that they run models at lower quants than they claim but that is not something I can prove. https://www.reddit.com/r/LocalLLaMA/comments/1mk4kt0/be_care...
reply