upvote
Qwen 3.8 wasn't that nice in my experience Qwen series has lagged a lot but I think Qwen 4 would be better they cleaned up the architecture.

And we are likely to see many companies start building 27-32B MoE models custom built for use cases now that Rubin is going to make training costs much lower.

I expect training costs to get under 100k USD within a year for small models with another 100k maybe for RL.

I think just having all your own data from claude and stuff on your system that you can feed these models and have companies offer great base 27B models will be how it works.

reply