upvote
Yeah. I would expect that Samsung or Apple’s bundled AI things (whatever those end up being) will be good enough for consumers, and open models will be the things that actually get used in the products of the future because they will allow technical people to alter models in ways that specialize them for whatever use case they’re building for. They will also be the onramp for engineers/data scientists of the future, and thus will have more available, specialized knowledge over time.

The bitter lesson would claim that we only need one model with more data thrown at it, but I’m a bit skeptical that we’ll end up with “the one true way” of building a model, and I think there will be model tradeoffs that we can pick from as the industry matures.

reply