Does it? Text generation models have been decoder-only for a while, with great benefits to their training. It's surprising to me that more attempts weren't made for other modalities.

$100k seems like a lot. I guess it isn't in the grand scheme of things but still