I think you’re right. It’s not optimized for some kinds of work. My little project has a Textual TUI interface that needs to display a few hundred thousand rows in a table. It takes 14 seconds to load in the default datatable component. I instructed Opus 5 to replace the datatable component with a fasttable alternative, a new dependency. I let it go overnight.
replyWhen I got back up, it had spun for hours and proudly announced that, instead of doing that, it had optimized the datatable build and avoided the dependency, because the new datatable loaded in 11 seconds. Once I got it to actually make the fasttable version, it loaded in less than a second…
I love how it sometimes has false a-ha moments and being "honest" about it, it feels so cringe. Then I recall it has no intelligence. It's a stochastic parrot. It's funny how people, like any other animal, that beetle of David Attenborough trying to reproduce with a brown bottle comes to mind, think that something is X just because it trips the right neurons.
replyI got the same impression. It feels like a massive misstep too; it makes sense to have models tuned for this but they should definitely be separate from those aimed at software engineers.
reply