I use these latest available public models daily in max effort modes, and they barely seem to work and need extreme guidance and as much context and constraints as possible.
I find that unless the outcome I'm looking for from the model is almost binary and easily verifiable, it is basically faster to do the work myself.
Assumptions made by the models multiply and by the non-deterministic nature (dbf, similar to work by humans) I'll have something end up light years away from where it should be. During a normal workflow, I have to contend with every line I write forcing a very tight feedback loop... I suppose I could also sit there and spend 9 hours writing out a "perfect spec" but we've already tried that with waterfall development!
So, not sure if its the models, rather the class of problems I'm applying them to... but it is a bit ironic they are allegedly able to solve these conjectures but not stop to ask about assumptions.
2. We dont have the actual frontier models