upvote
The tooling around LLMs is still nascent and, in my opinion, quite poor. You may be able to shotgun easily-falsifiable mathematical proofs with raw compute, but get into the messy world of real data, uncertainty quantification, and a host of other things that go into building real world models, and I think that an LLM plus tooling dedicated to the task plus a human in the loop will open up capabilities not available to an LLM in a chat or development centric software environment.
reply
I don't believe this is true with current frontier coding agents. Or at least, it's becoming increasingly less true, such that I think it will effectively be nullified in ~6 months.
reply
I'm gonna cite myself here:

«We came full circle on the problem that also exists with Google Search, and why so many people don't get good results out of it.» [0] It is not that access to all information was hidden to anyone before, it was harder to find it, sure. Now it can be found easily and aggregated, however, it is not as simple as saying "Do X" and believe that X is correct. Recall the infamous Swing & Product Management meme? [1] The problem is the absence of information you provide, the LLM will have to make a guess of what you mean, much like the human. Likelihoods of this guess being correct depends on the domain and background. So yes, it'll likely build whatever you ask it (I do think we're there already), but if that matches what you intended to actually get is vastly different. You'll be settling with "Good enough" though and declare it working.

Others already pointed out that 6 months seem to be the constant of distance, irrespective of the date.

[0] - https://news.ycombinator.com/item?id=50063427#50063744

[1] - https://www.productftw.com/productftw-2-the-tire-swing-carto...

reply
I'm done waiting 6 months. Just let me know the night before when I don't have to come in to work tomorrow.
reply
Its a bummer because that is also exactly when self-driving cars are going to work. You'll be able to sleep through the commute but won't have to go.
reply
Self driving cars have been working for years... And waymo launched this year in Denver.

https://waymo.com/blog/2025/10/creating-an-all-weather-drive...

reply
I can already sleep on the train
reply
Serious people are predicting automated RSI in 6 months this time, FWIW.
reply
Usually you get that info at 4:30 on a Friday.
reply
LLMs are the perfect tool for "finding the right words". They are literally translation machines.
reply
Just ask the LLM for these words, obviously !
reply
It's funny you mention this, because I've been thinking lately that all the focus on code quality benchmarks for LLMs seems to miss something. In my experience, LLMs aren't actually all that good at prompting other LLMs, and that's exactly the skill that matters for proper subagent usage.

The corpus of code available to train LLMs on is rich in both volume and quality. The same can't be said for LLM prompts. Prompts only came into existence alongside LLMs themselves, so most of the prompts out there are actually LLM generated, and training on them causes every model to overfit to the same patterns.

LLMs can give clear and concise directives to other LLMs, but only for basic tasks. Beyond that, they frequently overstuff their prompts with too much prose and too much direction, and worse, they often fill them with subtle contradictions.

Of course, there's a spectrum here. Some models turn out to be better at this than others, and I suspect this is what differentiates Fable-type models from the rest, and why vendors have started keeping their models' reasoning confidential.

reply
Quick tip here: Where possible try to trick the model into thinking whatever task it is writing will / could be read and performed by one of your coworkers rather than another agent. It will quickly fall into line and stop writing prompts meant for dumb historic low intelligence LLMs.
reply
The "agent factories" available to employees at the labs and hyperscalers clearly prove that agent delegation does work. Today, maybe that capacity lies with Fable class models, as you pointed out, but there is no doubt with opus 5.5 that this capability will be available to cheaper models as they get better.
reply
That's what I've been doing in areas I lack knowledge tbh. Instead of a half assed attempt at describing what I need, I ask an llm to take my base idea and write it up using industry standard jargon as if I were commissioning a team to do the work. Has been working pretty well so far!
reply
Okay so I just asked it "What question should I be asking you but I don't because I'm not smart enough to think of it?" Response was kind of interesting I have to say.
reply
It gave me a very helpful answer, my project will be improving just because I asked.
reply
I did this just now, ironically before I even saw this discussion. I ended up questioning the AI about humanism.
reply
So what? The average joe shouldn't be trying to diagnose people with cancer.
reply
Healthcare is more than having medical knowledge.

Ten years ago, in France, two doctors (one in a professional setting and the other during a private consultation) asked me about a wound I had on my shoulder; obviously I couldn't identify what it was, and they offered no suggestions, so I supposed it was not something important.

It took a visit to a cardiologist—for an entirely different reason—for him to suggest that I rapidly consult a dermatologist.

It was a carcinoma, and surgery removed it. If ChatGPT had existed back then, this carcinoma would have been removed several years earlier.

reply
This sounds like a competency problem on the part of the GPs. They’re supposed to make these calls.
reply
They are supposed to, but often times they don't and there are no consequences for it.

Current diagnostic setup relies on humans having vast expert knowledge, when in fact it's almost always impossible.

A well trained neural net/LLM will always be better at visual detection because of sheer number of examples it sees during training, compared to a dermatologist which, if lucky will observe no more than 20 patients/day x 270 days a year x 40 years of practice i.e. around 220k samples throughout his lifetime.

MD with other specialties will see significantly less and we are talking about top of the top specialists.

An average MD knows more amount medical diagnostics than than the average Joe, but in principle much less than a well trained AI.

Do we have those kinds of models already? Maybe not yet but, ceteris paribus, we will definitely have them in the future.

IMHO we do have those models already but they aren't available to the public, though their availability would certainly lower cost for healthcare providers.

reply
Yet here we are
reply
Maybe if chatgpt existed back then you'd have had your carcinoma extracted along with 10 other benign anomalies.

Automation doesn't make up for carelessness.

reply
Skin cancer is easily treated with excisions if it’s caught early. Better to have ten small false positives than a single miss.
reply
Even if addressing each false positive would carrying low but real risk of death or complications?
reply
Is your "low but real" risk comparable to the risk of driving a motorcycle, of riding in a car, or of using the bathroom?

Reasonable treatments for small, non-aggressive skin cancers (or suspected cancers) are extremely low risk. And reasonable practitioners will often suggest that you merely keep an eye on an abnormal spot - because it doesn't look worth the bother of any sort of treatment for now.

reply
Not sure why this is getting downvoted. In its specific case that's quite obviously not a good example because removing benign spots isn't harmful, but overlooking malignant ones is, so there is no downside.

But if we think a little further and generalize then there is great risk (and by extension, harm) to delegate diagnosis and treatment (of health issues in general, including potentially or supposedly fatal ones) to ChatGPT and similar tech. That we'd end up with a net positive is far from obvious.

reply
I still maintain my point that it isn't harmless to blindly address benign anomalies. Every medical procedure carries risk.
reply
Your point doesn’t really make a lot of sense. Even with ChatGPT existing and making 90% bad calls, a doctor isn’t likely to just “blindly” be cutting out anomalies.
reply
As opposed to what OP said?
reply
Your original comment seemed to imply that if ChatGPT had existed, maybe they’d have had ten benign things removed. But that’s not how it works.

Conversely, ChatGPT can help avoid false negatives.

reply
Obviously, error rate of ChatGPT should be measured by comparing to human diagnoses and when it plateaus, we should investigate a possibility that the number is driven mostly by human errors.
reply