upvote
Why would that be ironic? AI is helping us find so many subtle bugs and isolate the root cause, it’s nearly perfect for this type of use case.
reply
> complete reliability.

I think that’s a myth! What tends to happen in mature software is there are unfixable tradeoffs that can be made that favor one use case or another. And of course people will keep adding features too

reply
That’s why they said “closer”
reply
Just wait until someone relies on that bug too.
reply
Rust considers fix to unsoundness bug, a change that can be done at any SemVer revision (i.e. a patch version bump can break it).

If your spacebar heater relies on such behaviour Rust can and will break it. If you're in the crater group you'll be notified and urged to upgrade it.

reply
What aspects of it are remotely ironic?
reply
Obviously, many people have viewed AI’s contribution to programming as just producing unreliable garbage.

Yes, that’s an incomplete and tenuous belief, but that’s where the irony is. If you’re omniscient you don’t get to experience irony.

reply
Hey, if Alanis Morissette can make the same mistake…
reply
“Slop generator makes all future programs more reliable”
reply
Yeah this is actually quite interesting. I can see how people who have this "slop generator" perspective on AI would see this as an irony. But to me, it isn't an irony, it's a demonstration of why this perspective on AI is wrong.
reply
I assume that's why the original comment said "perhaps ironically".

I'm firmly in the "AI is incredibly powerful and useful" camp myself, but there's no question that currently, without good human oversight and feedback, AI output can have many issues which can be described as slop.

But yes, improved type systems are one of the ways this can be managed, and essentially help bootstrap more reliable systems.

There's a minor irony in imperfect system being used to help build more perfect systems, but you could say the same thing about human developers.

reply
Until they find bugs in the formal proof program ;)

https://www.lesswrong.com/posts/zHhGa3iQBQcdSifFL/a-critical...

reply
It is well known that proof assistants can be wrong. Fortunately, the theories underlying formal methods are usually simple enough that it is feasible to write verifiers for these proofs.
reply
[dead]
reply
The UB goes all the way down!
reply
deleted
reply
I asked myself, How many comments to do I have to collapse before someone says something about AI. 3.

I used to compare this hype to crypto hype, but its so much worse. Can we just try not to shove llms into every single conversation.

Is there a hackernews type space where the word is banned? Even lobste.rs has this problem. I need some sort or way to just hide all content on certain sites where LLMs/AI are mentioned.

reply
I browse Hacker News stories via this: https://unslop.news/
reply
Yeah the HN home page today seems especially bad
reply
Wow interesting
reply
lobste.rs has a `vibecoding` tag that you can hide.
reply
Unfortunately, a large proportion of stories submitted to Lobste.rs are slopped out... even if they don't mention AI, it's hard to escape there. Hacker News at least has functioning story-level moderation.
reply
I didn't realize that, thanks
reply
I'm not a huge AI hype man, but I think you'll just have to accept it. It's a new useful tool, of course people are excited to apply it to everything.

Like it or not, programming will become largely LLMs. And the comment you're replying to is actually making a pretty good case for where the use of LLMs is good: generating code to be formally verified.

reply
Something something halting problem. I never said don't use the tool!! I use the tool too! I just dont want to talk/read about it all the time.

Programming will never be dead.

1. Because the situation you describe is fantasy.

2. Even if it is a reality and all software can be verified (it cant), I will still be programming and so will millions of others because its fun, programming and sex are really damn close to things I cant live without. Not everyone got into engineering for the money. I legitimately love this activity, it is my actual passion. I would rather be poor than give it up.

Its like im being told everyday all day, non stop that the thing I love is not worth loving.

reply
Of course people will still program for the foreseeable future. But it is still a legit question how long it will be before people come to accept a vibe coded program and are ready to deal with its flaws (of course with more vibe coding) compared to hiring a consultancy.

I'm not talking about mission critical software, but bespoke business applications that are produced by software engineering sweatshops and where the actual users are inured to incomplete features with sharp edges, arcane bugs, and incomprehensibly long intervals between bug report and fix.

Even in mission critical software we will likely see a lot of LLM tool usage. Even if the copyright plug is pulled and all vibecoded applications are regarded as copyright violations, its uses to analyze existing code and give advice will remain. In this world, writing applications entirely by hand will become an artisanal discipline.

reply
I see. I'm not trying to put down your love of programming. The only programming that I really can say excites me (C64 or the like) died a long time ago, before I even started programming for money.

Nothing is stopping you from enjoying the sort of programming that you like. But I think it's healthy to accept that that style will soon not be mainstream. It will be like knitting your own clothes, and that's okay.

Regarding formal verification, it's not needed, as LLMs already make on average about as many errors as the average human programmer.

For me, 90% of programming is just a tool to get the job done. It's like a machine in a factory that spits out 50 spoons a minute, and it doesn't need to be any more beautiful than that. If you enjoy woodcarving and want to spend an hour making your own spoon, do that and don't let the existence of the machine make you feel that hobby is any less worth loving.

reply
This seems more like you projecting what you want in terms of what you enjoy and hoping the world optimises around that preference.

The truth is LLMs is what you need to be optimising around as they will become the standard.

reply
deleted
reply
Why don't you start TruthLLM like Trump started TruthSocial?
reply
You need to bow in the direction of Silicon Valley every three hours or the inquisition comes.
reply
I guess that’s something you need to work through that you’re just so sick of reading about the single biggest evolution in technology since the internet :(

Maybe tech isn’t for you if you don’t like trying to stay on top of it.

reply
Huh...

Anyways, I probably know more about llms than you, I probably use them more than you. I just dont want to turn every conversation into a discussion about them.

I would argue the smartphone is 1000x more impactful than LLMs, along with many other inventions since the internet. I'm not really sure what contribution llms have had that are actually THAT impactful for peoples lives. Its possibly (but unlikely) a net negative, time will tell. Most people using them are not getting smarter, thats concerning. Most are just making more money for their bosses who are itching to replace them with an llm.

reply
I think the problem you're seeing is not with LLMs per se, but with capitalism. Imagine we have a quite useful machine that's reducing the amount of work needed to accomplish stuff, and all normal people are afraid of that machine simply because they worry they'll have less work. How backwards is that!

If we didn't let people live off the work of others, as the capitalists do, then we could all rejoice in that we've found yet another way of reducing the labor required to produce stuff.

Yet, in the real world, it seems as despite the progress of technology, the labor of the everyman is constant, and only the richest get more and more shiny jets and yachts.

reply
Thank you for citing the Anthropic propaganda manual!
reply
and what stops AI from "accidentally" writing code with such bugs?
reply
Code review and testing? As always?
reply
[flagged]
reply
Even if you could be trusted to do that, we still need languages like Rust and tools like ASAN and Valgrind. Trust but verify. Trust alone is not enough.
reply
The compiler. That’s the whole point here. Type systems can prove the absence of entire classes of bugs, at compile time. If AI identifies bugs in type systems that can be corrected, then all future programs benefit, including those written by AI.
reply
Or we realize that it is not possible, and Rust accepts to be "just" a definitely safer C.
reply
There is a formally proven compiler for a large subset of C, so I don't see why formalizing (a large subset of) rust and making a formally proven compiler shouldn't be possible
reply
Also unlike C, it should be possible to formalize all of Rust, not just a subset. For two reasons: Rust evolution (not initially but today) is strongly tied with formalizing it and the language team consults with formalization experts (which are part of the Rust project themselves) all the time (and formalization or semi-formalization projects are ongoing), and also the mathematical understanding of system languages itself has advanced.
reply
This reminds me of Hilbert’s Program .
reply
There is a severe misunderstanding here. Beside being only a subset, CompCert definitely has UB. It just formalizes codegen for codebases not containing UB, which obviously won't be enough for Rust.
reply
Because people want a performant optimizing compiler.
reply
CompCert produces surprisingly fast native code.

This 2022 article [0] says it generates binaries that run about 7% slower than what GCC produces with -O1.

[0] https://www.cs.cornell.edu/courses/cs6120/2022sp/blog/compce...

reply