upvote
Last month I rebuilt my pool's plumbing system with the help of YouTube and GPT. I was quoted $6k and it ended up costing me about $1k of materials and a few days of work. This was my first exposure to any kind of outdoor plumbing, I'd never touched PVC before.

It's unlikely I would have had the confidence to do it from YouTube alone, specific diagnostic help and a full diagram to work off of was extremely helpful. I had it prepare an SVG of the whole assembly with all the measurements and parts labeled.

reply
I'm glad it went well for you. But I run a not-for-profit pinball museum, and I have specifically had to ban volunteer repairpeople from using the chatbots because it will confidently propose idiotically wrong solutions. Which will then get proposed to me, or just directly applied, with equal confidence. At this point I'd rather hear, "My horoscope said..." than "ChatGPT said..."

I expect that it's good for common use cases that's well documented. But then, so are a lot of other approaches.

reply
[dead]
reply
> This was my first exposure to any kind of outdoor plumbing, I'd never touched PVC before.

I find it telling that the highest praise for LLMs comes from people using it for something where they admittedly have very little domain knowledge. Domain experts usually mention major caveats. I've been testing them on subjects where I already understand the problem well, and I've yet to see any outputs that would make me trust them on things I don't already know.

https://en.wikipedia.org/wiki/Gell-Mann_Amnesia

https://en.wiktionary.org/wiki/confidence_trick

reply
That's a good point - I've heard people make the same one whenever LLMs are brought up. I hope someday you're able to get more value from them.

Anyway, my pool's looking great and I gained some new skills. I probably could have gotten there with books and YouTube alone, but having another tool at my disposal made me a bit more confident.

reply
It’s likely it missed some crucial subtlety that will come to bite you in the ass down the line.

That’s the thing with AI - its responses sound plausible enough to non-experts but time and time again I see experts in any given field being able to identify AI content by pinpointing subtle but crucial errors. That’s one of its dangers - it gives you enough confidence to shoot yourself in the foot.

reply
> It’s likely it missed some crucial subtlety that will come to bite you in the ass down the line.

Maybe, but that's part of the experience of learning. I plan to maintain pools for the rest of my life, if I made an oversight which costs me down the line then the lesson will be that much more memorable.

This is an above-ground pool with a pump and a filter, the stakes are relatively low. In the absolute worst case I could rip it all out and pay a pro to do it for the price I was quoted.

reply
If that's a pool for human use, the worst case is a bacterial/fungal infection due to incorrect filtering.
reply
A pool filter is for removing physical debris, it's not really for preventing bacterial or fungal infections.

I guess what you're talking about is sanitizer, in my case we use chlorine. I test it every time we swim, but I wouldn't have needed an LLM for that. It's very straight forward to maintain pool chlorine, my Dad taught me that when I was 13.

reply
Human workers also wreck these jobs horribly that come to bite your ass in the end. I think an intelligent person equipped with AI and common sense and real stake in the thing being well done (because it's their own, so they care) is better than whatever is possible to pay for or book in a realistic timeline from another human.

Also, ask people in the trades to review each other's jobs. They will harshly criticize each other too for missing basic things and then go on to vehemently disagree. As an outsider it doesn't mean much that an expert found some fault. They always find something to nitpick.

reply
> Human workers also wreck these jobs horribly

Yes, but with a human worker there is a chain of accountability. With AI, there is none.

reply
Have you had an argument or dispute with a contractor before? It's better to just do it yourself when you can, and fix it when it breaks
reply
Fellow pool owner who has always drawn the line at “only pros do the pvc cutting”. I’d love to hear more.
reply
In the 90s and prior you could have done the same thing using the public library.
reply
[delayed]
reply
I feel like if you had wanted to you could have done it before. When I got a pool in 2020,there were still old school phpBB forums out there dedicated to DIY and maintenance. That same summer, my neighbour who in no way is techie or handy redid his plumbing too.
reply
I've love to know more about how you did this. Was it the underground plumbing or your pump system above ground. This is one of the few areas of the home I have little understanding of.
reply
This was for a largish (40,000L) above-ground pool with no hookup to my home's plumbing system. The water was all pumped in from a water truck.

The previous system was also installed by a non-professional and was mostly tubes. It leaked to all hell and looked generally redneck and awful.

First step was draining the pool and doing a nice deep clean. Then I ripped out all the original plumbing until it was just the pool outlets, pump, and filter.

I arranged it all and measured the dimensions. I fed the figures along with a tonne of photos and explanation to GPT. I spent a while talking pros/cons and landed on a design which lined up with what I'd seen on YouTube. I had it prepare me a full shopping list of PVC, tools, cements, etc. all linked to a local pool dealer. I picked it up the next day.

The PVC was all cut with a chop-saw then primed and cemented together. I found this part easier than I would have expected. I put a layer of TigerFlex hose between the PVC manifold and the pump/pool/filter inlets so it had some tolerance.

We've been swimming in it all summer, no issues whatsoever so far.

reply
I hope what you’ll discover to be wrong needs only $5000 of repairs.
reply
I hope your DIY projects go well and you don't need any repairs at all.
reply
Answers to a lot of questions, with breadth, depth and nuance. And assistance in carrying out work on a lot of fields, not just programming.
reply
This only matters if the answer is correct.
reply
Do not mistake confidence and verbosity with breadth, depth and nuance
reply
breadth, depth and nuance

If ever there were three adjectives which do NOT apply to generative AI...

reply
Oh the text definitely has breadth, depth, and nuance ... just not sure how correct it is.
reply
I installed Ubuntu on an old laptop that I let Claude Code sysadmin. It makes it really easy to self-host open source stuff, and if there are issues it can fix them too.

Funnily enough, I've had a somewhat mixed-to-hostile response when trying to upstream the vibecoded fixes, so I suspect using an LLM to fix broken open-source software (that human maintainers don't have the time to fix themselves, nor the humility to accept an LLM-authored fix) will become more of a thing going forward too.

Oh, it's also been identifying a bunch of patterns in sales data for my business that has been increasing monthly profit consistently since last November (around $4,000 USD, every month, cumulatively so far with no sign of slowing down - could easily be $10k/mo in increased gains by end of financial year).

reply
It can be very exhausting to receive a lot of PRs. especially when they're LLMs. We have to read what people don't often even read themselves. They're often very wordy. Then it hurts all the more when it's wrong.
reply
I've had negative responses to small, isolated submissions that I've heavily QA'd and semi-positive responses to longer ones. I think it has less to do with the "realpolitik" of the code itself and more to do with the maintainer's viewpoints about whether AI as a whole is a positive or negative thing.

I tend to respond quite well to AI-authored or assisted PRs to my project, but to be fair we maybe only get 3-5 PRs in a good month.

reply
It's really good at writing code.
reply
It’s really good at writing bad code - something that superficially works but is badly architected, abstracted, or wrong in a subtle way.

Only a novice would look at ai code and say “wow this is good”.

reply
Yeah if you just let it run wild, it will produce subpar results. But that is not much different from humans tbh.

When you discuss design and architecture first, and write that out in a design doc or something along those lines, it works quite well for the most part.

And 9 out of 10 times when it produces some poor results, just asking "is this really a good approach?" or just stating "This code makes me very sad" it will most of the time do a really good job of analysing why that code is bad and how to improve it.

reply
You don't have to let it design the architecture. Personally, when I'm using AI: I design the software, and the AI implements it. The classes and functions are typed the way I want them to be typed. AI does a great job.
reply
For well-scoped tasks I wouldn't say the code is bad, not brilliant for sure, but definitively good enough.

For a lot of problems "quick and good enough" is all that is required. I've used it a lot for managing my Home Assistant setup. Has saved me countless of hours.

In principle I could've done it myself, but I never would have, the time investment required to learn it wouldn't have been worth the value I get from it.

reply
Skill issue. No pun intended.
reply
Something is better than nothing.

A pain plate of rice is bad food. But would you prefer starving too death? Or for others to starve?

reply
I’ve been programming professionally for 29 years and with the right constraints (strongly typed language, strict linting, adversarial review styleguide, test coverage, clearly defined spec or requirements) it does indeed regularly write good code. All of the other stuff required is either set-once-and-forget or is also AI, and it does require supervision, but it writes good code the vast majority of the time.

Note that I am talking about frontier models and only the last 6-12 months. Opus was really the breakthrough point for me.

reply
It’s good at all kinds of stuff that is search adjacent, “find amesent parks with water feature within 100 miles of me that have rv parking nearby”, etc
reply
This will of course never be underminded by aggressive marketing
reply
Rote classification doesn't require AI. You described a SELECT statement that was developed half a century ago
reply
Ehhhhh it’s faster at typing code. Writing in a full agentic mode, we’ve only experienced slop.
reply
If typing is the bottleneck you're working in too low-level of a language. Use more abstraction.
reply