After 18+ months of this, LLMs are incredible for getting rid of the work I hated most: Updating JIRA tickets, tedious little cleanup jobs, refactoring, etc. They are great at finding infosec issues.

They are also GREAT at writing code based on standards and patterns established by an actual human engineers. They are STILL trash at anything meaningfully complex from the ground up. I will go through hours of planning where I have to kick the hell out of its plans in ways that I don't think someone without a ton of real world experience could do. Even in the fancy new Fable models that remains true. They are not creative and any engineering worth doing requires creativity.

One thing that I find frustrating/disturbing about LLM generated code is that wrong stuff doesn't usually look wrong, so you almost have to review it even closer than what you'd review from a person. Like in the past when a developer was being sloppy, usually you could kind of tell superficially, but with LLM code it's usually well documented and superficially well structured, all while doing batshit insane things. Like today I noticed some code that it had written was just silently returning on errors without logging a warning or returning an error code. It "worked" but it was a major foot-gun!

You're moving too slow.

Over the last four days I've few shotted a 1:1 clone (and improvement) of Fal, OpenRouter, and Replicate in Rust. It's going to be open source.

I've lined up $300k of monthly commitments for it that land at launch. Might apply to YC with it.

Moving "organic" is too slow for the world today.

I can generate LLM code and it will be very stable long term, but you must be QA minded and non-stop testing, ask and make sure it generate maintainable code, watch for code smell etc. Maybe it won't match a very seasoned dev, but LLM's generate sht code because the dev allows it at the review stage.