upvote
It comes up anywhere that youre working with data that has some sort of correlation structure.

In image processing, the SVD makes it possible to talk about all the rich spatial correlations in the image, and pick out the strongest ones and discard noise.

This is also why it's so ubiquitous in compression algorithms, and of central importance in stuff like quantum information.

reply
what work are you doing in computer vision that isn't entirely ML these days?
reply
I'll give you one example, an often first step to solving the Perspective N Point (PNP) problem involves using the Direct Linear Transform (DLT) method which boils down to solving AX = 0 where A in a 12x2N matrix (N can be 6 to 500). The best way to solve this is with SVD. The first published PNP solver (for N = 3) dates to 1841 (did not use SVD) and we still are solving that problem now and I imagine we will still be solving it in 100 years (?).
reply
> Claude and Codex are now generating all my code for me now, and I see them spitting out SVD code frequently -- often for very special cases.

I find this so annoying. I had to PR some Claude-generated gaussian elimination routine last month and making sure it got the pivoting logic correct was a waste of my time.

reply
How big of an advantage was it, to have the code developed specifically for your project? These AI tools are pretty impressive, but why not have it generate a call to BLAS or PARDISO or something?
reply
You are doing it wrong. Have Claude generate the test code and log test data that it can feed back into itself. Claude can generate tests and verify the code better than humans now. I don't trust humans to get things right anymore -- I have a PhD and Claude knows all the math and libraries better than me.
reply
> You are doing it wrong.

I didn’t write any of it. I occasionally get assigned PRs written (or not, in this case) by other devs.

> Claude can generate tests and verify the code better than humans now.

It certainly didn’t do that in this case.

> I don't trust humans to get things right anymore -- I have a PhD and Claude knows all the math and libraries better than me.

If it knows all the libraries so well, why did it add a bespoke implementation?

reply
If you're getting code without tests to review in a PR, that should be an instant reject without even looking at the code.
reply