undefined

points

[-]

> but it seems less likely to me than before that the types of math/science discoveries will explicitly unlock better software performance.

You seem to overlook a simpler barrier. To make these advances, they have to be possible. A 15% improvement in GPU kernels doesn't evidence that significantly more improvement has been left on the table.

by GPerson2 hours ago|

prev|

[-]

I don’t really like AI but let’s stop kidding ourselves, no human mathematician could make progress on a dozen major open problems in a week or two. If you’re measuring it against humans then it is by far the best mathematician to ever live.

by paulmist1 hours ago|

prev|

[-]

Correct me if I'm wrong, but all of the aforementioned advances were made in the last year? Until very recently few people had access to these tools. Most people still don't know how to use ChatGPT, and very few use tools like CC regularily. If in a few years these frontier tools become commonplace and people upskill we would should see a network effect?

by woeirua2 days ago|

prev|

[-]

This makes no sense. To believe this you have to think that the models are somehow being overfit explicitly on academic mathematics and it doesn’t carry over at all to more practical software engineering. I wouldn’t make that bet.

by jvanderbot3 hours ago|

parent|

[-]

Or, that the mathematical formalisms that model the limits of software performance are firm enough that barring P==NP, nothing much will change despite proofs of beautiful math.

by threatofrain2 days ago|

parent|

prev|

[-]

This also makes the assumption that frontier math has all the long hanging fruits already taken... also very dubious.

by Ar-Curunir2 days ago|

parent|

[-]

Some of the problems solved here, at least in CS, have been open for decades, and have been worked on by very smart leading researchers in the field, including Turing Award winners.

Like, these would be best-paper awards at many top CS conferences.

by asdfologist2 days ago|

parent|

prev|

[-]

Unlike math, software is constrained by the physical world.

by cvak4 hours ago|

parent|

[-]

In what sense?

by zahlman31 minutes ago|

parent|

[-]

For example, pi can be computed to arbitrarily many digits, but could only even in principle be accurately represented with physical objects to a precision that many humans could memorize easily. This is thanks to physical constraints such as "diameter of the observable universe" and "Planck length", at a minimum.

by skybrian3 hours ago|

prev|

[-]

This will depend on the problem; I expect big algorithmic performance improvements in AI since the algorithms are still new, inefficent, and constantly being improved. But maybe not for sorting, fast fourier transforms, or other well-studied basic algorithms?

by pavpanchekha3 hours ago|

parent|

[-]

A lot of algorithmic improvement in AI is ultimately bottlenecked by compute. It is very easy to come up with ideas that could improve models! But to prove that they do, especially at scale, is expensive and takes a long time.

by slashdave2 days ago|

prev|

[-]

> we are also seeing incredible advances in software performance

Incredible?

> open ai announced like 15% improvement by fixing gpu kernel issue

That is... ordinary software optimization.

by blovescoffee2 days ago|

parent|

[-]

a 15% improvement at a trillion dollar scale company is massive

by enraged_camel3 hours ago|

parent|

prev|

[-]

There's nothing ordinary about downloading a new GPU driver and having performance go up by 15%.

by obidan3 hours ago|

parent|

[-]

This is untrue. It is very ordinary. How much do you know about GPU drivers that you state this so assuredly? Drivers are software. Software can be improved. Do you believe there are no prior examples of GPU drivers being improved such that particular compute patterns go up in performance by more than 15%? This driver improved Total War performance by 71% https://www.nvidia.com/download/driverResults.aspx/74714/en-... Also note you can go ahead and improve any open source driver right now, most likely. Compile it for your specific card and remove all other architecture specific if-cases and you can get an improvement.

Edit: also here’s a opencl 30% compute perf increase documented here : https://m.hexus.net/tech/news/graphics/74425-haswell-systems... that i just googled for

by dominotw2 days ago|

prev|

[-]

> novel advances in math

> we are seeing frontier level math breakthroughs (ie performance that would put it in the top 100 or 1000 mathematicians in the world if it were a human, meaning top .00001% or 800/8B)

i think you have misunderstanding of what mathematicians do

by DaiPlusPlus2 days ago|

parent|

[-]

> i think you have misunderstanding of what mathematicians do

They get to make cool 3D plot visualizations of functions so obscure to me that they’re named after someone who is still alive - and/or get to work on cryptography for the NSA - I think?