upvote
I personally think part of what makes chip design harder is a good amount of the training data is proprietary, and of training data you can find in public, over half of it is poorly designed or only acceptable for FPGA deployment not ASIC.

So you have to figure out what training data is acceptable and also make deals to get access to proprietary data.

reply
That is probably what partnering with synopsis is effectively solving.
reply
I've posted a very similar research back in April (https://github.com/FeSens/auto-arch-tournament), did not make as much noise as openAI of course
reply
It's not that it is harder so much as it is that the training set is incredibly small.

Mathematics is generally done in the open. SOTA chip design is done by a handful of people all behind closed private doors.

reply
deleted
reply
With proprietary synopsis software.
reply
Navier-Stokes is ultimately a textual problem rather than reasoning about shapes in the physical world like laying out gates. There are, e.g., mazes small enough that LLMs can solve them but generally they're much worse at stuff like that than humans.
reply
Navier Stokes is about modeling fluid flow through space. It’s not any more textual than chip design. Just like you can reduce fluid flow to textual partial differential equations, you can reduce chip design to purely textual constraint systems.
reply
A lot trickier to do self supervised RL on chip design than Navier Stokes, or maybe they aren't trying hard enough. I mean even if you check their outputs with Altium and KiCad DRCs it won't capture everything that goes into a good board. Still need human training data which is slow and expensive.

I suspect before the end of next year they will have enough data to bootstrap a production level self supervised learning environment.

I wonder if they do training verification with real pick and place circuits too.

reply
This is simply a case of they haven't gotten to it yet. They definitely will be able to do RTL optimization.
reply
do you understand how large the training sets are for LLMs? there is not enough RTL in the world (let alone public RTL) to usefully contribute to the training of a O(T) model. and contrary to popular belief, HDLs are nothing like programming languages so nothing transfers.
reply
This isn't done using a transformer, they probably doing something else .
reply
If they can figure out a good classifier for good vs bad circuits then that should be enough to bootstrap a robust model. It's just extremely extremely expensive getting good EEs to do this sort of data annotation for them.
reply
you're just saying the same thing in different words (classifiers are trained on data)
reply
Not necessarily, for electronics it could be done using a shit ton of heuristics. It won't be a good classifier, but for the purposes of bootstrapping ML you can do it step by step until you get a Good Enough classifier.
reply
did you miss the part where they partnered with synopsis? you think they might have some reference RTL?
reply
reminder: LLMs aren't actually intelligent, they just have trillions of parameters fit on a training set.
reply
Give me definition of intelligence that excludes LLMs but includes below-average intelligence person.
reply
Give me any rigorous definition of human level intelligence.

So far it doesn't exist.

reply
did you read this thread? the answer is "ability to write RTL without reading/training on 20T RTL tokens".
reply