upvote
You can... but the trick is to do so without killing performance. Turns out a lot of random things help make coding performance good.
reply
Does this desideratum make any sense? The whole point is that you write to it in English or Urdu, and it writes the specified code. If you cut off everything but the code writing, you cut off everything.
reply
If you're literally using it as code autocomplete that's not functionally true. But it's still neither well specified nor a good idea.
reply
Domain modelling as well: we have clear programming concepts, but the kind of autocomplete that can autocomplete a customer sales process needs to be able to refer/leverage ontological connections on words like ‘bass’, ‘season’, ‘rebate’, and ‘jamboree’.

Intuitively it feels like focused models should be better models, but human programmers are ‘better’ knowing programming alongside general stuff. We’re not reduced by reading economics or Tolkien, removing such knowledge would be premature optimization.

reply
Thanks..non AI expert here just wanted to understand..cos one of the most talked about topics is running models locally on cheaper hardware. Helps many esp in poorer places.

Would be nice if a genuinely useful coding model can fit into an old laptop, give decent performance and know nothing but (say) Go or c language.

But I see yours + others points.

reply
no, apparently, otherwise we'd already have specialized models. every bit of meaningful human-generated data appears to improve the overall capability of the model.
reply
we do though and it can be stripped
reply
Kind of yes, but this be get you are pretty stupid autocomplete yuo can probably avhieve without an LLM at all.

>we have professors with specialisation

Yes, but any professor with a specialisation is an erudite with vast knowledge across the board.

I'd argue we can have a meaningful BIG model with a specialisation but not vice versa.

PS: all of this is about a model that is expected to be able to execute development tasks on a human level. Obviously we can have small models that are very capable in things like TTS or STT.

reply
I guess it can but it will be useless. After all the model superpower is awareness and ability to guess and infer some stuff. Right now a model saves you time not only by coding faster, but that it can figure out some stuff about the shape of the data and its purpose.

If you throw general purpose model at a codebase - it will look at the table and data logical connections beyond what is explicitly declared. It will figure out on its own that Salaries should be displayed on SalariesTable.php and it will "know" that your prices should include vat and so on.

A human knows that VAT and price go together and are related, full size LLM does too, stripped one - doesn't.

reply
Yes, look up REAP.
reply
Linking here since the pruning method you're talking about wasn't the top search result when I looked: https://github.com/CerebrasResearch/reap
reply
[dead]
reply