upvote

points

by sdevonoes17 hours ago |
comments
upvoteby AntiUSAbah17 hours ago|
next
[-]
Quality, simplicity, speed.

I have a ML Setup with 2 4090 and 128gb of ram, its warm when i use them for finetuning or batch processes.

I do not run them for coding. Its a lot easier and nicer to play around with better models for just 20 $.

reply
upvoteby operatingthetan17 hours ago|
prev|
next
[-]
Well they are subsidizing us for starters.
reply
upvoteby victorbjorklund15 hours ago|
prev|
next
[-]
Why give apple/nvidia your money?
reply
upvoteby badsectoracula13 hours ago|
parent|
[-]
Jokes on you, i'm running my local models on AMD :-P
reply
upvoteby theshrike7917 hours ago|
prev|
[-]
The author got $50 free credits.

Also Anthropic is by far the best, open (local) models are glorified autocomplete at best unless you casually have 20k€ worth of hardware at home.

reply
upvoteby binary001017 hours ago|
parent|
next
[-]
Disagree. Qwen 3.6 and opencode have built and helped plan entire feature sets such as vectorizing and searching, setting up UI to manage categorized search data. Some test systems around this, etc.

Very usable locally assuming you setup your local tooling correctly and you are an actual programmer who can generally help drive this stuff correctly and not just a vibe coder.

reply
upvoteby theshrike7915 hours ago|
parent|
[-]
How big of a Qwen model are you running that can plan and implement entire feature sets?

I’ve tried multiple that I can run locally and they’re all very much just glorified autocomplete, but slower - on a M4 Max MacBook

reply
upvoteby binary00109 minutes ago|
parent|
[-]
I'm running qwen 3.6 35b.

I'm using opencode here's one of the projects I've had it complete - just so you know exactly what it's getting done.

I have a large (300,000k loc) sims-like game that I've hand written over last 3 years.

I have a lot of internal administration tooling that has to be built to manage stuff like icons, NPC brain data, world lore, world actions, all kinds of 3d game data, etc, etc.

One example I had qwen do: Work with me to plan out a feature for an admin panel to manage searchable vector embeddings for each NPC's personality, this was around 600 loc across 4 files, back-end database, front-end UI logic, and front-end templating.

It made 3 small mistakes I told it to sort out and fix, which it did.

I essentially let it do it's thing while I was working on main game core coding. So I was pretty hands off and it planned things out nicely before-hand and got my approvals before it built it.

I really wouldn't call it "glorified auto complete"

reply
upvoteby eikenberry17 hours ago|
parent|
prev|
[-]
Why assume local when you can easily use any of the open models via openrouter or any number of similar services.
reply
upvoteby theshrike7915 hours ago|
parent|
[-]
The OP said “ But why give Anthropic/openai our money? Nonsense. Use open models”

Then I’d be giving money to openrouter and a Chinese model provider, is that better?

reply
upvoteby eikenberry14 hours ago|
parent|
[-]
Yes, it is better. They are releasing open models, unlike Anthropic. Additionally other (non-chinese) companies run the open models, so if that is the issue you have options.
reply
upvoteby signatoremo32 minutes ago|
parent|
[-]
"If you don't pay for a product, you are the product". That's always been emphasized on HN threads related to FB, Google, etc.

Are LLMs different?

reply