upvote

points

by sparkling1 days ago |
comments
upvoteby Manfrednotfunny1 days ago|
next
[-]
I'm waiting for the speed/quality per dollar metric to go down a little bit further and then I will def run it at home.

Its not just that you send a sentence to an API endpoint, you always send EVERYTHING to that agent as a context.

You want to analyse your spending history? You now send everything to someone.

Either no one cares but understands this implication on how easy it is to really capture you or no one really things about it.

But i'm a lot more diligent on what I send. I disabled the gemini activity feature for example because google started telling me that my stuff could be reviwed by humans.

reply
upvoteby plufz23 hours ago|
parent|
next
[-]
Yeah, it does feel a bit silly with my encrypted disks, encrypted backups, unique passwords, advanced router, etc, while I send everything I do in plain text to anthropic.
reply
upvoteby 19 hours ago|
parent|
prev|
next
[-]
deleted
reply
upvoteby zbendefy21 hours ago|
parent|
prev|
[-]
Similiarly I wonder why we dont run our own email server despite the sensitive data there.
reply
upvoteby Manfrednotfunny20 hours ago|
parent|
[-]
I did, it started to become too much work to run it well due to all the spam :| (even with the right signatures and configs, until you learn what a blacklisted ip is and that ips need some time of 'positive history' and what not.....)

But at least with your email, you had to trust only one company, as shitty as it is.

Separation of concerns was also easy.

Now with OpenRouter, you just might by accident, send your whole context to just everyone because OpenRouter just routes to different models and you might just switch around between some free model, the good one etc. And it is always the whole context.

reply
upvoteby zoobab1 days ago|
prev|
next
[-]
"With dirt cheap models like deepseek-v4-flash that will run "forever" on $10, the answer for me is clearly: no."

When it's free, you are the product.

reply
upvoteby IMTDb1 days ago|
parent|
next
[-]
Deepseek flash is open weight, this means we can download and run that model without any connection to deepseek, no data/tokens/usage data ever reaches them. They cannot make us their product.
reply
upvoteby Gigachad22 hours ago|
parent|
next
[-]
All those random api providers are absolutely scooping up your data though. And the hardware to run it locally is absurdly expensive.
reply
upvoteby ekianjo20 hours ago|
parent|
prev|
[-]
Running Ds flash at acceptable speeds is challenging unless you have several thousands of dollars to invest
reply
upvoteby prplxd_nihilist1 days ago|
parent|
prev|
next
[-]
I see many people saying deepseek and other chinese providers have always been profitable. Also they show their training costs publicly. Can't say for sure since I have not used it personally, but I think they'll for sure outlive the western SOTAs.
reply
upvoteby LogicFailsMe22 hours ago|
parent|
[-]
OpenAI apparently runs a profitable inference business with 40% gross margin, but their advertising budget is nutso and their real costs are pretraining and research. I suspect Deepseek's comp is not predicated on capturing the lightcone of all future value, some googling insinuates their top pay is $212K US which would support that suspicion. Compare and contrast with the $1.35M and up at OpenAI.
reply
upvoteby amrit312823 hours ago|
parent|
prev|
[-]
Ah yes, I'm sure Trovalds and Stallman are harvesting my data through free software, aren't they? This argument is used by boomers who were fed cold war era propoganda that surely everybody is selfish, and you're always at fault.
reply
upvoteby kipchak21 hours ago|
parent|
[-]
Think they're talking about things that are free as in beer but not free as in freedom, not FOSS
reply
upvoteby halJordan1 days ago|
prev|
[-]
It's the size of a big vm. There's nothing wrong with reserving that much working space for one item.
reply