upvote

points

by k__8 hours ago |
comments
upvoteby himata41138 hours ago|
next
[-]
https://deepswe.datacurve.ai/ or https://artificialanalysis.ai/ pareto frontier graph.
reply
upvoteby k__8 hours ago|
parent|
[-]
Thanks!

What is the parento frontier?

reply
upvoteby Evidlo7 hours ago|
parent|
next
[-]
If you have multiple metrics to evaluate goodness of a design, one would normally need to decide which metrics they care the most about in order to find the "best" design.

The Pareto frontier tells you which designs are the best in at least one of your metrics (non-dominated by another design). For example if you're selecting a car and you care about both speed and mpg, a Formula 1 car and a Prius might lie on the Pareto frontier, but a Model T Ford would not.

reply
upvoteby StevenWaterman7 hours ago|
parent|
prev|
next
[-]
The set of models that are pareto-optimal, IE for some set of variables, no other model strictly dominates them = no other model is better than them on every variable.

So like, on a cost-intelligence graph, the cheapest and most intelligent models are pareto optimal. Then in-between those if you have

- cost $3 intelligence 6

- cost $1 intelligence 5

- cost $2 intelligence 4

The 1st and 2nd are pareto optimal, the 3rd is not, because it's dominated by the 2nd (2nd is cheaper AND more intelligent at the same time)

reply
upvoteby evanwolf7 hours ago|
parent|
prev|
[-]
try PARETO
reply
upvoteby 383toast8 hours ago|
prev|
[-]
considering token efficiency as well I presume?
reply
upvoteby schergr8 hours ago|
parent|
[-]
I'm struggling to decide whether I feel comfortable sending my data to these Chinese models
reply
upvoteby himata41138 hours ago|
parent|
next
[-]
It's actually less likely for china to abuse your data in a way that is harmful towards you than for american labs to do the same. Claude has attempted in testing to report you for 'unethical' usage to 3 letter agencies.
reply
upvoteby dash28 hours ago|
parent|
[-]
How do we know that Chinese models would not do the same? What makes you so sure that China is less likely to abuse my data?
reply
upvoteby swiftcoder8 hours ago|
parent|
next
[-]
It’s not that the Chinese firms are any less likely to misuse your data, it’s that you don’t live in china, so their abuse of your data is unlikely to directly impact your day-to-day life in the same way
reply
upvoteby himata41138 hours ago|
parent|
prev|
[-]
There's just really no incentive all they really want is just to train on that data to improve performance which in turn actually benefits your usecase since it becomes trained on that data and made available back to you. American labs take that data anyway and store it for years to possibly report you for misuse in the future for whatever reason they want. For example: you're very critical of X so they pull up your conversations and weaponize it.
reply
upvoteby jsLavaGoat7 hours ago|
parent|
[-]
really weird that they would download every SF-86 file the government had and Equifax credit records of every American then.
reply
upvoteby Saris8 hours ago|
parent|
prev|
next
[-]
Are you comfortable sending it to US ones? Especially if installing Claude Code or another tool on your PC and it can collect all the data it wants..

On Openrouter Kimi K3 says it does not retain data or train on it, which is better than what US hosts claim for Claude, ChatGPT, etc.. as they collect and retain data even if you disable training on it.

Opencode or similar open source tool + a zero data retention provider is about the best option aside from running a smaller fully local model on your own PC.

reply
upvoteby jszymborski8 hours ago|
parent|
prev|
[-]
For open weight models, you can choose from a few providers. Each have their own caveats, none of ToS'/Privacy Policies I entirely trust, nor do many make renewable energy claims.
reply