upvote
> There is probably a market for Deepseek/GLM served from non CCP available servers. I might even look into how hard that would be to setup here.

Please do. There is definitely a market for Deepseek / GLM hosted from non-China servers, there's over 20 providers for GLM 5.2 on OpenRouter alone... and they're all either Singapore (home of Z.AI / GLM), China, or US. There is nothing yet listed on OpenRouter from Europe (Inceptron still only has GLM 5.1). And of course, there is absolutely nothing hosted in Australia.

We're in a particularly dire situation in Australia. We're about to be cut off from Claude Fable and premium American models. The European Mistral models are garbage, at least in comparison to US models. Our only hope is going to be Chinese models (GLM 5.2 is good), and we're not even hosting them in Australia.

By the way, if you haven't tried an Anthropic model, it's worth spending at least $20 one month to give Opus 4.8 a try. I only got one night of access to Fable before I was cut off, but one single evening of Fable provided plans that I've been working through for about a week afterwards with Opus 4.8... and that was only Fable, not even Mythos. That's the kind of intelligence lead Australia is about to be cut off from.

(And kudos on the Containers For Change, that's something I do as well - mostly as an exercise incentive to walk to the local recycling machine, because the money certainly doesn't compensate for the time spent on the recycling.)

reply
Cortecs (EU router) lists GLM 5.2 from Tensorix and Nebius https://cortecs.ai/detailedServerlessView/glm-5.2

So two European providers at least

reply
Hosting in Australia is not feasible at Australian electricity prices.

(Speaking as a not-so-proud Australian.)

reply
Same issue in Canada - domestic inference capability for the open models is woefully behind.
reply
Canada has fewer excuses, given sparsely populated places that are cold with nearly infinite water and extremely cheap electricity.
reply
Yep, agreed. Main issue in Canada is a notoriously slow and stingy investment ecosystem. Resource-wise we're incredibly well positioned.
reply
Would you happen to know why there are so many Canadian investments in American telecom?
reply
It's very easy to use other providers. See https://openrouter.ai/ which also lets you filter by where the provider is hosted and their data retention policy.

Jeremy Howard was recommending fireworks.ai as a host of you want to go direct. Or there's Cloudflare.

For subscription alternatives people here on HN seem to mention Open Code Go a lot too https://opencode.ai/go

reply
> I'm using the Chinese DeepSeek provider, so everything done there could potentially be taken and used by the CCP

As opposed to Anthropic or OpenAI where everything done could potentially be taken and used by the US government.

Also, replace "could potentially" with "will definitely" in both cases, there's no conspiracy here.

We're stuck between two bad positions, so just use the one that's best for you, and wait for a better solution to arrive.

reply
You don't seem to like the "CCP" and their political views, but why are you using their sponsored models?

Why don't you exclusively host and use the open-weight western models, even if right now they don't perform as well?

I'd like to know the psychology behind this, because your actions feel contradictory to me.

reply