There are many cheap, open models available on the vLLM engine: https://huggingface.co/models?other=vllm. This includes gpt-oss, LLaMa, and Gemma. This is in addition to Qwen, Deepseek, Mistral, Kimi, GLM, and Poolside.
replyYes, and I keep copies of the ones I like[0]. I can't run the huge ones, but the ones I can run aren't as good the "frontier" models. Regardless, I expect they will be considered contraband someday.
reply[0] - I've been using llama.ccp and Ollama. I should checkout vLLM.
Is there any precedent you’re referencing? Many things that are expensive, slow, scarce, or bad are going to become cheap, fast, abundant, and awesome. Historically people like that a lot.
replyI just have trouble seeing how we get to there from here. Vote to ban AI? Has anything like that happened before?