upvote

points

by kajecounterhack21 hours ago |
comments
upvoteby embedding-shape20 hours ago|
next
[-]
> Have you found Gemma 4 31B better than Qwen 3.6 27B Q8?

Which quant of Gemma? For coding Qwen seems to be pretty far ahead, but generally Gemma seems to have a "vaster" set of knowledge, but armed with a search tool it doesn't really matter, and Qwen 3.6 been really great for all sorts of tool calling. I mostly do programming and related things though, fwiw.

> I was going off of peoples' opinions on reddit

It's extremely astroturfed all over the place, especially the larger subreddits, and especially the one related to a specific animal in a specific location. It's sad, as early on it was a great resource, but now it's mostly paid posts and a race to the bottom, with lots of piling, and all the knowledgeable people I used to recognize are nowhere to be found.

reply
upvoteby xenophonf19 hours ago|
parent|
[-]
It took me way too long to realize you were referring to r/localllama.
reply
upvoteby MoonWalk19 hours ago|
parent|
[-]
Why the obfuscation in the first place?
reply
upvoteby embedding-shape8 hours ago|
parent|
next
[-]
Just a bit of flair. Also, bunch of people have "keyword watchers" setup for various terms, so when you mention certain things on HN, reddit and elsewhere, you get commentators who enter the conversation not because the context or larger conversation, but because the single term/thing they care deeply about was mentioned, and it just gets very boring to read the whole attackers/defenders comments over and over again. But ultimately I just did it like that because it was more fun to write it like that.
reply
upvoteby zozbot23418 hours ago|
parent|
prev|
[-]
I'm not sure that GP is correct, many people in that forum tend to hate Qwen for closing up many of their more recent models and leaving the whole local inference community 'stranded' on their older releases.
reply
upvoteby julianlam14 hours ago|
parent|
next
[-]
Are you sure? Prior to today the sub seems to be pretty partial to Qwen.
reply
upvoteby kajecounterhack14 hours ago|
parent|
prev|
[-]
That was definitely not the subreddit where I got my info.
reply
upvoteby thangalin20 hours ago|
prev|
next
[-]
Yes. I'm using Gemma-4 31B (gemma-4-31B-it-assistant.Q4_K_M.gguf) with llama.cpp to attribute quotations throughout chapters of my sci-fi novel. I started with Qwen3, but couldn't get it to work. Qwen3 TTS Voice Design, on the other hand, is incredible (Qwen3-TTS-12Hz-1.7B-VoiceDesign). I'm using both for an audiobook generator that produces a variety of voices.

Screens:

* https://i.ibb.co/TBBV5nJk/kl-01.png (voice design)

* https://i.ibb.co/nNvvKDyV/kl-02.png (quotation attributions)

reply
upvoteby qingcharles12 hours ago|
prev|
[-]
Gemma 4 31B is enormously impressive. You get 1000 requests/day for free on Google's API and another 1000/day off OpenRouter. Only problem is you get 503 like crazy.
reply