I just got GGUF Q4 XL Qwen Flash Next 3.8 working on my V100 engine: https://stealthgoat.com/fnfl/pelicans.html
reply4 pelicans at once!
What's the point of using it without reasoning? Isn't that what Luna's for?
replyIt's neat that we can now compare the Terra without reasoning pelican (cost 0.64 cents) with the equivalently priced Luna with reasoning pelicans (Luna xhigh is 0.40 cents, Luna max is 0.91 cents). I think the Terra low one compares favorably to those, though I'd suggest also comparing them on tasks more representative of real work than generating pelican SVGs!
replyTerra without reasoning is almost certainly going to be faster than Luna on High (which is roughly equivalent in intelligence according to AA).
replya bigger model still has more built-in knowledge to draw from, even without reasoning.
replyI appreciate that most of these pelicans are not holding the handlebars, i think that's more realistic than the alternative
replyDo you have an agent scanning the front page waiting to post the pelicans?
replyI should do but no, it's just a bad HN habit.
replyI can literally see what the training data sample looked like that they included, so it performs well on this benchmark.
reply12 seconds for a pelican on low. Pretty good.
replySeems Gemini is way ahead in pelican drawing
replyApparently Google made it a point to train their models to output SVG, among other things, so that helps
reply