upvote

points

by AndrewKemendo12 hours ago |
comments
upvoteby AspireOne12 hours ago|
next
[-]
As somebody who attempted that recently, I seriously doubt that percentage :D
reply
upvoteby nomel11 hours ago|
parent|
next
[-]
Maybe you just have a voice that's, shall we say, in sparse latent space? ;)
reply
upvoteby adastra228 hours ago|
parent|
[-]
New insult dropped!
reply
upvoteby AndrewKemendo10 hours ago|
parent|
prev|
[-]
I have an insane amount of writing output as training data going back a loooong time so it all comes down to how much training data do you have
reply
upvoteby throwup2388 hours ago|
parent|
[-]
Many of us can do it on just our hacker news comments (been there, done that).
reply
upvoteby sshine10 hours ago|
prev|
[-]
What do you mean by your custom models? Do you mean custom prompting?
reply
upvoteby sheepscreek10 hours ago|
parent|
next
[-]
Guessing - finetuned? Or LoRA?

EDIT: Nevermind, see below. I would definitely go with a LoRA though.

reply
upvoteby AndrewKemendo10 hours ago|
parent|
[-]
That’s if I was going to build my own model on myself, which I’m not planning on doing at this point
reply
upvoteby AndrewKemendo10 hours ago|
parent|
prev|
[-]
Couple things:

I have a “style guide” markdown that is pretty expansive

I run an RLHF style loop with me in the middle for all my writing now where I give a voice rant that is over expressive (aka redundant samples of concepts that I want to express clearly) in order to manage lossy compression steps

Then I will manually clean up that last 5% after a half dozen rounds

That sequence goes into the style guide to be referenced as a reasoning chain of thought to map rant > output

It’s been three years of tuning I’d suspect at this point

reply
upvoteby sshine7 hours ago|
parent|
[-]
How did you train your style guide, though?

I have a somewhat expansive style guide, and it still reeks of Claude.

My cleanup is much closer to 40%, which still makes it worth the effort, but sometimes when speed matters, I'll apologize for the slop.

reply
upvoteby ipkstef6 hours ago|
parent|
[-]
I've recently been using gemini argon as a voice judge. so it goes claude ( with style guide) -> voice judge with argon -> claude adjusts. I do that in a few loops before it hard stops if it can't reconcile, and pushes to me for review.
reply