You can see exactly what prompts we used and the results here: https://github.com/CTGT-Inc/lineage-eval/tree/main/data
replyWe found V4 Flash was significantly more censored than the baseline.
Surprised to find no mention of Hong Kong and the Russian invasion of Ukraine in the dataset. It's interesting how the fine-tuned model will respond.
replyYou can try it yourself!
https://playground.ctgt.ai
replyCould just be resources available? Deepseek is the easiest to get up and running on hardware that's pretty readily available:
reply unsloth/DeepSeek-V4-Flash-GGUF 4bit ~140GB
unsloth/Kimi-K3-GGUF 4bit ~1.5TB
unsloth/GLM-5.2-GGUF 4bit ~400GB