Definitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc!
replyWill have to try it out. I always thought that was more for fine-tuning and less for inference.
replyOh yes sadly we partially mis-communicated haha - there's both and synthetic data generation + exporting!
reply