upvote
Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
reply
it enables models larger than was previously possible.
reply
No because the base model from which the distilled or quantized models are derived is larger.
reply