Models learn. It just costs $10B and 1 year to do what a human does every night.
replyLoRAs or even full fine-tunes would be much cheaper than that, and with some investment in the right infra could be updated regularly. And at least LoRAs can be swapped in and out cheaply, making them usable in large-scale inference providers. But there seems to be limited appetite in offering this. Both Anthropic and OpenAI no longer offer fine tuning for current models
replydoes lora do a good job at teaching the model new things that werent in the training data?
replywithout trillions of examples of following instructions at a million context length, im not convinced the behaviour is in the weights to begin with
No. Lora is for tuning behaviour and how the model applies what it learned in training. Teaching a model new facts is still expensive.
replyAt least these costs are currently preventing the planets surface from being covered in paperclip maximizers for the moment.
reply