The base weights can't be updated but from what I recall it allows adding a low rank adapter to customize the model a little bit.