Our skippy library is a patch queue on top of llama that allows us to access internal information, such as activations, and filter tensors on model load.
replyThis really should be in the blogpost. It’s both useful info and basic courtesy to be explicit about which underlying inferencing engine you are using
reply