Depending on which model you're running, you might need to use the custom forks.
replyDetails are here -> https://github.com/PrismML-Eng/Bonsai-demo/blob/main/README....
I spent quite sometime trying to install their tools and nothing really worked. I used these repos you shared but the dependencies all fail on mac
replyIf you can share details on where it is failing, we'd love to help fix.
replyYou can also join Discord to communicate with us directly http://discord.gg/prismml
I did not know you guys would be watching. For sure. Let me do that tomorrow when I turn it on again :)
I am happy to see the message. Thanks!
replyDidn't work for me in Unsloth, but it will probably be fixed in a day or two when the next batch of updates comes out.
reply