The white paper says "mean-active memory pressure down to 1.95 GB for 1-bit Bonsai Image 4B and 2.38 GB for
Ternary Bonsai Image 4B". Storage is on the linked page, and is about half that.
replyThat is very low, looks like it should run in base MacMini M4 with 16GB RAM. I understand it is not released yet? What sort of harness is necessary for this type of model? (I have only used coding agents through GH Copilot in VS Code, the JetBrains AI tool and Pi, this last one was sort of a pain to setup…)
replyFor ternary mlx, size on disk is 3.8GB. 512x512 peak memory use is ~3.7
reply