I tried stable-diffusion.cpp, following its compile guide here[0], and its Qwen Image-2.1 specific instructions here[1]. It works out of the box. I made a test pelican[2]. It took 3 minutes on a CPU.
[0] https://github.com/leejet/stable-diffusion.cpp/blob/master/d...
[1] https://github.com/leejet/stable-diffusion.cpp/blob/master/d...
total params memory size = 15645.19MB (VRAM 15645.19MB, RAM 0.00MB):
text_encoders 7669.77MB(VRAM),
diffusion_model 7331.05MB(VRAM),
vae 644.38MB(VRAM),
controlnet 0.00MB(N/A),
extensions 0.00MB(N/A)In fact, like it appears in the reports above, it is "7b" as in
> 7B parameters in its visual generation component
It seems they calibrated the size to fill a 16GB VRAM near the limit. RAM requirements will vary.
Edit x2: As usual I'm in a twisty maze of pip packages that don't work together, with obscure errors about missing modules, even though I followed the instructions on the page to the letter. I really wish people didn't use Python for this stuff. A simple C/C++ program would be so much better.
I think it will technically run on anything that has enough memory. I just tried it on a standard laptop (dual-channel DDR5), and it took about 3 minutes for a 512x512. If you'd want to run it at interactive speeds, you would want a GPU (one which fits this in VRAM).
> "I really wish people didn't use Python for this stuff. A simple C/C++ program would be so much better."
You mean besides stable-diffusion.cpp ?
Yes, thanks, I didn't know about that. Will try it.
it already has day-0 qwen image 2.1 support!
I have FLUX.2 klein and dev, Ideogram, LaDA-Image and SenseNova locally. Works great. Ive never touched a file.
The days of making container yamls myself is over. I read them but I dont edit anymore.
I think that's all Python (not a direct executable).
You could just do (see the "Quick Start") four `pip install` and have a dozen lines script to generate the image. But `llama.cpp` and similar do not require e.g. installing Torch (or PyTorch) - you can use `llama.cpp` on a non-specialized machine.
I don't think I have ever once run "pip install transformers" and had it work without three rounds of fiddling
Yep, that's (also) what I meant ;)
Lean, efficient... Also sensible and trouble-less.
> Currently, we support image, audio and video input.
Image outputs are supported, videos I'm not sure but I don't think that's an output, just a preview of the equirectangular example, so, same question here, what does this model outputs that isn't supported?
I understand that llama.cpp could only output text, last time I checked (I do not know how to find a good source for that though).
See https://github.com/ggml-org/llama.cpp/blob/master/src/llama-... , the
enum llm_arch {
At the risk of stating the obvious llama.cpp isn't just about LLaMa as https://github.com/ggml-org/llama.cpp/blob/master/src/llama-... someone else pointed out.