upvote
Runs on my 16GB M2 Air (firefox). ~7 tok/s
reply
It should be though.
reply
Even native AI gallery uses smaller Gemma models. I guess whatever Chrome is using for WebGPU compute on Android is just adding too much overhead.
reply