So you have some fun examples?
replySadly crashing on Pixel 9 Pro, but I guess phone GPU with 16GB RAM total wouldnt be enough anyway.
replyRuns on my 16GB M2 Air (firefox). ~7 tok/s
replyIt should be though.
replyEven native AI gallery uses smaller Gemma models. I guess whatever Chrome is using for WebGPU compute on Android is just adding too much overhead.
reply