What about it? Google's ML Kit supports Tensorflow models, which are more proliferate and common than Apple's MLX format.

Android phones didn't need "insane community work" because (unlike Apple hardware) they support the same Vulkan compute shaders that PC GPUs use.