Agreed, unless AI progress slows down enough that it becomes reasonable to bake weights into circuitry, the conventional approach will probably remain preferable for encoding, at least on power constrained devices.