In 2019 the two fastest machines in the world, Summit & Sierra (see top500.org) used ppc64le + Nvidia GPUs.

Yes. There was a generation of POWER that offered NVLink.