> but i wonder how the performance would be on compute workloads running with NVME as a swap for GPU VRAM.

4x as slow in absolute best case, NVMe drives have 4 PCIe lanes usually