Yes obviously. That VRAM is also slower and has weak compute attached. Loading to the external GPU will slow things down too much.