Yes, but it's pinned to a driver version that I unfortunately can not use. That's precisely why I love your solution, it is the best way to do this.
replyI'm running 8 GPUs attached to a single CPU and that driver is a pretty essential part of getting this to work with P2P between as many cards as possible. The modded 4090 is a problem because the BAR1 it advertises (32G) is smaller than the VRAM so not all software is able to use it (you need two memory segments rather than a single 48G one to make this work). That driver is part of the solution for this problem.
FWIW the gpu unlock ada repo doesn't pin to a driver version, Codex for me just compiled it, and it works with my 615.xx driver even though the fork is for 610.x. I think the repo just uses the firmware from that version. My GPU is 4070ti super.
replyOk, trying it. I'm using a pretty heavily modified 590.48.01 to be able to use those 48G 4090s, they work but they do require a bit of handholding. The main problem is the BAR1 just isn't large enough, it's capped at 32G.
replyHeh, got it working, thank you so much!!
Overall 30% reduction in wall clock time, that's pretty neat (and I'm still not running this at full power but 450 W is a bit much for that puny connector).
I have two of modded RTX 4090 with 48GB VRAM.
But I'm using default drivers.
I'm using models, which uses almost full 48GB.
replyNow i'm curious - am I missing some settings? Do I need to check any of these BAR things?
You're probably not using peer-to-peer then. Try the p2pbandwidthtest that comes with the NV development package to see if you are or not.
replyIf they are forked from my repo whatever driver version they pin doesn't matter, the pin is just clanker stuff really.
What it's used for is just extracting the right booter firmware and loading it, but the whole booter part is reset before handing over to nvidia driver so the versions dont have to match at all.
replyApparently they were, it compiles and installs but I don't see any improvement just yet. I'll keep plugging away at it.
replyreply
That's a fork of GP's work.
replyBut it contains the 4090 variant.
reply