My take as well. The dual-3090 and dual-spark configs have an outsized voice in this conversation. I'd add pipeline parallelism vs tensor parallelism and in the case of TP setting your lanes and speeds per card.
replyWould love to have multi-gpu support eventually but it's a balance between whats popular and what actually has good quality benchmarks available. Multi-gpu numbers can also vary between setups
replyNvlink just is not available above 3090 and below B200 (datacenter stuff). E.g. https://www.gpuyard.com/tutorials/howto/setup-nvlink-blackwe...
reply