Yes, this should be a monster machine. Ampere is an older generation, so I expect that's where some of your issues have been

Start with a quant, you can run the Qwen 27B model at 4-bit on one 3090, presumably 6/8-bit on 2x3090.