You could probably run a Q2-Q3 with 2x DGX Sparks. So...$12k at today's prices. Plenty of folks are running DS 4.1 Flash with Strata and some GPU + bulk in system memory. Maybe more like $3k-$4k? But speeds come down quite a bit.
reply[flagged]
replyQ2. Woof.
replyIt actually benchmarks quite well. Honestly not practically worse than the Q4 native weights.
reply