Yes! P4 and the other small cards are fantastic. I've been more focused on developing a cooling system around the 2 slot sized cards so I don't have any of these lying around. Are you using P4 for anything outside of LLM work? I'm interested in seeing their image processing capabilities.
replyThat’s cool but 7 - 12 tps is frustrating for anything interactive.
replyHow the hell did you fit 6 P4s in a mATX case?
reply> about $80 (£60)
replyMan, I wish I lived where you guys lived.
Same, and hope I can afford that w/$ $/t, 650w is wild to run here24/7 , would cost me 32% of my salary
reply(650/1000)(24*30)=468 kWh.
replyThat would cost me about $70/month ($0.15/kWh) or someone in California about $234/month ($0.50/kWh).
Do you pay $1/kWh and make ~$1500/month or something? I can’t make the math work for your case.