2000$ dollars per month will get you 8xAMD-MI300X on Oracle.
replyI have deployed multiple setups with 2/4/8 x H100/200 to do data entry with LLMs at big companies. Trillions of tokens already inferenced ok those. The starting price is about 100k.
calculator shows $35,712 instead? https://imgur.com/a/CNurw0v
replyTalk to your Oracle Cloud representative wink.
No discount on Nvidia, plenty on AMD. IBM is also offering incredible discounts on Intel Gaudi accelerators.
reply