For anyone not familiar with Fujitsu's CPUs, worth noting their overall long history with HPC, and more recently, ARM. FugakuNEXT is "NEXT" because the current Fugaku (#1 on TOP500 for a time, and still in the top 10) also used an ARM CPU from Fujitsu.

Benchmarks will be interesting to see but I doubt the cores alone will be able to reach beyond ~500GB/s of BW, and even if they match that figure it will be great.

Man this looks amazing, more competition is always welcome! The issue for Ai inference is always firmware/software support. Up until recently, that rocm hardware became usable, let alone optimized. Nvidia had a big start, now everyone is trying to catch up

Thanks for clarifying why this makes sense for inference.