170GB/s memory bandwidth Configurable up to 32GB unified memory
307GB/s memory bandwidth Configurable up to 64GB unified memory
That is also the factor you want to take into account for AI inference, of course.
- Apple M5 Ultra chip
- 30-core CPU with 10 super cores and 20 performance cores
- 64-core GPU
- Neural Accelerators
- Hardware-accelerated ray tracing
- 32-core Neural Engine
- 1.2TB/s memory bandwidth
one point 2 terrabyte a second memory bandwidth....
512gb coming later this year
but at the cost of a small car
I just wait for practical real live numbers with real stacks i use.
And btw. they reduced the memory bandwdith on the M4 in comparision to its previous version by 40gb/sec or so, you need to wait to see.
Says 1.2x for multithreaded and doesn't specify (I presume smaller) for single-threaded. That's compared to M5 not M5 Pro, so M5 Pro is likely significantly faster.