upvote
M5 is excellent, they’ve finally gotten their own tensor cores.

Good for inference; however if you like to train, data format support and effective performance is limited (M5 Pro). Some hardware features are not exposed or extremely slow.

You’ll be fine for inference, but pales in comparison to what a RTX 6000 Pro can do for compute/matmuls/training.

reply
4x faster prompt processing than M3 Ultra.
reply
deleted
reply