upvote
These are fundamentally different points in design space though, hbm doesn’t have a 10mw idle draw like lpddr does.
reply
Not many workloads are RAM bandwidth limited. Power and latency are much more common bottlenecks, and HBM loses on both of those.
reply
Isn’t memory bandwidth super relevant for AI?
reply
Can’t put HBM in smartphones and laptops. The power drain is too great.
reply