upvote
reply
Optane? (Too soon?)
reply
Optane was targeting the latency gap, while HBF targets bandwidth. Given how LLMs work, HBF is perfect for offloading.
reply
interesting!
reply
yes! I guess future hardware designs will have something like that!
reply