but but but but unified memory! (jk, I don't actually believe in Apple marketing words)
replyThere might be future optimizations. Like, have your small model do COT to find where to look for memory that is relevant.
There might be future optimizations. Like, have your small model do COT to find where to look for memory that is relevant.