> I also wonder if they are glad they published it
replyJeff Dean is asked this question by Geoffrey Hinton at 37:35 - might worth watching. Overall an interesting video.
Link with time code: https://youtu.be/ue9MWfvMylE?t=2261
replySo Google allowed publishing the Attention paper because they didn't understand its value.
replyThey patented it. When the dumb money stops sloshing around, we'll start to see the fallout from that.
reply