I think googles been putting more of their money into super long context stuff, not powerful coding stuff. they've got 10million token windows for some internal stuff (Gemini 1.5 Pro Test), more research says meta is also in on the long context game (Llama 4 Scout)
reply