I strongly recommend avoiding HN for intelligent takes on AI internals. This place is full of people who think they can understand these models by vague analogies to the brain and their own pet (and almost-always underdeveloped and philosophically ignorant) theory of mind, and also that you can have a meaningful understanding of these models without at least knowing some very basic linear algebra.

I would recommend going on Twitter (or a Nitter clone) and looking at e.g. Neel Nanda, Nick Camarata, roon, Jon Stokes, or other researchers that are directly involved in this stuff. HN when AI is involved is full of the most incompetent and embarrassing armchair speculators saying things so incoherent they aren't even wrong https://en.wikipedia.org/wiki/Not_even_wrong.