Just because you enjoy a thing at a certain time in your life, doesn't mean necessarily that you would or could have enjoyed a similar thing earlier.

Besides, social interactions are one of those things that don't depend exclusively on you but also on the environment and on luck. I had better and worse periods, I doubt I could have had only "great periods". Going through periods is how you also learn and get to put some effort to change (the environment and yourself).

In the grand scheme, it's very difficult to miss out on anything.

Taking phrases like "when you're ready" as a condescending insult or ego challenge is a stronger guarantee of pain than simply doing nothing. Your own expectations and misguided impressions are most of the pain.

There are plenty of bitter and unhappy people who got that way by being delusional. Misjudging one's own experiences and accomplishments is what it really means to "miss out".