No, they're not Olympic athletes but they're considerably more fit than the average American.
It's the same with F1. "We have the best drivers in the world!" You have the best drivers from the self-selection mechanism you impose on the sport. There are zero reasons to think these categories have good overlap.