I don’t know about museums near you, but most museums I’ve been to internationally are free to enter and to see most of their exhibits. They’ll often have much more in their collections than what’s on display, but they’re absolutely still a public good.
We also have a responsibility to preserve stuff from the past for future generations. As our ancestors have done for us.