In my opinion (which might not be shared by everyone) this is a you problem.
Developers in the team not using decontainers should not have to worry about your environment.
ide/local-env stuff should be ignored in the users git setup, everything that the repo creates (build artifacts, environment files etc) should be in the repo.
That's an interesting case, where you are crossing operating systems.
---
That said, the easier change is still a one/two line bind mount that trying to exhaustively list ignored directories for every IDE or tool under the sun.