Easiest way to do it would be enable ssh in container and then use VSCode ssh extension. Your host VSCode “becomes” your container VSCode.

I run it natively on my rocky8 container with UI sometimes but usually just do ssh