The terribleness of VNC (vs RDP) is what gets you. A GUI client in that VM sucks to access. If it didn't, a GUI client wouldn't be easily rejectable.
replySo use RDP?
reply(Or x forwarding over ssh, or waypipie if you only need to access a gui application, not a desktop).