WaveTerminal which I use on and off is sort of a graphical terminal like that. Has gui widgets that tile inside the terminal doing alot of the things you might open another pane for IE:file manager resources etc.
Probably not as extensive as you mean but its sort of a stepping stone.
reply> I've been thinking on and off for a few years now about the idea of a "graphical terminal", sitting somewhere between a GUI toolkit and a terminal emulator and a full blown OS for building inter-composable apps and tools and components that could replace TUI based workflows/apps/layouts. I have a vision of every "pro" app just being a different curation and configuration of underlying components rather than actually separate software.
replyAre you thinking about emacs?