> And on the other side, I've also felt the need of having some of the patch holes replaced by knobs, so I could just twist and turn it to evaluate if I want to modulate it, instead of having to actually setup the patch.

That could be an interesting spin on this idea. A freestanding PCB with a jack plug on the back and a knob on the front. Turn the knob, and the jack sends CV accordingly. Maybe with a velcro based system to have the PCB stay still while you twiddle the knob.