I'll correct myself: it sounds good for about 5 seconds before you think about it and realize it's an unworkable idea which creates more problems than it solves.
I also did that for some time, I just don't perceived clocks to have a single point that is up and mentally rotated clocks all the time. The hours just lost their meaning beyond their numerical value.