Unfortunately this adds quite a bit of overhead and would make everything take a lot more time. It might be worth it though.
I've been planning forever to do something similar with length, duration, power, etc.
This is called "number sense". I'm pretty sure we do have evidence under searches for that term, it was well-enough known as a concept when I was in school decades ago and is the reason we don't use calculators when first learning math.
It works quite well. I do the math lessons during bath-time daily with my 6 yo. He's up to the point were he can add multiply pretty much any number by 2, 3 or 4 as long as the product is under 3 digits.
Going from adding single digits to multiplication of random 2-digit numbers by 4 with lessons only during bath-time (no paper or whiteboard) gives a child a great deal of confidence with numbers.