For one thing you do not need to do much arithmetic to do algebra, for another estimating and getting a feel for numbers is not the same skill as learning a bunch of arithmetic techniques. No one is going to do long division while shopping.
I can keep enough digits in my working memory to do long division in the grocery aisle.
I also compulsively factor numbers on license plates..