I mean I think that is ok as long as I explicitly allowed you to.

The problem is, with a phone number anyone can. Phone numbers need to operate more like a shared secret.

I was getting an oil change the other day and the guy asked me for my phone number...

I said why? Do you need to call me?

He said, no we just need it to put in the system and it won't let me proceed without one.

I said ok well here is a fake number since you don't need to contact me.

He was visibily frustrated with me, yet inputed the fake number and it allowed him to proceed.

My point with sharing this story is it seems like we have forgotten as a society what the purpose of the phone number is. Your supposed share it when you want to be able to communicate that's it.

It's turned into a required chokepoint to do anything.

You can trivially accomplish this under the current system. There is no need for a change that imposes your preferences on everyone.