When it comes to tax issues etc. it turns out the company registration is meaningless. The sweet spot has to be somewhere in the middle. Starting a company shouldn't be something you expect to do in a day but it also shouldn't require you to sell a kidney or fill in pointless forms.
Taxes have nothing to do with the physical location of the company. You go after the owners, and I'm pretty sure you can't open a company in the UK anonymously.
Even banks are required to validate now, had my bank asking me to validate details even when i have my business for 6 years, same company, same address, and same bank account.