> Only Firefox seems to offer it

Ohh I didn't realise Firefox persisted the toggle to Private mode on Android! (Properly, even if you Force Quit). I was using Brave previously, which doesn't do that, so assumed the same.

Though it says "Firefox deletes your cookies, history and site data when you close all your private tabs" ... so I'm not exactly sure what gets persisted and what persisted gets deleted when