This is pretty much my flow as well. Haven't gone beyond managing three work trees in parallel. It's nice being able to test locally against multiple work trees -- one is at 3000, then 3001, etc.
Gh issues works surprisingly well as an agent board. Labels for state, one issue per feature. The part i haven't figured out yet is how to know when the output is actually done vs just "looks done" to the agent.
How much are worktrees benefitting you? If I can describe the work so clearly that it can be done in parallel, I find Claude can typically one shot so parallel work isn't needed.