I certainly travelled during the PERM phase, and my lawyer didn’t even suggest I think about it. I did not travel after submitting the application while waiting for the EAD.

Not a lawyer. PERM is a DOL process. Travel is governed by visas (or parole in some cases). The two are unrelated.