You can definitely handle camera rotation via vector operations on rotation matrices.

Your response is well-grounded--trig is trouble. Angles are often fine, but many 3rd party library functions are not.

Have you ended up with a set of self-implemented tools that you reuse?