Same issue with the lightning to 3.5 dongle. Plus the phone sometimes takes like 10s to recognize it.

That problem might be considered a software problem, not a hardware or physical problem. The instant pausing of the music is the real problem. Software developers probably don't move around as much as you do, and I'd bet if they did, this problem would be fixed quickly with a simple timeout setting or something.