Companion App gets stuck on Pairing Devices and won't go back to ride

I connect all my devices directly to Zwift on my PC. I do not connect devices using my mobile device. However, everytime hit A on my keyboard and go in the pairing screen on my PC, the Companion App on my phone gets stuck in Pairing Devices mode and will stay stuck there for the rest of the ride. I can close the app and reopen, but it still stuck until the ride is done. This is getting to be a problem because I often hit A by accident while typing a message and sometimes I use it to stop the bike when trying to regroup in a ride.